May 26 00:07:38.827363 ip-10-0-134-90 systemd[1]: Starting Kubernetes Kubelet...
May 26 00:07:39.228966 ip-10-0-134-90 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 00:07:39.228966 ip-10-0-134-90 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 00:07:39.228966 ip-10-0-134-90 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 00:07:39.228966 ip-10-0-134-90 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 00:07:39.228966 ip-10-0-134-90 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 00:07:39.229900 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.229811    2576 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 00:07:39.234008 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.233990    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 00:07:39.234008 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234008    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234011    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234015    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234018    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234021    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234024    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234026    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234041    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234044    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234046    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234049    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234052    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234055    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234057    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234060    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234064    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234075    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234078    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234081    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 00:07:39.234094 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234085    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234088    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234091    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234093    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234096    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234099    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234102    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234104    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234107    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234110    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234113    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234116    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234118    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234120    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234123    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234126    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234128    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234131    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234133    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234135    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 00:07:39.234553 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234138    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234140    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234143    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234145    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234148    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234151    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234153    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234156    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234158    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234161    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234164    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234166    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234169    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234172    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234175    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234178    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234180    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234184    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234186    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234189    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 00:07:39.235105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234192    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234194    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234197    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234200    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234203    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234207    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234211    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234214    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234217    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234219    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234222    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234224    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234227    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234229    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234232    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234234    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234238    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234240    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234243    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234246    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 00:07:39.235595 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234249    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234251    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234254    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234257    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234259    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234261    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234678    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234683    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234686    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234689    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234691    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234694    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234697    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234699    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234702    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234704    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234706    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234709    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234711    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234714    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 00:07:39.237157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234716    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234718    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234721    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234723    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234726    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234729    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234731    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234733    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234736    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234738    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234741    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234743    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234746    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234749    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234753    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234756    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234758    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234761    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234765    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234768    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 00:07:39.237644 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234771    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234773    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234776    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234778    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234781    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234783    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234786    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234789    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234791    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234794    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234798    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234800    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234803    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234805    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234809    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234812    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234815    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234818    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234821    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 00:07:39.238152 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234823    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234826    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234828    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234831    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234833    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234836    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234838    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234841    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234843    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234846    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234849    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234851    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234854    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234856    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234859    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234861    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234864    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234866    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234869    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234872    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 00:07:39.238613 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234874    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234877    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234879    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234881    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234884    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234886    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234889    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234891    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234894    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234896    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234898    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234901    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.234903    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.234985    2576 flags.go:64] FLAG: --address="0.0.0.0"
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.234995    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235006    2576 flags.go:64] FLAG: --anonymous-auth="true"
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235013    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235021    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235027    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235047    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235052    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 00:07:39.239157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235055    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235060    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235063    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235067    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235070    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235073    2576 flags.go:64] FLAG: --cgroup-root=""
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235076    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235079    2576 flags.go:64] FLAG: --client-ca-file=""
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235082    2576 flags.go:64] FLAG: --cloud-config=""
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235084    2576 flags.go:64] FLAG: --cloud-provider="external"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235087    2576 flags.go:64] FLAG: --cluster-dns="[]"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235091    2576 flags.go:64] FLAG: --cluster-domain=""
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235094    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235097    2576 flags.go:64] FLAG: --config-dir=""
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235099    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235103    2576 flags.go:64] FLAG: --container-log-max-files="5"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235107    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235110    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235114    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235117    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235120    2576 flags.go:64] FLAG: --contention-profiling="false"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235123    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235126    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235129    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235132    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 00:07:39.239652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235137    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235140    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235143    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235146    2576 flags.go:64] FLAG: --enable-load-reader="false"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235149    2576 flags.go:64] FLAG: --enable-server="true"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235152    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235157    2576 flags.go:64] FLAG: --event-burst="100"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235160    2576 flags.go:64] FLAG: --event-qps="50"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235163    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235167    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235170    2576 flags.go:64] FLAG: --eviction-hard=""
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235174    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235178    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235180    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235183    2576 flags.go:64] FLAG: --eviction-soft=""
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235186    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235189    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235192    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235195    2576 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235198    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235201    2576 flags.go:64] FLAG: --fail-swap-on="true"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235203    2576 flags.go:64] FLAG: --feature-gates=""
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235207    2576 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235210    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235213    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 00:07:39.240277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235217    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235219    2576 flags.go:64] FLAG: --healthz-port="10248"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235222    2576 flags.go:64] FLAG: --help="false"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235225    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-134-90.ec2.internal"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235228    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235231    2576 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235234    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235237    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235241    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235243    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235246    2576 flags.go:64] FLAG: --image-service-endpoint=""
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235249    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235252    2576 flags.go:64] FLAG: --kube-api-burst="100"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235255    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235258    2576 flags.go:64] FLAG: --kube-api-qps="50"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235261    2576 flags.go:64] FLAG: --kube-reserved=""
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235264    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235267    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235270    2576 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235273    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235276    2576 flags.go:64] FLAG: --lock-file=""
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235279    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235282    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235284    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 00:07:39.240871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235290    2576 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235293    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235296    2576 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235298    2576 flags.go:64] FLAG: --logging-format="text"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235301    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235305    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235307    2576 flags.go:64] FLAG: --manifest-url=""
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235310    2576 flags.go:64] FLAG: --manifest-url-header=""
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235315    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235318    2576 flags.go:64] FLAG: --max-open-files="1000000"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235323    2576 flags.go:64] FLAG: --max-pods="110"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235326    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235329    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235331    2576 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235334    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235337    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235340    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235343    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235351    2576 flags.go:64] FLAG: --node-status-max-images="50"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235354    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235357    2576 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235360    2576 flags.go:64] FLAG: --pod-cidr=""
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235363    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 00:07:39.241468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235369    2576 flags.go:64] FLAG: --pod-manifest-path=""
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235372    2576 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235376    2576 flags.go:64] FLAG: --pods-per-core="0"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235379    2576 flags.go:64] FLAG: --port="10250"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235382    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235386    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fc06ec7e9a10ce2d"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235389    2576 flags.go:64] FLAG: --qos-reserved=""
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235392    2576 flags.go:64] FLAG: --read-only-port="10255"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235395    2576 flags.go:64] FLAG: --register-node="true"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235398    2576 flags.go:64] FLAG: --register-schedulable="true"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235401    2576 flags.go:64] FLAG: --register-with-taints=""
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235404    2576 flags.go:64] FLAG: --registry-burst="10"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235407    2576 flags.go:64] FLAG: --registry-qps="5"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235410    2576 flags.go:64] FLAG: --reserved-cpus=""
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235412    2576 flags.go:64] FLAG: --reserved-memory=""
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235417    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235420    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235423    2576 flags.go:64] FLAG: --rotate-certificates="false"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235431    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235434    2576 flags.go:64] FLAG: --runonce="false"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235437    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235440    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235443    2576 flags.go:64] FLAG: --seccomp-default="false"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235446    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235449    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235452    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 00:07:39.242008 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235455    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235458    2576 flags.go:64] FLAG: --storage-driver-password="root"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235461    2576 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235464    2576 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235467    2576 flags.go:64] FLAG: --storage-driver-user="root"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235470    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235473    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235477    2576 flags.go:64] FLAG: --system-cgroups=""
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235480    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235486    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235491    2576 flags.go:64] FLAG: --tls-cert-file=""
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235494    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235497    2576 flags.go:64] FLAG: --tls-min-version=""
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235500    2576 flags.go:64] FLAG: --tls-private-key-file=""
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235503    2576 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235506    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235508    2576 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235511    2576 flags.go:64] FLAG: --v="2"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235515    2576 flags.go:64] FLAG: --version="false"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235520    2576 flags.go:64] FLAG: --vmodule=""
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235524    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.235527    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236103    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236143    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 00:07:39.242640 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236152    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236160    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236167    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236175    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236183    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236193    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236201    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236208    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236214    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236229    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236236    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236243    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236252    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236262    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236272    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236280    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236288    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236297    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236303    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236308    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 00:07:39.243230 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236314    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236320    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236331    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236338    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236344    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236349    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236356    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236362    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236371    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236382    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236388    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236416    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236421    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236425    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236434    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236439    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236443    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236447    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236451    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 00:07:39.243751 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236455    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236460    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236464    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236468    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236472    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236476    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236480    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236484    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236493    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236497    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236501    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236505    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236509    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236514    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236518    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236522    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236526    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236530    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236535    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 00:07:39.244243 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236539    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236548    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236552    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236556    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236561    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236568    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236591    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236595    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236599    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236603    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236608    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236612    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236616    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236620    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236629    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236633    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236637    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236641    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236645    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 00:07:39.244705 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236649    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236655    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236661    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236665    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236669    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236673    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.236677    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.237353    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.244371    2576 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.244484    2576 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244533    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244539    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244542    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244545    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244548    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 00:07:39.245201 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244551    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244554    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244556    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244559    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244561    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244563    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244566    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244569    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244571    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244574    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244577    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244579    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244581    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244584    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244587    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244590    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244592    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244594    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244597    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244599    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 00:07:39.245601 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244602    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244604    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244607    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244609    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244612    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244616    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244621    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244625    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244628    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244631    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244634    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244637    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244639    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244641    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244644    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244646    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244649    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244651    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244655    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 00:07:39.246105 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244659    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244662    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244665    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244667    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244670    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244672    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244675    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244677    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244680    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244682    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244685    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244687    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244690    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244692    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244695    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244698    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244700    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244703    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244706    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244709    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 00:07:39.247294 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244712    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244715    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244718    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244720    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244723    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244725    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244728    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244730    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244733    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244735    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244738    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244740    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244743    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244745    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244748    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244750    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244752    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244755    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244757    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244760    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 00:07:39.247776 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244762    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244764    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.244770    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244871    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244875    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244878    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244880    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244883    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244885    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244888    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244890    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244893    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244896    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244899    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244901    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 00:07:39.248379 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244904    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244906    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244909    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244911    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244914    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244916    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244918    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244921    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244923    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244926    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244928    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244931    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244933    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244935    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244939    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244941    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244944    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244947    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244949    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 00:07:39.248756 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244951    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244954    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244957    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244959    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244962    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244964    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244966    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244969    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244971    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244974    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244977    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244979    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244982    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244984    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244986    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244989    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244991    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244993    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244996    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.244998    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 00:07:39.249383 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245001    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245003    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245005    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245007    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245026    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245029    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245033    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245036    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245039    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245042    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245045    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245047    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245050    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245052    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245055    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245058    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245061    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245063    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245066    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 00:07:39.249861 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245068    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245071    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245073    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245076    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245078    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245081    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245084    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245086    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245089    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245091    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245094    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245096    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245098    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245101    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245103    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:39.245106    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 00:07:39.250324 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.245110    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 00:07:39.250708 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.245244    2576 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 00:07:39.250708 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.249441    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 00:07:39.250708 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.250289    2576 server.go:1019] "Starting client certificate rotation"
May 26 00:07:39.250708 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.250396    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 00:07:39.250708 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.250437    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 00:07:39.271633 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.271608    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 00:07:39.272806 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.272784    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 00:07:39.285434 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.285404    2576 log.go:25] "Validated CRI v1 runtime API"
May 26 00:07:39.290869 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.290844    2576 log.go:25] "Validated CRI v1 image API"
May 26 00:07:39.294845 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.294825    2576 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 00:07:39.297610 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.297581    2576 fs.go:135] Filesystem UUIDs: map[3e0a81a2-4c69-4375-aab3-a87d8de0d0ca:/dev/nvme0n1p4 5fd5049d-0afd-49db-b11e-4c92ba15666f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
May 26 00:07:39.297610 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.297603    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 00:07:39.303293 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.303270    2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 00:07:39.303732 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.303620    2576 manager.go:217] Machine: {Timestamp:2026-05-26 00:07:39.303094407 +0000 UTC m=+0.367065285 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104233 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cfe0b9c7bef8d0fdfda129b260d4c SystemUUID:ec2cfe0b-9c7b-ef8d-0fdf-da129b260d4c BootID:b5570a65-0ced-4c2f-8070-28d72b79e360 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b3:8e:5d:86:bb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b3:8e:5d:86:bb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:1f:76:b9:92:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 00:07:39.304468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.304457    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 00:07:39.304618 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.304606    2576 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 00:07:39.307632 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.307594    2576 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 00:07:39.307775 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.307637    2576 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-90.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 00:07:39.307821 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.307784    2576 topology_manager.go:138] "Creating topology manager with none policy"
May 26 00:07:39.307821 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.307792    2576 container_manager_linux.go:306] "Creating device plugin manager"
May 26 00:07:39.308357 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.308346    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 00:07:39.309171 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.309160    2576 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 00:07:39.310890 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.310879    2576 state_mem.go:36] "Initialized new in-memory state store"
May 26 00:07:39.311007 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.310998    2576 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 00:07:39.313759 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.313746    2576 kubelet.go:491] "Attempting to sync node with API server"
May 26 00:07:39.313812 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.313765    2576 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 00:07:39.313812 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.313779    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 00:07:39.313812 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.313789    2576 kubelet.go:397] "Adding apiserver pod source"
May 26 00:07:39.313812 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.313799    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 00:07:39.315387 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.315370    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 00:07:39.315458 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.315394    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 00:07:39.318253 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.318234    2576 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 00:07:39.320792 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.320775    2576 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 00:07:39.321547 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.321532    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 00:07:39.321626 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.321552    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 00:07:39.321626 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.321558    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 00:07:39.321626 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.321564    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 00:07:39.321626 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.321572    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 00:07:39.321626 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.321578    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 00:07:39.321626 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.321583    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 00:07:39.321626 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.321589    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 00:07:39.321626 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.321595    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 00:07:39.321626 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.321601    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 00:07:39.321626 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.321609    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 00:07:39.322067 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.321873    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 00:07:39.323050 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.323039    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 00:07:39.323107 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.323054    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 00:07:39.324047 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.324000    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nw5vs"
May 26 00:07:39.326473 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.326458    2576 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 00:07:39.326541 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.326497    2576 server.go:1295] "Started kubelet"
May 26 00:07:39.326665 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.326602    2576 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 00:07:39.326720 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.326700    2576 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 00:07:39.326822 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.326797    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 00:07:39.327566 ip-10-0-134-90 systemd[1]: Started Kubernetes Kubelet.
May 26 00:07:39.328205 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.327611    2576 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-90.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 00:07:39.328205 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.327691    2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-90.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 00:07:39.328205 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.327730    2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 00:07:39.328205 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.327943    2576 server.go:317] "Adding debug handlers to kubelet server"
May 26 00:07:39.328205 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.328154    2576 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 00:07:39.328957 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.328930    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nw5vs"
May 26 00:07:39.331271 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.330394    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-90.ec2.internal.18b2f4e32db6bd29  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-90.ec2.internal,UID:ip-10-0-134-90.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-90.ec2.internal,},FirstTimestamp:2026-05-26 00:07:39.326471465 +0000 UTC m=+0.390442342,LastTimestamp:2026-05-26 00:07:39.326471465 +0000 UTC m=+0.390442342,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-90.ec2.internal,}"
May 26 00:07:39.335115 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.335098    2576 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 00:07:39.336229 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.336208    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 00:07:39.336716 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.336702    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 00:07:39.336812 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.336799    2576 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 00:07:39.336870 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.336814    2576 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 00:07:39.336916 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.336907    2576 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 00:07:39.337003 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.336991    2576 reconstruct.go:97] "Volume reconstruction finished"
May 26 00:07:39.337077 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.337005    2576 reconciler.go:26] "Reconciler: start to sync state"
May 26 00:07:39.337523 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.337502    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:39.337791 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.337776    2576 factory.go:55] Registering systemd factory
May 26 00:07:39.337836 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.337796    2576 factory.go:223] Registration of the systemd container factory successfully
May 26 00:07:39.342693 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.342620    2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 00:07:39.342847 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.342700    2576 factory.go:153] Registering CRI-O factory
May 26 00:07:39.342914 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.342861    2576 factory.go:223] Registration of the crio container factory successfully
May 26 00:07:39.342961 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.342922    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 00:07:39.342961 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.342940    2576 factory.go:103] Registering Raw factory
May 26 00:07:39.342961 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.342955    2576 manager.go:1196] Started watching for new ooms in manager
May 26 00:07:39.343630 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.343615    2576 manager.go:319] Starting recovery of all containers
May 26 00:07:39.345937 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.345917    2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-90.ec2.internal\" not found" node="ip-10-0-134-90.ec2.internal"
May 26 00:07:39.355063 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.355042    2576 manager.go:324] Recovery completed
May 26 00:07:39.359625 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.359612    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 00:07:39.361522 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.361504    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
May 26 00:07:39.361589 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.361535    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
May 26 00:07:39.361589 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.361546    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
May 26 00:07:39.362081 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.362065    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 00:07:39.362081 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.362082    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 00:07:39.362173 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.362099    2576 state_mem.go:36] "Initialized new in-memory state store"
May 26 00:07:39.365057 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.365045    2576 policy_none.go:49] "None policy: Start"
May 26 00:07:39.365114 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.365062    2576 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 00:07:39.365114 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.365072    2576 state_mem.go:35] "Initializing new in-memory state store"
May 26 00:07:39.411651 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.411633    2576 manager.go:341] "Starting Device Plugin manager"
May 26 00:07:39.428270 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.411673    2576 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 00:07:39.428270 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.411690    2576 server.go:85] "Starting device plugin registration server"
May 26 00:07:39.428270 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.411982    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 00:07:39.428270 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.411995    2576 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 00:07:39.428270 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.412133    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 00:07:39.428270 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.412219    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 00:07:39.428270 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.412227    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 00:07:39.428270 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.413104    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 00:07:39.428270 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.413150    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:39.484920 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.484844    2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 00:07:39.486279 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.486252    2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 00:07:39.486279 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.486275    2576 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 00:07:39.486407 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.486292    2576 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 00:07:39.486407 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.486299    2576 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 00:07:39.486407 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.486343    2576 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 00:07:39.493042 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.493002    2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 00:07:39.512503 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.512478    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 00:07:39.513594 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.513574    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
May 26 00:07:39.513682 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.513604    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
May 26 00:07:39.513682 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.513614    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
May 26 00:07:39.513682 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.513636    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-90.ec2.internal"
May 26 00:07:39.521383 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.521367    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-90.ec2.internal"
May 26 00:07:39.521459 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.521392    2576 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-90.ec2.internal\": node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:39.540178 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.540154    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:39.587187 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.587156    2576 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"]
May 26 00:07:39.587265 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.587253    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 00:07:39.589080 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.589061    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
May 26 00:07:39.589159 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.589097    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
May 26 00:07:39.589159 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.589109    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
May 26 00:07:39.590452 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.590438    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 00:07:39.590620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.590602    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
May 26 00:07:39.590680 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.590642    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 00:07:39.591176 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.591158    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
May 26 00:07:39.591262 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.591162    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
May 26 00:07:39.591262 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.591211    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
May 26 00:07:39.591262 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.591222    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
May 26 00:07:39.591262 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.591187    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
May 26 00:07:39.591390 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.591266    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
May 26 00:07:39.592367 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.592354    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
May 26 00:07:39.592419 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.592378    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 00:07:39.592983 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.592966    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
May 26 00:07:39.593069 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.592990    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
May 26 00:07:39.593069 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.593002    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
May 26 00:07:39.625670 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.625644    2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-90.ec2.internal\" not found" node="ip-10-0-134-90.ec2.internal"
May 26 00:07:39.630098 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.630081    2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-90.ec2.internal\" not found" node="ip-10-0-134-90.ec2.internal"
May 26 00:07:39.638650 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.638632    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69ab9d0d17196fa34e06b930a77dabc9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"69ab9d0d17196fa34e06b930a77dabc9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
May 26 00:07:39.638710 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.638659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69ab9d0d17196fa34e06b930a77dabc9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"69ab9d0d17196fa34e06b930a77dabc9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
May 26 00:07:39.638710 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.638677    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ce4a613030626295f96eac475acc9709-config\") pod \"kube-apiserver-proxy-ip-10-0-134-90.ec2.internal\" (UID: \"ce4a613030626295f96eac475acc9709\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
May 26 00:07:39.641181 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.641167    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:39.739408 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.739326    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69ab9d0d17196fa34e06b930a77dabc9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"69ab9d0d17196fa34e06b930a77dabc9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
May 26 00:07:39.739408 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.739362    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69ab9d0d17196fa34e06b930a77dabc9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"69ab9d0d17196fa34e06b930a77dabc9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
May 26 00:07:39.739408 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.739380    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ce4a613030626295f96eac475acc9709-config\") pod \"kube-apiserver-proxy-ip-10-0-134-90.ec2.internal\" (UID: \"ce4a613030626295f96eac475acc9709\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
May 26 00:07:39.739578 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.739428    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ce4a613030626295f96eac475acc9709-config\") pod \"kube-apiserver-proxy-ip-10-0-134-90.ec2.internal\" (UID: \"ce4a613030626295f96eac475acc9709\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
May 26 00:07:39.739578 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.739436    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/69ab9d0d17196fa34e06b930a77dabc9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"69ab9d0d17196fa34e06b930a77dabc9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
May 26 00:07:39.739578 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.739474    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69ab9d0d17196fa34e06b930a77dabc9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"69ab9d0d17196fa34e06b930a77dabc9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
May 26 00:07:39.741421 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.741405    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:39.842174 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.842136    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:39.929351 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.929330    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
May 26 00:07:39.934104 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:39.934083    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
May 26 00:07:39.942584 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:39.942561    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:40.043083 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:40.043046    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:40.143580 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:40.143544    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:40.244100 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:40.244053    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:40.250208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.250187    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 00:07:40.250379 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.250360    2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 00:07:40.250416 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.250358    2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 00:07:40.331192 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.331113    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 00:02:39 +0000 UTC" deadline="2028-01-17 04:14:50.791869358 +0000 UTC"
May 26 00:07:40.331192 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.331154    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14428h7m10.46071939s"
May 26 00:07:40.337025 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.336996    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 00:07:40.345431 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:40.344636    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:40.350214 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.350184    2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 00:07:40.366824 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.366796    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g57fx"
May 26 00:07:40.374202 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.374178    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g57fx"
May 26 00:07:40.438577 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:40.438546    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce4a613030626295f96eac475acc9709.slice/crio-4598442fc96c8591748dc64722356f783f9b8c506d5757c56cf0b0804b8a5592 WatchSource:0}: Error finding container 4598442fc96c8591748dc64722356f783f9b8c506d5757c56cf0b0804b8a5592: Status 404 returned error can't find the container with id 4598442fc96c8591748dc64722356f783f9b8c506d5757c56cf0b0804b8a5592
May 26 00:07:40.438845 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:40.438822    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ab9d0d17196fa34e06b930a77dabc9.slice/crio-e76852dfb845dfce2face3943503c865d34a540c81a6b774a745da65ee3a981c WatchSource:0}: Error finding container e76852dfb845dfce2face3943503c865d34a540c81a6b774a745da65ee3a981c: Status 404 returned error can't find the container with id e76852dfb845dfce2face3943503c865d34a540c81a6b774a745da65ee3a981c
May 26 00:07:40.443157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.443138    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 00:07:40.445262 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:40.445246    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:40.489926 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.489870    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal" event={"ID":"ce4a613030626295f96eac475acc9709","Type":"ContainerStarted","Data":"4598442fc96c8591748dc64722356f783f9b8c506d5757c56cf0b0804b8a5592"}
May 26 00:07:40.490785 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.490763    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal" event={"ID":"69ab9d0d17196fa34e06b930a77dabc9","Type":"ContainerStarted","Data":"e76852dfb845dfce2face3943503c865d34a540c81a6b774a745da65ee3a981c"}
May 26 00:07:40.546241 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:40.546207    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:40.646755 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:40.646689    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:40.747196 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:40.747163    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
May 26 00:07:40.785086 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.785044    2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 00:07:40.790171 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.790153    2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 00:07:40.837521 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.837489    2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
May 26 00:07:40.850477 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.850451    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 00:07:40.851416 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.851404    2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
May 26 00:07:40.860814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:40.860789    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 00:07:41.118758 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.118730    2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 00:07:41.315664 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.315632    2576 apiserver.go:52] "Watching apiserver"
May 26 00:07:41.323659 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.323637    2576 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 00:07:41.324109 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.324075    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-dflxx","openshift-network-diagnostics/network-check-target-5kth8","openshift-network-operator/iptables-alerter-nmzkz","openshift-ovn-kubernetes/ovnkube-node-hcsmb","kube-system/konnectivity-agent-vqbhq","kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt","openshift-dns/node-resolver-4gsm7","openshift-image-registry/node-ca-b65d9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal","openshift-multus/multus-additional-cni-plugins-v99mr","openshift-multus/multus-xc77d","openshift-cluster-node-tuning-operator/tuned-2m2xf"]
May 26 00:07:41.326196 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.326163    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.327264 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.327239    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:41.327364 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.327317    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:07:41.328390 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.328370    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nmzkz"
May 26 00:07:41.328973 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.328769    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 00:07:41.328973 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.328837    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 00:07:41.329284 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.329264    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 00:07:41.329383 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.329285    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8b2jt\""
May 26 00:07:41.329682 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.329668    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.330643 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.330626    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 00:07:41.330823 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.330806    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dw5tg\""
May 26 00:07:41.331028 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.330997    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 00:07:41.331107 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.331031    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 00:07:41.331217 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.331177    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vqbhq"
May 26 00:07:41.331752 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.331738    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 00:07:41.332307 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.332290    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 00:07:41.332394 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.332340    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 00:07:41.332394 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.332385    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 00:07:41.332491 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.332408    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 00:07:41.333178 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.332622    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mwgnd\""
May 26 00:07:41.333178 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.332639    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 00:07:41.333178 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.332625    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:41.333178 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.332740    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:07:41.333409 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.333387    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 00:07:41.333409 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.333406    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 00:07:41.333550 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.333387    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cffg9\""
May 26 00:07:41.335597 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.335576    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4gsm7"
May 26 00:07:41.337236 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.336721    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b65d9"
May 26 00:07:41.338243 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.338221    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 00:07:41.338342 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.338298    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 00:07:41.339242 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.339220    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 00:07:41.339242 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.339234    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vr6kv\""
May 26 00:07:41.339372 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.339242    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 00:07:41.339372 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.339237    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6vfnw\""
May 26 00:07:41.339472 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.339389    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 00:07:41.340036 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.339995    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.342636 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.342182    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.342636 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.342537    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xc77d"
May 26 00:07:41.343178 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.343159    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 00:07:41.343339 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.343322    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 00:07:41.343515 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.343496    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 00:07:41.343602 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.343574    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n6q2b\""
May 26 00:07:41.343683 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.343411    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 00:07:41.343770 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.343753    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 00:07:41.344610 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.344592    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 00:07:41.344610 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.344604    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 00:07:41.344942 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.344925    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pk84j\""
May 26 00:07:41.345178 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.345159    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-znjcw\""
May 26 00:07:41.345273 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.345205    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 00:07:41.348783 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.348763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-slash\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.348892 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.348789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-cni-netd\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.348892 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.348805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1b775b7-78b6-4102-b790-0042cef57e40-ovn-node-metrics-cert\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.348892 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.348823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvfqz\" (UniqueName: \"kubernetes.io/projected/b1b775b7-78b6-4102-b790-0042cef57e40-kube-api-access-bvfqz\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.348892 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.348851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-system-cni-dir\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.348892 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.348873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1b775b7-78b6-4102-b790-0042cef57e40-ovnkube-config\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349170 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.348896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.349170 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.348989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8brhq\" (UniqueName: \"kubernetes.io/projected/95a4ba2c-6a84-4c47-8fb6-2e6268896081-kube-api-access-8brhq\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.349170 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:41.349170 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-run-systemd\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349170 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-etc-openvswitch\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349170 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-cni-bin\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349170 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae9fbcfc-8941-4ba7-9f93-894158483ffe-tmp-dir\") pod \"node-resolver-4gsm7\" (UID: \"ae9fbcfc-8941-4ba7-9f93-894158483ffe\") " pod="openshift-dns/node-resolver-4gsm7"
May 26 00:07:41.349170 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpdfg\" (UniqueName: \"kubernetes.io/projected/ae9fbcfc-8941-4ba7-9f93-894158483ffe-kube-api-access-fpdfg\") pod \"node-resolver-4gsm7\" (UID: \"ae9fbcfc-8941-4ba7-9f93-894158483ffe\") " pod="openshift-dns/node-resolver-4gsm7"
May 26 00:07:41.349170 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349168    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-device-dir\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-sys-fs\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349210    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-cni-binary-copy\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5a9ad5dd-740f-4630-867f-a7b36f95f973-iptables-alerter-script\") pod \"iptables-alerter-nmzkz\" (UID: \"5a9ad5dd-740f-4630-867f-a7b36f95f973\") " pod="openshift-network-operator/iptables-alerter-nmzkz"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a9ad5dd-740f-4630-867f-a7b36f95f973-host-slash\") pod \"iptables-alerter-nmzkz\" (UID: \"5a9ad5dd-740f-4630-867f-a7b36f95f973\") " pod="openshift-network-operator/iptables-alerter-nmzkz"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bcs4\" (UniqueName: \"kubernetes.io/projected/5a9ad5dd-740f-4630-867f-a7b36f95f973-kube-api-access-7bcs4\") pod \"iptables-alerter-nmzkz\" (UID: \"5a9ad5dd-740f-4630-867f-a7b36f95f973\") " pod="openshift-network-operator/iptables-alerter-nmzkz"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b5bec4e-eac6-4433-8127-c273c08bce50-konnectivity-ca\") pod \"konnectivity-agent-vqbhq\" (UID: \"0b5bec4e-eac6-4433-8127-c273c08bce50\") " pod="kube-system/konnectivity-agent-vqbhq"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349300    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-kubelet\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-var-lib-openvswitch\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-run-ovn\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-systemd-units\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349354    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-run-netns\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-log-socket\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-run-ovn-kubernetes\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ae9fbcfc-8941-4ba7-9f93-894158483ffe-hosts-file\") pod \"node-resolver-4gsm7\" (UID: \"ae9fbcfc-8941-4ba7-9f93-894158483ffe\") " pod="openshift-dns/node-resolver-4gsm7"
May 26 00:07:41.349511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8baf0394-fbc4-46b5-b59f-99e4b3eb5221-host\") pod \"node-ca-b65d9\" (UID: \"8baf0394-fbc4-46b5-b59f-99e4b3eb5221\") " pod="openshift-image-registry/node-ca-b65d9"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349457    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlwrh\" (UniqueName: \"kubernetes.io/projected/8baf0394-fbc4-46b5-b59f-99e4b3eb5221-kube-api-access-wlwrh\") pod \"node-ca-b65d9\" (UID: \"8baf0394-fbc4-46b5-b59f-99e4b3eb5221\") " pod="openshift-image-registry/node-ca-b65d9"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-cnibin\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349518    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-run-openvswitch\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-etc-selinux\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdtwb\" (UniqueName: \"kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb\") pod \"network-check-target-5kth8\" (UID: \"4f1376ca-33ab-4866-9065-c5fae5729ae5\") " pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b5bec4e-eac6-4433-8127-c273c08bce50-agent-certs\") pod \"konnectivity-agent-vqbhq\" (UID: \"0b5bec4e-eac6-4433-8127-c273c08bce50\") " pod="kube-system/konnectivity-agent-vqbhq"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349623    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1b775b7-78b6-4102-b790-0042cef57e40-env-overrides\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349643    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1b775b7-78b6-4102-b790-0042cef57e40-ovnkube-script-lib\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-socket-dir\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-os-release\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349694    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349711    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-node-log\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8baf0394-fbc4-46b5-b59f-99e4b3eb5221-serviceca\") pod \"node-ca-b65d9\" (UID: \"8baf0394-fbc4-46b5-b59f-99e4b3eb5221\") " pod="openshift-image-registry/node-ca-b65d9"
May 26 00:07:41.349996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-registration-dir\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.350517 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2h6t\" (UniqueName: \"kubernetes.io/projected/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-kube-api-access-h2h6t\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:41.350517 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.349777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf76l\" (UniqueName: \"kubernetes.io/projected/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-kube-api-access-rf76l\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.375145 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.375082    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 00:02:40 +0000 UTC" deadline="2027-11-19 11:30:01.557791929 +0000 UTC"
May 26 00:07:41.375145 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.375134    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13019h22m20.182664122s"
May 26 00:07:41.438029 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.437990    2576 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 00:07:41.450187 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450154    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-etc-openvswitch\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.450335 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450201    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fpdfg\" (UniqueName: \"kubernetes.io/projected/ae9fbcfc-8941-4ba7-9f93-894158483ffe-kube-api-access-fpdfg\") pod \"node-resolver-4gsm7\" (UID: \"ae9fbcfc-8941-4ba7-9f93-894158483ffe\") " pod="openshift-dns/node-resolver-4gsm7"
May 26 00:07:41.450335 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450245    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-device-dir\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.450335 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450257    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-etc-openvswitch\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.450335 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450271    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-sys-fs\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.450484 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450337    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-sys-fs\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.450484 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450341    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-device-dir\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.450484 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450368    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-cni-binary-copy\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.450484 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450392    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b5bec4e-eac6-4433-8127-c273c08bce50-konnectivity-ca\") pod \"konnectivity-agent-vqbhq\" (UID: \"0b5bec4e-eac6-4433-8127-c273c08bce50\") " pod="kube-system/konnectivity-agent-vqbhq"
May 26 00:07:41.450484 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450412    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-var-lib-openvswitch\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.450484 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450440    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-run-ovn\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.450484 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450467    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-log-socket\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.450730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450490    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ae9fbcfc-8941-4ba7-9f93-894158483ffe-hosts-file\") pod \"node-resolver-4gsm7\" (UID: \"ae9fbcfc-8941-4ba7-9f93-894158483ffe\") " pod="openshift-dns/node-resolver-4gsm7"
May 26 00:07:41.450730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450513    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8baf0394-fbc4-46b5-b59f-99e4b3eb5221-host\") pod \"node-ca-b65d9\" (UID: \"8baf0394-fbc4-46b5-b59f-99e4b3eb5221\") " pod="openshift-image-registry/node-ca-b65d9"
May 26 00:07:41.450730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450539    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-cnibin\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.450730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-multus-socket-dir-parent\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.450730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-sysctl-d\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.450730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450591    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-log-socket\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.450730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-tuned\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.450730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450644    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-var-lib-openvswitch\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.450730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450654    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.450730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450678    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-run-openvswitch\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.450730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450687    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-run-ovn\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.450730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-sysctl-conf\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.450730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450729    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b5bec4e-eac6-4433-8127-c273c08bce50-agent-certs\") pod \"konnectivity-agent-vqbhq\" (UID: \"0b5bec4e-eac6-4433-8127-c273c08bce50\") " pod="kube-system/konnectivity-agent-vqbhq"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450756    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1b775b7-78b6-4102-b790-0042cef57e40-env-overrides\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450756    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ae9fbcfc-8941-4ba7-9f93-894158483ffe-hosts-file\") pod \"node-resolver-4gsm7\" (UID: \"ae9fbcfc-8941-4ba7-9f93-894158483ffe\") " pod="openshift-dns/node-resolver-4gsm7"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450776    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1b775b7-78b6-4102-b790-0042cef57e40-ovnkube-script-lib\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450797    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8baf0394-fbc4-46b5-b59f-99e4b3eb5221-host\") pod \"node-ca-b65d9\" (UID: \"8baf0394-fbc4-46b5-b59f-99e4b3eb5221\") " pod="openshift-image-registry/node-ca-b65d9"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450806    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450828    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-node-log\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450849    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-run-openvswitch\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450856    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8baf0394-fbc4-46b5-b59f-99e4b3eb5221-serviceca\") pod \"node-ca-b65d9\" (UID: \"8baf0394-fbc4-46b5-b59f-99e4b3eb5221\") " pod="openshift-image-registry/node-ca-b65d9"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450882    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rf76l\" (UniqueName: \"kubernetes.io/projected/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-kube-api-access-rf76l\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450908    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-cni-netd\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450933    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1b775b7-78b6-4102-b790-0042cef57e40-ovn-node-metrics-cert\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450954    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-run-netns\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450969    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-var-lib-cni-bin\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450986    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-system-cni-dir\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450983    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.450999    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-cni-binary-copy\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.451208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.451040    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-node-log\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.451835 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.451000    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b5bec4e-eac6-4433-8127-c273c08bce50-konnectivity-ca\") pod \"konnectivity-agent-vqbhq\" (UID: \"0b5bec4e-eac6-4433-8127-c273c08bce50\") " pod="kube-system/konnectivity-agent-vqbhq"
May 26 00:07:41.451835 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.451123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-etc-kubernetes\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.451835 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.451134    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-system-cni-dir\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.451835 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.451326    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 00:07:41.451835 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.451531    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.451835 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.451622    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-cni-bin\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.452278 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452258    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae9fbcfc-8941-4ba7-9f93-894158483ffe-tmp-dir\") pod \"node-resolver-4gsm7\" (UID: \"ae9fbcfc-8941-4ba7-9f93-894158483ffe\") " pod="openshift-dns/node-resolver-4gsm7"
May 26 00:07:41.452323 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452275    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1b775b7-78b6-4102-b790-0042cef57e40-ovnkube-script-lib\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.452323 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452285    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-cni-netd\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.452323 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452293    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdtwb\" (UniqueName: \"kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb\") pod \"network-check-target-5kth8\" (UID: \"4f1376ca-33ab-4866-9065-c5fae5729ae5\") " pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:41.452462 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-os-release\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.452462 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452335    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-cni-bin\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.452462 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452443    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-hostroot\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.452462 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452454    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8baf0394-fbc4-46b5-b59f-99e4b3eb5221-serviceca\") pod \"node-ca-b65d9\" (UID: \"8baf0394-fbc4-46b5-b59f-99e4b3eb5221\") " pod="openshift-image-registry/node-ca-b65d9"
May 26 00:07:41.452646 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-var-lib-kubelet\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.452646 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12db9477-2602-4003-b9bd-74c5c3d9c563-tmp\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.452646 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452565    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae9fbcfc-8941-4ba7-9f93-894158483ffe-tmp-dir\") pod \"node-resolver-4gsm7\" (UID: \"ae9fbcfc-8941-4ba7-9f93-894158483ffe\") " pod="openshift-dns/node-resolver-4gsm7"
May 26 00:07:41.452646 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452574    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5a9ad5dd-740f-4630-867f-a7b36f95f973-iptables-alerter-script\") pod \"iptables-alerter-nmzkz\" (UID: \"5a9ad5dd-740f-4630-867f-a7b36f95f973\") " pod="openshift-network-operator/iptables-alerter-nmzkz"
May 26 00:07:41.452646 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452601    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a9ad5dd-740f-4630-867f-a7b36f95f973-host-slash\") pod \"iptables-alerter-nmzkz\" (UID: \"5a9ad5dd-740f-4630-867f-a7b36f95f973\") " pod="openshift-network-operator/iptables-alerter-nmzkz"
May 26 00:07:41.452916 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.452641    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a9ad5dd-740f-4630-867f-a7b36f95f973-host-slash\") pod \"iptables-alerter-nmzkz\" (UID: \"5a9ad5dd-740f-4630-867f-a7b36f95f973\") " pod="openshift-network-operator/iptables-alerter-nmzkz"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.453084    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bcs4\" (UniqueName: \"kubernetes.io/projected/5a9ad5dd-740f-4630-867f-a7b36f95f973-kube-api-access-7bcs4\") pod \"iptables-alerter-nmzkz\" (UID: \"5a9ad5dd-740f-4630-867f-a7b36f95f973\") " pod="openshift-network-operator/iptables-alerter-nmzkz"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454384    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-kubelet\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454430    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454457    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wlwrh\" (UniqueName: \"kubernetes.io/projected/8baf0394-fbc4-46b5-b59f-99e4b3eb5221-kube-api-access-wlwrh\") pod \"node-ca-b65d9\" (UID: \"8baf0394-fbc4-46b5-b59f-99e4b3eb5221\") " pod="openshift-image-registry/node-ca-b65d9"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454460    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1b775b7-78b6-4102-b790-0042cef57e40-ovn-node-metrics-cert\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-multus-conf-dir\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-sys\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454542    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-systemd-units\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454564    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1b775b7-78b6-4102-b790-0042cef57e40-env-overrides\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454583    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-run-netns\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454608    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-run-ovn-kubernetes\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454630    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454640    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-system-cni-dir\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454852    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-kubelet\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454881    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b5bec4e-eac6-4433-8127-c273c08bce50-agent-certs\") pod \"konnectivity-agent-vqbhq\" (UID: \"0b5bec4e-eac6-4433-8127-c273c08bce50\") " pod="kube-system/konnectivity-agent-vqbhq"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454915    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-run-ovn-kubernetes\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.455311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-var-lib-cni-multus\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.454962    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-run-netns\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-run-multus-certs\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455096    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9nw7\" (UniqueName: \"kubernetes.io/projected/12db9477-2602-4003-b9bd-74c5c3d9c563-kube-api-access-n9nw7\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455095    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5a9ad5dd-740f-4630-867f-a7b36f95f973-iptables-alerter-script\") pod \"iptables-alerter-nmzkz\" (UID: \"5a9ad5dd-740f-4630-867f-a7b36f95f973\") " pod="openshift-network-operator/iptables-alerter-nmzkz"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455168    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-cnibin\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455215    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-systemd-units\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455269    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-etc-selinux\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455273    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-cnibin\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455322    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455342    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-socket-dir\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455410    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-var-lib-kubelet\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-systemd\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455465    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-os-release\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455498    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-registration-dir\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-multus-cni-dir\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455594    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-cni-binary-copy\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.456209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455624    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-modprobe-d\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455652    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-kubernetes\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-lib-modules\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455713    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2h6t\" (UniqueName: \"kubernetes.io/projected/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-kube-api-access-h2h6t\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455743    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-slash\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455773    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bvfqz\" (UniqueName: \"kubernetes.io/projected/b1b775b7-78b6-4102-b790-0042cef57e40-kube-api-access-bvfqz\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455879    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-run-k8s-cni-cncf-io\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455907    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1b775b7-78b6-4102-b790-0042cef57e40-ovnkube-config\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455938    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455968    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8brhq\" (UniqueName: \"kubernetes.io/projected/95a4ba2c-6a84-4c47-8fb6-2e6268896081-kube-api-access-8brhq\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.455999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-multus-daemon-config\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.456061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmr79\" (UniqueName: \"kubernetes.io/projected/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-kube-api-access-cmr79\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.456090    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-sysconfig\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.456147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-run\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.456178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-host\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.456212    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.456246    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-run-systemd\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.456966 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.456341    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-run-systemd\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.457742 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.456503    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-registration-dir\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.457742 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.456635    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-socket-dir\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.457742 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.456669    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1b775b7-78b6-4102-b790-0042cef57e40-host-slash\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.457742 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.456685    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-etc-selinux\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.457742 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.456806    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-os-release\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.457742 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.456951    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/95a4ba2c-6a84-4c47-8fb6-2e6268896081-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.457742 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.457171    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.457742 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.457178    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1b775b7-78b6-4102-b790-0042cef57e40-ovnkube-config\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.457742 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.457301    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:41.457742 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.457389    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs podName:df89838f-af5c-4ca8-af8e-9dcfe5f6c321 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:41.957349804 +0000 UTC m=+3.021320672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs") pod "network-metrics-daemon-dflxx" (UID: "df89838f-af5c-4ca8-af8e-9dcfe5f6c321") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:41.459251 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.459228    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:07:41.459350 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.459258    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:07:41.459350 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.459271    2576 projected.go:194] Error preparing data for projected volume kube-api-access-pdtwb for pod openshift-network-diagnostics/network-check-target-5kth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:41.459472 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.459354    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb podName:4f1376ca-33ab-4866-9065-c5fae5729ae5 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:41.959340267 +0000 UTC m=+3.023311147 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pdtwb" (UniqueName: "kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb") pod "network-check-target-5kth8" (UID: "4f1376ca-33ab-4866-9065-c5fae5729ae5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:41.462613 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.462590    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf76l\" (UniqueName: \"kubernetes.io/projected/70ca1622-3e99-47c4-a3a3-336fdcc4fb44-kube-api-access-rf76l\") pod \"multus-additional-cni-plugins-v99mr\" (UID: \"70ca1622-3e99-47c4-a3a3-336fdcc4fb44\") " pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.462805 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.462676    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpdfg\" (UniqueName: \"kubernetes.io/projected/ae9fbcfc-8941-4ba7-9f93-894158483ffe-kube-api-access-fpdfg\") pod \"node-resolver-4gsm7\" (UID: \"ae9fbcfc-8941-4ba7-9f93-894158483ffe\") " pod="openshift-dns/node-resolver-4gsm7"
May 26 00:07:41.462933 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.462904    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlwrh\" (UniqueName: \"kubernetes.io/projected/8baf0394-fbc4-46b5-b59f-99e4b3eb5221-kube-api-access-wlwrh\") pod \"node-ca-b65d9\" (UID: \"8baf0394-fbc4-46b5-b59f-99e4b3eb5221\") " pod="openshift-image-registry/node-ca-b65d9"
May 26 00:07:41.463441 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.463420    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bcs4\" (UniqueName: \"kubernetes.io/projected/5a9ad5dd-740f-4630-867f-a7b36f95f973-kube-api-access-7bcs4\") pod \"iptables-alerter-nmzkz\" (UID: \"5a9ad5dd-740f-4630-867f-a7b36f95f973\") " pod="openshift-network-operator/iptables-alerter-nmzkz"
May 26 00:07:41.464658 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.464639    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvfqz\" (UniqueName: \"kubernetes.io/projected/b1b775b7-78b6-4102-b790-0042cef57e40-kube-api-access-bvfqz\") pod \"ovnkube-node-hcsmb\" (UID: \"b1b775b7-78b6-4102-b790-0042cef57e40\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.465358 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.465317    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8brhq\" (UniqueName: \"kubernetes.io/projected/95a4ba2c-6a84-4c47-8fb6-2e6268896081-kube-api-access-8brhq\") pod \"aws-ebs-csi-driver-node-xd8mt\" (UID: \"95a4ba2c-6a84-4c47-8fb6-2e6268896081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.465594 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.465571    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2h6t\" (UniqueName: \"kubernetes.io/projected/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-kube-api-access-h2h6t\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:41.547793 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.547755    2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 00:07:41.557184 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557149    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-system-cni-dir\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557351 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557200    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-var-lib-cni-multus\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557351 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557219    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-run-multus-certs\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557351 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557238    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n9nw7\" (UniqueName: \"kubernetes.io/projected/12db9477-2602-4003-b9bd-74c5c3d9c563-kube-api-access-n9nw7\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.557351 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557240    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-system-cni-dir\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557351 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557259    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-var-lib-kubelet\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557351 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557283    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-systemd\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.557351 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557308    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-multus-cni-dir\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557351 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557309    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-run-multus-certs\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557351 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557320    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-var-lib-cni-multus\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557351 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557330    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-cni-binary-copy\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557351 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557354    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-modprobe-d\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557359    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-var-lib-kubelet\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557388    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-kubernetes\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557410    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-lib-modules\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557434    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-run-k8s-cni-cncf-io\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557463    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-modprobe-d\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557462    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-multus-daemon-config\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557497    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmr79\" (UniqueName: \"kubernetes.io/projected/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-kube-api-access-cmr79\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557522    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-sysconfig\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557561    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-run\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557597    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-host\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557610    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-multus-cni-dir\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557654    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-cnibin\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557661    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-host\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557683    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-multus-socket-dir-parent\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557709    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-sysctl-d\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557722    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-kubernetes\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557733    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-tuned\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.557814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557761    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-sysctl-conf\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557795    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-run-netns\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557808    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-lib-modules\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557821    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-var-lib-cni-bin\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557839    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-run\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557568    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-systemd\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557849    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-etc-kubernetes\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557883    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-multus-socket-dir-parent\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557890    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-os-release\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557916    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-hostroot\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557948    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-var-lib-kubelet\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.557971    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12db9477-2602-4003-b9bd-74c5c3d9c563-tmp\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558005    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-multus-conf-dir\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558048    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-sys\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558071    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-var-lib-cni-bin\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558124    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-sys\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558133    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-run-k8s-cni-cncf-io\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558164    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-etc-kubernetes\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.558565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558173    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-sysctl-d\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.559545 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558191    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-cnibin\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.559545 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558216    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-os-release\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.559545 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558252    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-hostroot\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.559545 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558292    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-var-lib-kubelet\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.559545 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558361    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-cni-binary-copy\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.559545 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558415    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-sysconfig\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.559545 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558450    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-host-run-netns\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.559545 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558486    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-multus-conf-dir\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.559545 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558513    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-sysctl-conf\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.559545 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.558675    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-multus-daemon-config\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.560926 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.560901    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12db9477-2602-4003-b9bd-74c5c3d9c563-tmp\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.560926 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.560921    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12db9477-2602-4003-b9bd-74c5c3d9c563-etc-tuned\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.565577 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.565548    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9nw7\" (UniqueName: \"kubernetes.io/projected/12db9477-2602-4003-b9bd-74c5c3d9c563-kube-api-access-n9nw7\") pod \"tuned-2m2xf\" (UID: \"12db9477-2602-4003-b9bd-74c5c3d9c563\") " pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.566322 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.566302    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmr79\" (UniqueName: \"kubernetes.io/projected/d7ed538b-bd88-43f3-bd08-34ff2b41a9e0-kube-api-access-cmr79\") pod \"multus-xc77d\" (UID: \"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0\") " pod="openshift-multus/multus-xc77d"
May 26 00:07:41.641466 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.641382    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt"
May 26 00:07:41.652134 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.652102    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nmzkz"
May 26 00:07:41.660098 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.660071    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:07:41.665675 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.665648    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vqbhq"
May 26 00:07:41.672265 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.672241    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4gsm7"
May 26 00:07:41.680811 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.680788    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b65d9"
May 26 00:07:41.688458 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.688437    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v99mr"
May 26 00:07:41.695096 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.695071    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2m2xf"
May 26 00:07:41.700160 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.700138    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xc77d"
May 26 00:07:41.961548 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.961460    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:41.961548 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:41.961521    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdtwb\" (UniqueName: \"kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb\") pod \"network-check-target-5kth8\" (UID: \"4f1376ca-33ab-4866-9065-c5fae5729ae5\") " pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:41.961772 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.961610    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:41.961772 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.961648    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:07:41.961772 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.961665    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:07:41.961772 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.961677    2576 projected.go:194] Error preparing data for projected volume kube-api-access-pdtwb for pod openshift-network-diagnostics/network-check-target-5kth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:41.961772 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.961682    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs podName:df89838f-af5c-4ca8-af8e-9dcfe5f6c321 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:42.961665789 +0000 UTC m=+4.025636658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs") pod "network-metrics-daemon-dflxx" (UID: "df89838f-af5c-4ca8-af8e-9dcfe5f6c321") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:41.961772 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:41.961726    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb podName:4f1376ca-33ab-4866-9065-c5fae5729ae5 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:42.961710415 +0000 UTC m=+4.025681294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdtwb" (UniqueName: "kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb") pod "network-check-target-5kth8" (UID: "4f1376ca-33ab-4866-9065-c5fae5729ae5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:42.130641 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:42.130596    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9ad5dd_740f_4630_867f_a7b36f95f973.slice/crio-eee015ad0412a9477df0a65d5015102a8895255f0595111dffb08c45c534e6ad WatchSource:0}: Error finding container eee015ad0412a9477df0a65d5015102a8895255f0595111dffb08c45c534e6ad: Status 404 returned error can't find the container with id eee015ad0412a9477df0a65d5015102a8895255f0595111dffb08c45c534e6ad
May 26 00:07:42.131725 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:42.131694    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5bec4e_eac6_4433_8127_c273c08bce50.slice/crio-3d395fc71821ebca198ada913d79655436b0be2383ab933c20919db2a5209c64 WatchSource:0}: Error finding container 3d395fc71821ebca198ada913d79655436b0be2383ab933c20919db2a5209c64: Status 404 returned error can't find the container with id 3d395fc71821ebca198ada913d79655436b0be2383ab933c20919db2a5209c64
May 26 00:07:42.136458 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:42.136419    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b775b7_78b6_4102_b790_0042cef57e40.slice/crio-fa00eb6a7760ccf5bcff51ca39ddb3673c8958c2c370c32748e2fc2be3ceb586 WatchSource:0}: Error finding container fa00eb6a7760ccf5bcff51ca39ddb3673c8958c2c370c32748e2fc2be3ceb586: Status 404 returned error can't find the container with id fa00eb6a7760ccf5bcff51ca39ddb3673c8958c2c370c32748e2fc2be3ceb586
May 26 00:07:42.137285 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:42.137260    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ed538b_bd88_43f3_bd08_34ff2b41a9e0.slice/crio-777dcda63cc4212efc33b07352e1dc7d9f0df1ea898f2bc07a17f3ca0b7aa224 WatchSource:0}: Error finding container 777dcda63cc4212efc33b07352e1dc7d9f0df1ea898f2bc07a17f3ca0b7aa224: Status 404 returned error can't find the container with id 777dcda63cc4212efc33b07352e1dc7d9f0df1ea898f2bc07a17f3ca0b7aa224
May 26 00:07:42.138129 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:42.137973    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9fbcfc_8941_4ba7_9f93_894158483ffe.slice/crio-4d2b48406aa07b3f1ada4a503890659ecb7e100b341a03e6eb113b90bb0d0b51 WatchSource:0}: Error finding container 4d2b48406aa07b3f1ada4a503890659ecb7e100b341a03e6eb113b90bb0d0b51: Status 404 returned error can't find the container with id 4d2b48406aa07b3f1ada4a503890659ecb7e100b341a03e6eb113b90bb0d0b51
May 26 00:07:42.139036 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:42.138975    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8baf0394_fbc4_46b5_b59f_99e4b3eb5221.slice/crio-0b0bf9dc679a1075196ca2155255100b45705a30ce1336596530b9fd9f4568a5 WatchSource:0}: Error finding container 0b0bf9dc679a1075196ca2155255100b45705a30ce1336596530b9fd9f4568a5: Status 404 returned error can't find the container with id 0b0bf9dc679a1075196ca2155255100b45705a30ce1336596530b9fd9f4568a5
May 26 00:07:42.140073 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:42.139843    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12db9477_2602_4003_b9bd_74c5c3d9c563.slice/crio-db1c5e2ea3f537091213ebcc8f3beeaec087d353a7467f5390b7b415de75e4a0 WatchSource:0}: Error finding container db1c5e2ea3f537091213ebcc8f3beeaec087d353a7467f5390b7b415de75e4a0: Status 404 returned error can't find the container with id db1c5e2ea3f537091213ebcc8f3beeaec087d353a7467f5390b7b415de75e4a0
May 26 00:07:42.141147 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:42.141079    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a4ba2c_6a84_4c47_8fb6_2e6268896081.slice/crio-a742e2d04a736882e36dfae397e70634a133e347b4860dab7dc691aae6bbb27d WatchSource:0}: Error finding container a742e2d04a736882e36dfae397e70634a133e347b4860dab7dc691aae6bbb27d: Status 404 returned error can't find the container with id a742e2d04a736882e36dfae397e70634a133e347b4860dab7dc691aae6bbb27d
May 26 00:07:42.142910 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:07:42.142878    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70ca1622_3e99_47c4_a3a3_336fdcc4fb44.slice/crio-32f33c69ec70ab84fc48f52487d407334c5ccd9ade3af539630116ea71009854 WatchSource:0}: Error finding container 32f33c69ec70ab84fc48f52487d407334c5ccd9ade3af539630116ea71009854: Status 404 returned error can't find the container with id 32f33c69ec70ab84fc48f52487d407334c5ccd9ade3af539630116ea71009854
May 26 00:07:42.309036 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.308988    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hpkbr"]
May 26 00:07:42.310736 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.310717    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:42.310828 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:42.310785    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:07:42.364928 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.364879    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88963404-bad9-4411-8b30-b5f169b7ff47-dbus\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:42.365415 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.364967    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:42.365415 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.365005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88963404-bad9-4411-8b30-b5f169b7ff47-kubelet-config\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:42.375827 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.375794    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 00:02:40 +0000 UTC" deadline="2028-02-06 14:43:06.978790484 +0000 UTC"
May 26 00:07:42.375827 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.375823    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14918h35m24.602969781s"
May 26 00:07:42.465495 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.465464    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88963404-bad9-4411-8b30-b5f169b7ff47-kubelet-config\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:42.465610 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.465529    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88963404-bad9-4411-8b30-b5f169b7ff47-dbus\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:42.465610 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.465565    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:42.465610 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.465587    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88963404-bad9-4411-8b30-b5f169b7ff47-kubelet-config\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:42.465702 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:42.465656    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 00:07:42.465702 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.465684    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88963404-bad9-4411-8b30-b5f169b7ff47-dbus\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:42.465780 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:42.465706    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret podName:88963404-bad9-4411-8b30-b5f169b7ff47 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:42.965692511 +0000 UTC m=+4.029663375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret") pod "global-pull-secret-syncer-hpkbr" (UID: "88963404-bad9-4411-8b30-b5f169b7ff47") : object "kube-system"/"original-pull-secret" not registered
May 26 00:07:42.487204 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.487144    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:42.487309 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:42.487263    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:07:42.495274 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.495234    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal" event={"ID":"ce4a613030626295f96eac475acc9709","Type":"ContainerStarted","Data":"33a2f869c4ac9fe46907f5a227337e8e44f4b4b050f9cdb484885b198fcd70a4"}
May 26 00:07:42.496215 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.496191    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v99mr" event={"ID":"70ca1622-3e99-47c4-a3a3-336fdcc4fb44","Type":"ContainerStarted","Data":"32f33c69ec70ab84fc48f52487d407334c5ccd9ade3af539630116ea71009854"}
May 26 00:07:42.496997 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.496982    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xc77d" event={"ID":"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0","Type":"ContainerStarted","Data":"777dcda63cc4212efc33b07352e1dc7d9f0df1ea898f2bc07a17f3ca0b7aa224"}
May 26 00:07:42.497755 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.497740    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt" event={"ID":"95a4ba2c-6a84-4c47-8fb6-2e6268896081","Type":"ContainerStarted","Data":"a742e2d04a736882e36dfae397e70634a133e347b4860dab7dc691aae6bbb27d"}
May 26 00:07:42.498679 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.498661    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4gsm7" event={"ID":"ae9fbcfc-8941-4ba7-9f93-894158483ffe","Type":"ContainerStarted","Data":"4d2b48406aa07b3f1ada4a503890659ecb7e100b341a03e6eb113b90bb0d0b51"}
May 26 00:07:42.499598 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.499573    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vqbhq" event={"ID":"0b5bec4e-eac6-4433-8127-c273c08bce50","Type":"ContainerStarted","Data":"3d395fc71821ebca198ada913d79655436b0be2383ab933c20919db2a5209c64"}
May 26 00:07:42.500449 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.500423    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2m2xf" event={"ID":"12db9477-2602-4003-b9bd-74c5c3d9c563","Type":"ContainerStarted","Data":"db1c5e2ea3f537091213ebcc8f3beeaec087d353a7467f5390b7b415de75e4a0"}
May 26 00:07:42.501294 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.501276    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b65d9" event={"ID":"8baf0394-fbc4-46b5-b59f-99e4b3eb5221","Type":"ContainerStarted","Data":"0b0bf9dc679a1075196ca2155255100b45705a30ce1336596530b9fd9f4568a5"}
May 26 00:07:42.502137 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.502115    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb" event={"ID":"b1b775b7-78b6-4102-b790-0042cef57e40","Type":"ContainerStarted","Data":"fa00eb6a7760ccf5bcff51ca39ddb3673c8958c2c370c32748e2fc2be3ceb586"}
May 26 00:07:42.503066 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.503045    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nmzkz" event={"ID":"5a9ad5dd-740f-4630-867f-a7b36f95f973","Type":"ContainerStarted","Data":"eee015ad0412a9477df0a65d5015102a8895255f0595111dffb08c45c534e6ad"}
May 26 00:07:42.504253 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.504232    2576 generic.go:358] "Generic (PLEG): container finished" podID="69ab9d0d17196fa34e06b930a77dabc9" containerID="8298b983dd1d18383317fb5750d7136c69fb55af3c7e8156d0490869aaa214fa" exitCode=0
May 26 00:07:42.504332 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.504258    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal" event={"ID":"69ab9d0d17196fa34e06b930a77dabc9","Type":"ContainerDied","Data":"8298b983dd1d18383317fb5750d7136c69fb55af3c7e8156d0490869aaa214fa"}
May 26 00:07:42.507799 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.507755    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal" podStartSLOduration=2.507742195 podStartE2EDuration="2.507742195s" podCreationTimestamp="2026-05-26 00:07:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:07:42.507588671 +0000 UTC m=+3.571559557" watchObservedRunningTime="2026-05-26 00:07:42.507742195 +0000 UTC m=+3.571713081"
May 26 00:07:42.969340 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.969292    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdtwb\" (UniqueName: \"kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb\") pod \"network-check-target-5kth8\" (UID: \"4f1376ca-33ab-4866-9065-c5fae5729ae5\") " pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:42.969526 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.969373    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:42.969526 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:42.969404    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:42.969677 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:42.969531    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 00:07:42.969677 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:42.969605    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret podName:88963404-bad9-4411-8b30-b5f169b7ff47 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:43.969585605 +0000 UTC m=+5.033556470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret") pod "global-pull-secret-syncer-hpkbr" (UID: "88963404-bad9-4411-8b30-b5f169b7ff47") : object "kube-system"/"original-pull-secret" not registered
May 26 00:07:42.970056 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:42.970038    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:07:42.970133 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:42.970061    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:07:42.970133 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:42.970074    2576 projected.go:194] Error preparing data for projected volume kube-api-access-pdtwb for pod openshift-network-diagnostics/network-check-target-5kth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:42.970133 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:42.970121    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb podName:4f1376ca-33ab-4866-9065-c5fae5729ae5 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:44.970105152 +0000 UTC m=+6.034076020 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdtwb" (UniqueName: "kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb") pod "network-check-target-5kth8" (UID: "4f1376ca-33ab-4866-9065-c5fae5729ae5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:42.970387 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:42.970185    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:42.970387 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:42.970220    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs podName:df89838f-af5c-4ca8-af8e-9dcfe5f6c321 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:44.970207696 +0000 UTC m=+6.034178563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs") pod "network-metrics-daemon-dflxx" (UID: "df89838f-af5c-4ca8-af8e-9dcfe5f6c321") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:43.489729 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:43.489225    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:43.489729 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:43.489367    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:07:43.514918 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:43.514885    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal" event={"ID":"69ab9d0d17196fa34e06b930a77dabc9","Type":"ContainerStarted","Data":"a02b1b733cd1734e8ffbc1c0a23ee61fe66ce6203bb9a1e9fee07d3104e9fafc"}
May 26 00:07:43.979632 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:43.979548    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:43.979807 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:43.979704    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 00:07:43.979807 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:43.979780    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret podName:88963404-bad9-4411-8b30-b5f169b7ff47 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:45.979759061 +0000 UTC m=+7.043729933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret") pod "global-pull-secret-syncer-hpkbr" (UID: "88963404-bad9-4411-8b30-b5f169b7ff47") : object "kube-system"/"original-pull-secret" not registered
May 26 00:07:44.487092 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:44.486453    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:44.487092 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:44.486577    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:07:44.487092 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:44.486947    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:44.487092 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:44.487052    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:07:44.988441 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:44.987599    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdtwb\" (UniqueName: \"kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb\") pod \"network-check-target-5kth8\" (UID: \"4f1376ca-33ab-4866-9065-c5fae5729ae5\") " pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:44.988441 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:44.987673    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:44.988441 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:44.987809    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:44.988441 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:44.987873    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs podName:df89838f-af5c-4ca8-af8e-9dcfe5f6c321 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:48.987855381 +0000 UTC m=+10.051826249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs") pod "network-metrics-daemon-dflxx" (UID: "df89838f-af5c-4ca8-af8e-9dcfe5f6c321") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:44.988441 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:44.988322    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:07:44.988441 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:44.988344    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:07:44.988441 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:44.988357    2576 projected.go:194] Error preparing data for projected volume kube-api-access-pdtwb for pod openshift-network-diagnostics/network-check-target-5kth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:44.988441 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:44.988404    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb podName:4f1376ca-33ab-4866-9065-c5fae5729ae5 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:48.988388765 +0000 UTC m=+10.052359633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdtwb" (UniqueName: "kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb") pod "network-check-target-5kth8" (UID: "4f1376ca-33ab-4866-9065-c5fae5729ae5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:45.487275 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:45.487235    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:45.487460 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:45.487389    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:07:45.997062 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:45.997006    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:45.997670 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:45.997124    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 00:07:45.997670 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:45.997203    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret podName:88963404-bad9-4411-8b30-b5f169b7ff47 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:49.99718406 +0000 UTC m=+11.061154940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret") pod "global-pull-secret-syncer-hpkbr" (UID: "88963404-bad9-4411-8b30-b5f169b7ff47") : object "kube-system"/"original-pull-secret" not registered
May 26 00:07:46.486955 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:46.486922    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:46.487143 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:46.487037    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:07:46.487437 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:46.487416    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:46.487534 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:46.487520    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:07:47.489218 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:47.489177    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:47.489609 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:47.489310    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:07:48.486575 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:48.486484    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:48.486741 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:48.486606    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:07:48.486968 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:48.486492    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:48.487108 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:48.487092    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:07:49.023540 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:49.023497    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdtwb\" (UniqueName: \"kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb\") pod \"network-check-target-5kth8\" (UID: \"4f1376ca-33ab-4866-9065-c5fae5729ae5\") " pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:49.023977 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:49.023576    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:49.023977 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:49.023693    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:07:49.023977 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:49.023718    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:49.023977 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:49.023720    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:07:49.023977 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:49.023738    2576 projected.go:194] Error preparing data for projected volume kube-api-access-pdtwb for pod openshift-network-diagnostics/network-check-target-5kth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:49.023977 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:49.023781    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb podName:4f1376ca-33ab-4866-9065-c5fae5729ae5 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:57.023768441 +0000 UTC m=+18.087739319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdtwb" (UniqueName: "kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb") pod "network-check-target-5kth8" (UID: "4f1376ca-33ab-4866-9065-c5fae5729ae5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:49.023977 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:49.023800    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs podName:df89838f-af5c-4ca8-af8e-9dcfe5f6c321 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:57.023789593 +0000 UTC m=+18.087760459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs") pod "network-metrics-daemon-dflxx" (UID: "df89838f-af5c-4ca8-af8e-9dcfe5f6c321") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:49.487581 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:49.487499    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:49.487746 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:49.487589    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:07:50.030782 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:50.030741    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:50.031222 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:50.030888    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 00:07:50.031222 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:50.030953    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret podName:88963404-bad9-4411-8b30-b5f169b7ff47 nodeName:}" failed. No retries permitted until 2026-05-26 00:07:58.030934771 +0000 UTC m=+19.094905641 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret") pod "global-pull-secret-syncer-hpkbr" (UID: "88963404-bad9-4411-8b30-b5f169b7ff47") : object "kube-system"/"original-pull-secret" not registered
May 26 00:07:50.486750 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:50.486711    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:50.486937 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:50.486845    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:07:50.487278 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:50.487256    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:50.487376 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:50.487350    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:07:51.488178 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:51.488137    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:51.488664 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:51.488286    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:07:52.487131 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:52.487094    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:52.487298 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:52.487233    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:07:52.487595 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:52.487573    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:52.487698 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:52.487681    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:07:53.487340 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:53.487305    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:53.487788 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:53.487453    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:07:54.486743 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:54.486706    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:54.486743 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:54.486734    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:54.486979 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:54.486831    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:07:54.486979 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:54.486957    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:07:55.487282 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:55.487243    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:55.487771 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:55.487363    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:07:56.487190 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:56.487148    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:56.487407 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:56.487279    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:07:56.487760 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:56.487742    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:56.487847 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:56.487829    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:07:57.084535 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:57.084495    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdtwb\" (UniqueName: \"kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb\") pod \"network-check-target-5kth8\" (UID: \"4f1376ca-33ab-4866-9065-c5fae5729ae5\") " pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:57.084799 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:57.084567    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:57.084799 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:57.084678    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:57.084799 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:57.084692    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:07:57.084799 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:57.084718    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:07:57.084799 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:57.084732    2576 projected.go:194] Error preparing data for projected volume kube-api-access-pdtwb for pod openshift-network-diagnostics/network-check-target-5kth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:57.084799 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:57.084738    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs podName:df89838f-af5c-4ca8-af8e-9dcfe5f6c321 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:13.084723566 +0000 UTC m=+34.148694432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs") pod "network-metrics-daemon-dflxx" (UID: "df89838f-af5c-4ca8-af8e-9dcfe5f6c321") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:07:57.084799 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:57.084785    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb podName:4f1376ca-33ab-4866-9065-c5fae5729ae5 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:13.084769289 +0000 UTC m=+34.148740157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdtwb" (UniqueName: "kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb") pod "network-check-target-5kth8" (UID: "4f1376ca-33ab-4866-9065-c5fae5729ae5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:07:57.487752 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:57.487207    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:57.487752 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:57.487342    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:07:58.090796 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:58.090759    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:58.090993 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:58.090893    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 00:07:58.090993 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:58.090964    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret podName:88963404-bad9-4411-8b30-b5f169b7ff47 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:14.09094684 +0000 UTC m=+35.154917704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret") pod "global-pull-secret-syncer-hpkbr" (UID: "88963404-bad9-4411-8b30-b5f169b7ff47") : object "kube-system"/"original-pull-secret" not registered
May 26 00:07:58.487411 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:58.487334    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:07:58.487558 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:58.487406    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:07:58.487558 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:58.487524    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:07:58.487644 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:58.487613    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:07:59.488181 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:07:59.488143    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:07:59.488572 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:07:59.488279    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:08:00.487132 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:00.487094    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:08:00.487273 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:00.487167    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:08:00.487307 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:00.487271    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:08:00.487426 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:00.487401    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:08:01.486905 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.486706    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:08:01.487735 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:01.487042    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:08:01.551303 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.551265    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vqbhq" event={"ID":"0b5bec4e-eac6-4433-8127-c273c08bce50","Type":"ContainerStarted","Data":"d39ea6ca7943f68e4a28c6a91e51da5d2ba2af14ec0e7aa08e5ce0dea933db27"}
May 26 00:08:01.552459 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.552430    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2m2xf" event={"ID":"12db9477-2602-4003-b9bd-74c5c3d9c563","Type":"ContainerStarted","Data":"4de3a22d40cd010f8346ea014444138dbb5f51b6b50a19a7129e2f633c77223c"}
May 26 00:08:01.553669 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.553632    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b65d9" event={"ID":"8baf0394-fbc4-46b5-b59f-99e4b3eb5221","Type":"ContainerStarted","Data":"11700304a197937efffd32232fe8f62ed38561fec8ccc2e49f1b35819f5ac2e5"}
May 26 00:08:01.556304 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.556281    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb" event={"ID":"b1b775b7-78b6-4102-b790-0042cef57e40","Type":"ContainerStarted","Data":"e2cba823b65b7161b5d42859d307a9f4efcf8a0fadcae84c140fe094c65f6a5c"}
May 26 00:08:01.556304 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.556305    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb" event={"ID":"b1b775b7-78b6-4102-b790-0042cef57e40","Type":"ContainerStarted","Data":"7ec33ab8201123dbbd864b7539c4c03eec7391466457624514d0e497512fc484"}
May 26 00:08:01.556478 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.556315    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb" event={"ID":"b1b775b7-78b6-4102-b790-0042cef57e40","Type":"ContainerStarted","Data":"e937176a185be8dc9ac600f6435c6bcf475154060f64d5e32746da53ff53df7d"}
May 26 00:08:01.556478 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.556326    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb" event={"ID":"b1b775b7-78b6-4102-b790-0042cef57e40","Type":"ContainerStarted","Data":"5586cc52dee10ef0f4d458ac0d4b082d62698ea75157f7dadb04c29fca1635cb"}
May 26 00:08:01.556478 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.556339    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb" event={"ID":"b1b775b7-78b6-4102-b790-0042cef57e40","Type":"ContainerStarted","Data":"dd9b5b8abe0f9783d96a606361f671db757610984f63e7c0df19bc221b24db86"}
May 26 00:08:01.556478 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.556351    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb" event={"ID":"b1b775b7-78b6-4102-b790-0042cef57e40","Type":"ContainerStarted","Data":"672652e136fd2834fec236618580b674be2abf9aa2be01c7231d759a662e98a8"}
May 26 00:08:01.557638 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.557612    2576 generic.go:358] "Generic (PLEG): container finished" podID="70ca1622-3e99-47c4-a3a3-336fdcc4fb44" containerID="16900fd4a5cf1b3c321161c7a3bea30563fcf1e14662aa9cd7ff50d12ca69109" exitCode=0
May 26 00:08:01.557849 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.557673    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v99mr" event={"ID":"70ca1622-3e99-47c4-a3a3-336fdcc4fb44","Type":"ContainerDied","Data":"16900fd4a5cf1b3c321161c7a3bea30563fcf1e14662aa9cd7ff50d12ca69109"}
May 26 00:08:01.559059 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.558943    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xc77d" event={"ID":"d7ed538b-bd88-43f3-bd08-34ff2b41a9e0","Type":"ContainerStarted","Data":"b74f030f89ac9abf431a449dc8b7ece8c65daed6e09b03eb672cc57162c71aa7"}
May 26 00:08:01.560824 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.560804    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt" event={"ID":"95a4ba2c-6a84-4c47-8fb6-2e6268896081","Type":"ContainerStarted","Data":"28f3c1cdfe9e81d8f74dd93de9e4c460d164caf4e5025c937c6e600f9e8263c8"}
May 26 00:08:01.562251 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.562038    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4gsm7" event={"ID":"ae9fbcfc-8941-4ba7-9f93-894158483ffe","Type":"ContainerStarted","Data":"598b6d43f985fe29384f8748d745e66ba80e8490f61b0c766d8ad358155cf8b6"}
May 26 00:08:01.566393 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.566250    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal" podStartSLOduration=21.566238665 podStartE2EDuration="21.566238665s" podCreationTimestamp="2026-05-26 00:07:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:07:43.532442655 +0000 UTC m=+4.596413543" watchObservedRunningTime="2026-05-26 00:08:01.566238665 +0000 UTC m=+22.630209592"
May 26 00:08:01.581353 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.581319    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vqbhq" podStartSLOduration=4.113161672 podStartE2EDuration="22.581309597s" podCreationTimestamp="2026-05-26 00:07:39 +0000 UTC" firstStartedPulling="2026-05-26 00:07:42.134999839 +0000 UTC m=+3.198970716" lastFinishedPulling="2026-05-26 00:08:00.603147761 +0000 UTC m=+21.667118641" observedRunningTime="2026-05-26 00:08:01.566233697 +0000 UTC m=+22.630204584" watchObservedRunningTime="2026-05-26 00:08:01.581309597 +0000 UTC m=+22.645280484"
May 26 00:08:01.581486 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.581466    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-4gsm7" podStartSLOduration=4.125389106 podStartE2EDuration="22.581461559s" podCreationTimestamp="2026-05-26 00:07:39 +0000 UTC" firstStartedPulling="2026-05-26 00:07:42.139677961 +0000 UTC m=+3.203648839" lastFinishedPulling="2026-05-26 00:08:00.595750426 +0000 UTC m=+21.659721292" observedRunningTime="2026-05-26 00:08:01.580975986 +0000 UTC m=+22.644946873" watchObservedRunningTime="2026-05-26 00:08:01.581461559 +0000 UTC m=+22.645432446"
May 26 00:08:01.598201 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.598161    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b65d9" podStartSLOduration=4.143478019 podStartE2EDuration="22.598151626s" podCreationTimestamp="2026-05-26 00:07:39 +0000 UTC" firstStartedPulling="2026-05-26 00:07:42.14107568 +0000 UTC m=+3.205046548" lastFinishedPulling="2026-05-26 00:08:00.595749287 +0000 UTC m=+21.659720155" observedRunningTime="2026-05-26 00:08:01.597825113 +0000 UTC m=+22.661796004" watchObservedRunningTime="2026-05-26 00:08:01.598151626 +0000 UTC m=+22.662122513"
May 26 00:08:01.634789 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.634722    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2m2xf" podStartSLOduration=4.157411611 podStartE2EDuration="22.634709258s" podCreationTimestamp="2026-05-26 00:07:39 +0000 UTC" firstStartedPulling="2026-05-26 00:07:42.1417337 +0000 UTC m=+3.205704578" lastFinishedPulling="2026-05-26 00:08:00.619031356 +0000 UTC m=+21.683002225" observedRunningTime="2026-05-26 00:08:01.634339341 +0000 UTC m=+22.698310230" watchObservedRunningTime="2026-05-26 00:08:01.634709258 +0000 UTC m=+22.698680154"
May 26 00:08:01.650783 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:01.650745    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-xc77d" podStartSLOduration=4.127681809 podStartE2EDuration="22.650734038s" podCreationTimestamp="2026-05-26 00:07:39 +0000 UTC" firstStartedPulling="2026-05-26 00:07:42.139279617 +0000 UTC m=+3.203250483" lastFinishedPulling="2026-05-26 00:08:00.662331829 +0000 UTC m=+21.726302712" observedRunningTime="2026-05-26 00:08:01.650233215 +0000 UTC m=+22.714204103" watchObservedRunningTime="2026-05-26 00:08:01.650734038 +0000 UTC m=+22.714704925"
May 26 00:08:02.129876 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:02.129849    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 00:08:02.145369 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:02.145338    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vqbhq"
May 26 00:08:02.426128 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:02.426000    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T00:08:02.129873525Z","UUID":"de593158-8e9e-478d-b6ee-975678c26823","Handler":null,"Name":"","Endpoint":""}
May 26 00:08:02.429199 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:02.428987    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 00:08:02.429350 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:02.429207    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 00:08:02.487437 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:02.487399    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:08:02.487819 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:02.487399    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:08:02.487819 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:02.487518    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:08:02.487819 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:02.487621    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:08:02.565048 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:02.564998    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt" event={"ID":"95a4ba2c-6a84-4c47-8fb6-2e6268896081","Type":"ContainerStarted","Data":"0d118014bb7678af32c6ccc3925443838df5b1ab52df59bc44f7e34736e9f2b2"}
May 26 00:08:02.566315 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:02.566241    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nmzkz" event={"ID":"5a9ad5dd-740f-4630-867f-a7b36f95f973","Type":"ContainerStarted","Data":"8ca2e73ae1a1f5fc4234a267a3b3b22da9cc22a3e84ab8f122d352eb86840b3b"}
May 26 00:08:02.583534 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:02.583491    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nmzkz" podStartSLOduration=5.102595078 podStartE2EDuration="23.58347342s" podCreationTimestamp="2026-05-26 00:07:39 +0000 UTC" firstStartedPulling="2026-05-26 00:07:42.133041664 +0000 UTC m=+3.197012546" lastFinishedPulling="2026-05-26 00:08:00.613920021 +0000 UTC m=+21.677890888" observedRunningTime="2026-05-26 00:08:02.583157676 +0000 UTC m=+23.647128564" watchObservedRunningTime="2026-05-26 00:08:02.58347342 +0000 UTC m=+23.647444308"
May 26 00:08:03.487130 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:03.487096    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:08:03.487294 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:03.487247    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:08:03.570575 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:03.570541    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt" event={"ID":"95a4ba2c-6a84-4c47-8fb6-2e6268896081","Type":"ContainerStarted","Data":"d97a29498ac7de248b4aa93d72ef4102540688f1ef525314cf626a8c1200205f"}
May 26 00:08:03.573264 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:03.573236    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb" event={"ID":"b1b775b7-78b6-4102-b790-0042cef57e40","Type":"ContainerStarted","Data":"7042dc0476d34311b01110c40c02700e0e104908ac88cb4a5d32ac6a12834292"}
May 26 00:08:03.588716 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:03.588669    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xd8mt" podStartSLOduration=3.616781651 podStartE2EDuration="24.588655093s" podCreationTimestamp="2026-05-26 00:07:39 +0000 UTC" firstStartedPulling="2026-05-26 00:07:42.142264698 +0000 UTC m=+3.206235577" lastFinishedPulling="2026-05-26 00:08:03.114138148 +0000 UTC m=+24.178109019" observedRunningTime="2026-05-26 00:08:03.588112821 +0000 UTC m=+24.652083707" watchObservedRunningTime="2026-05-26 00:08:03.588655093 +0000 UTC m=+24.652625980"
May 26 00:08:04.469186 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:04.469153    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vqbhq"
May 26 00:08:04.469735 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:04.469719    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vqbhq"
May 26 00:08:04.487196 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:04.487171    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:08:04.487296 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:04.487171    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:08:04.487351 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:04.487333    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:08:04.487351 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:04.487257    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:08:04.575209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:04.575185    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vqbhq"
May 26 00:08:05.486738 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:05.486720    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:08:05.486839 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:05.486820    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:08:06.486707 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:06.486673    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:08:06.487222 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:06.486672    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:08:06.487222 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:06.486788    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:08:06.487222 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:06.486887    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:08:07.487145 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:07.486961    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:08:07.487594 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:07.487250    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:08:07.583254 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:07.583222    2576 generic.go:358] "Generic (PLEG): container finished" podID="70ca1622-3e99-47c4-a3a3-336fdcc4fb44" containerID="17156f4fbe122849af367da8dc59bbdaef5cb509d7abe9153e53f57763d6545e" exitCode=0
May 26 00:08:07.583421 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:07.583312    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v99mr" event={"ID":"70ca1622-3e99-47c4-a3a3-336fdcc4fb44","Type":"ContainerDied","Data":"17156f4fbe122849af367da8dc59bbdaef5cb509d7abe9153e53f57763d6545e"}
May 26 00:08:07.586739 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:07.586713    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb" event={"ID":"b1b775b7-78b6-4102-b790-0042cef57e40","Type":"ContainerStarted","Data":"1a2e62d881a923f0f82a331d5a861512508a63635310aaa8cd812142d07dc682"}
May 26 00:08:07.587094 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:07.587053    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:08:07.603233 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:07.603212    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:08:07.625164 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:07.625084    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb" podStartSLOduration=10.094747359 podStartE2EDuration="28.625070842s" podCreationTimestamp="2026-05-26 00:07:39 +0000 UTC" firstStartedPulling="2026-05-26 00:07:42.138444961 +0000 UTC m=+3.202415844" lastFinishedPulling="2026-05-26 00:08:00.668768448 +0000 UTC m=+21.732739327" observedRunningTime="2026-05-26 00:08:07.623305069 +0000 UTC m=+28.687275956" watchObservedRunningTime="2026-05-26 00:08:07.625070842 +0000 UTC m=+28.689041729"
May 26 00:08:08.487209 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:08.487180    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:08:08.487580 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:08.487214    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:08:08.487580 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:08.487285    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:08:08.487580 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:08.487399    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:08:08.588675 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:08.588618    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:08:08.588675 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:08.588676    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:08:08.603860 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:08.603830    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:08:09.125235 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:09.125002    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hpkbr"]
May 26 00:08:09.125407 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:09.125368    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:08:09.125556 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:09.125515    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:08:09.125883 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:09.125866    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5kth8"]
May 26 00:08:09.125992 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:09.125978    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:08:09.126113 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:09.126093    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:08:09.126518 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:09.126498    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dflxx"]
May 26 00:08:09.126609 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:09.126601    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:08:09.126701 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:09.126681    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:08:09.591862 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:09.591828    2576 generic.go:358] "Generic (PLEG): container finished" podID="70ca1622-3e99-47c4-a3a3-336fdcc4fb44" containerID="e571fd698026cf056d43e6c715dbca4d3d3f47b83f8a34dca5f3cbababb9c4e6" exitCode=0
May 26 00:08:09.592229 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:09.591913    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v99mr" event={"ID":"70ca1622-3e99-47c4-a3a3-336fdcc4fb44","Type":"ContainerDied","Data":"e571fd698026cf056d43e6c715dbca4d3d3f47b83f8a34dca5f3cbababb9c4e6"}
May 26 00:08:10.487474 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:10.487382    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:08:10.487639 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:10.487383    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:08:10.487639 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:10.487516    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:08:10.487639 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:10.487555    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:08:10.596290 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:10.596260    2576 generic.go:358] "Generic (PLEG): container finished" podID="70ca1622-3e99-47c4-a3a3-336fdcc4fb44" containerID="c7893ebeb3813e12f9171a8aaaff680b33efce441916a95eb667bdee7937ecc5" exitCode=0
May 26 00:08:10.596937 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:10.596353    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v99mr" event={"ID":"70ca1622-3e99-47c4-a3a3-336fdcc4fb44","Type":"ContainerDied","Data":"c7893ebeb3813e12f9171a8aaaff680b33efce441916a95eb667bdee7937ecc5"}
May 26 00:08:11.487268 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:11.487230    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:08:11.487465 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:11.487349    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5kth8" podUID="4f1376ca-33ab-4866-9065-c5fae5729ae5"
May 26 00:08:12.486911 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:12.486874    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:08:12.487421 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:12.486879    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:08:12.487421 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:12.487000    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hpkbr" podUID="88963404-bad9-4411-8b30-b5f169b7ff47"
May 26 00:08:12.487421 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:12.487099    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dflxx" podUID="df89838f-af5c-4ca8-af8e-9dcfe5f6c321"
May 26 00:08:13.108420 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.108380    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:08:13.108612 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.108462    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdtwb\" (UniqueName: \"kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb\") pod \"network-check-target-5kth8\" (UID: \"4f1376ca-33ab-4866-9065-c5fae5729ae5\") " pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:08:13.108612 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:13.108531    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:08:13.108612 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:13.108597    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs podName:df89838f-af5c-4ca8-af8e-9dcfe5f6c321 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:45.108582699 +0000 UTC m=+66.172553564 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs") pod "network-metrics-daemon-dflxx" (UID: "df89838f-af5c-4ca8-af8e-9dcfe5f6c321") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 00:08:13.108791 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:13.108615    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 00:08:13.108791 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:13.108639    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 00:08:13.108791 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:13.108653    2576 projected.go:194] Error preparing data for projected volume kube-api-access-pdtwb for pod openshift-network-diagnostics/network-check-target-5kth8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:08:13.108791 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:13.108710    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb podName:4f1376ca-33ab-4866-9065-c5fae5729ae5 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:45.108694641 +0000 UTC m=+66.172665512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pdtwb" (UniqueName: "kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb") pod "network-check-target-5kth8" (UID: "4f1376ca-33ab-4866-9065-c5fae5729ae5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 00:08:13.270802 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.270758    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeReady"
May 26 00:08:13.270965 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.270948    2576 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 00:08:13.310376 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.309935    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zj7t4"]
May 26 00:08:13.311981 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.311958    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:08:13.313293 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.313273    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qswhg"]
May 26 00:08:13.314526 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.314509    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 00:08:13.314595 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.314557    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 00:08:13.314646 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.314511    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vc6m6\""
May 26 00:08:13.314932 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.314745    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 00:08:13.314932 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.314893    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qswhg"
May 26 00:08:13.317326 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.317216    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8ln8c\""
May 26 00:08:13.317326 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.317239    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 00:08:13.317326 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.317307    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 00:08:13.323077 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.323058    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zj7t4"]
May 26 00:08:13.337699 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.337357    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qswhg"]
May 26 00:08:13.411420 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.411334    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:13.411580 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.411433    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nznjw\" (UniqueName: \"kubernetes.io/projected/b19d258d-73bb-4e9b-aafa-b59379cbbe09-kube-api-access-nznjw\") pod \"ingress-canary-zj7t4\" (UID: \"b19d258d-73bb-4e9b-aafa-b59379cbbe09\") " pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:08:13.411580 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.411471    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgvn6\" (UniqueName: \"kubernetes.io/projected/b88f291f-1680-43a6-8740-229cf439c90d-kube-api-access-pgvn6\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:13.411580 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.411501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert\") pod \"ingress-canary-zj7t4\" (UID: \"b19d258d-73bb-4e9b-aafa-b59379cbbe09\") " pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:08:13.411580 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.411529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b88f291f-1680-43a6-8740-229cf439c90d-tmp-dir\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:13.411789 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.411613    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b88f291f-1680-43a6-8740-229cf439c90d-config-volume\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:13.486828 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.486795    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:08:13.489698 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.489672    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkcd9\""
May 26 00:08:13.490231 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.489725    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 00:08:13.490231 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.489698    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 00:08:13.512906 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.512880    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nznjw\" (UniqueName: \"kubernetes.io/projected/b19d258d-73bb-4e9b-aafa-b59379cbbe09-kube-api-access-nznjw\") pod \"ingress-canary-zj7t4\" (UID: \"b19d258d-73bb-4e9b-aafa-b59379cbbe09\") " pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:08:13.513080 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.512920    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pgvn6\" (UniqueName: \"kubernetes.io/projected/b88f291f-1680-43a6-8740-229cf439c90d-kube-api-access-pgvn6\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:13.513080 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.512945    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert\") pod \"ingress-canary-zj7t4\" (UID: \"b19d258d-73bb-4e9b-aafa-b59379cbbe09\") " pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:08:13.513080 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.512963    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b88f291f-1680-43a6-8740-229cf439c90d-tmp-dir\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:13.513080 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.512996    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b88f291f-1680-43a6-8740-229cf439c90d-config-volume\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:13.513300 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:13.513109    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:13.513300 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.513132    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:13.513300 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:13.513170    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert podName:b19d258d-73bb-4e9b-aafa-b59379cbbe09 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:14.013151209 +0000 UTC m=+35.077122074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert") pod "ingress-canary-zj7t4" (UID: "b19d258d-73bb-4e9b-aafa-b59379cbbe09") : secret "canary-serving-cert" not found
May 26 00:08:13.513300 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:13.513205    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:13.513300 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:13.513260    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls podName:b88f291f-1680-43a6-8740-229cf439c90d nodeName:}" failed. No retries permitted until 2026-05-26 00:08:14.013248234 +0000 UTC m=+35.077219099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls") pod "dns-default-qswhg" (UID: "b88f291f-1680-43a6-8740-229cf439c90d") : secret "dns-default-metrics-tls" not found
May 26 00:08:13.513555 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.513401    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b88f291f-1680-43a6-8740-229cf439c90d-tmp-dir\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:13.513732 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.513711    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b88f291f-1680-43a6-8740-229cf439c90d-config-volume\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:13.525505 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.525481    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgvn6\" (UniqueName: \"kubernetes.io/projected/b88f291f-1680-43a6-8740-229cf439c90d-kube-api-access-pgvn6\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:13.525630 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:13.525594    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nznjw\" (UniqueName: \"kubernetes.io/projected/b19d258d-73bb-4e9b-aafa-b59379cbbe09-kube-api-access-nznjw\") pod \"ingress-canary-zj7t4\" (UID: \"b19d258d-73bb-4e9b-aafa-b59379cbbe09\") " pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:08:14.016703 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:14.016663    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert\") pod \"ingress-canary-zj7t4\" (UID: \"b19d258d-73bb-4e9b-aafa-b59379cbbe09\") " pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:08:14.016882 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:14.016740    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:14.016882 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:14.016821    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:14.016882 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:14.016876    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert podName:b19d258d-73bb-4e9b-aafa-b59379cbbe09 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:15.016863319 +0000 UTC m=+36.080834188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert") pod "ingress-canary-zj7t4" (UID: "b19d258d-73bb-4e9b-aafa-b59379cbbe09") : secret "canary-serving-cert" not found
May 26 00:08:14.017050 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:14.016821    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:14.017050 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:14.016955    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls podName:b88f291f-1680-43a6-8740-229cf439c90d nodeName:}" failed. No retries permitted until 2026-05-26 00:08:15.016942385 +0000 UTC m=+36.080913264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls") pod "dns-default-qswhg" (UID: "b88f291f-1680-43a6-8740-229cf439c90d") : secret "dns-default-metrics-tls" not found
May 26 00:08:14.117680 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:14.117639    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:08:14.117850 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:14.117797    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 00:08:14.117891 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:14.117869    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret podName:88963404-bad9-4411-8b30-b5f169b7ff47 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:46.117855073 +0000 UTC m=+67.181825941 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret") pod "global-pull-secret-syncer-hpkbr" (UID: "88963404-bad9-4411-8b30-b5f169b7ff47") : object "kube-system"/"original-pull-secret" not registered
May 26 00:08:14.486551 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:14.486470    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:08:14.486709 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:14.486655    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:08:14.489376 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:14.489353    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 00:08:14.489505 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:14.489363    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 00:08:14.490615 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:14.490441    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6mqgt\""
May 26 00:08:15.024283 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:15.024229    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:15.024458 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:15.024330    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert\") pod \"ingress-canary-zj7t4\" (UID: \"b19d258d-73bb-4e9b-aafa-b59379cbbe09\") " pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:08:15.024458 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:15.024418    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:15.024458 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:15.024446    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:15.024562 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:15.024494    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls podName:b88f291f-1680-43a6-8740-229cf439c90d nodeName:}" failed. No retries permitted until 2026-05-26 00:08:17.024473205 +0000 UTC m=+38.088444087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls") pod "dns-default-qswhg" (UID: "b88f291f-1680-43a6-8740-229cf439c90d") : secret "dns-default-metrics-tls" not found
May 26 00:08:15.024562 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:15.024516    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert podName:b19d258d-73bb-4e9b-aafa-b59379cbbe09 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:17.024506455 +0000 UTC m=+38.088477329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert") pod "ingress-canary-zj7t4" (UID: "b19d258d-73bb-4e9b-aafa-b59379cbbe09") : secret "canary-serving-cert" not found
May 26 00:08:16.609505 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:16.609471    2576 generic.go:358] "Generic (PLEG): container finished" podID="70ca1622-3e99-47c4-a3a3-336fdcc4fb44" containerID="0435a02cbbe4aa0da46f3f5e7690c295b02a6b7b16e468709d83d99791541b87" exitCode=0
May 26 00:08:16.609881 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:16.609544    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v99mr" event={"ID":"70ca1622-3e99-47c4-a3a3-336fdcc4fb44","Type":"ContainerDied","Data":"0435a02cbbe4aa0da46f3f5e7690c295b02a6b7b16e468709d83d99791541b87"}
May 26 00:08:17.038318 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:17.038281    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert\") pod \"ingress-canary-zj7t4\" (UID: \"b19d258d-73bb-4e9b-aafa-b59379cbbe09\") " pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:08:17.038489 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:17.038349    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:17.038489 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:17.038443    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:17.038489 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:17.038453    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:17.038586 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:17.038504    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls podName:b88f291f-1680-43a6-8740-229cf439c90d nodeName:}" failed. No retries permitted until 2026-05-26 00:08:21.038491277 +0000 UTC m=+42.102462155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls") pod "dns-default-qswhg" (UID: "b88f291f-1680-43a6-8740-229cf439c90d") : secret "dns-default-metrics-tls" not found
May 26 00:08:17.038586 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:17.038518    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert podName:b19d258d-73bb-4e9b-aafa-b59379cbbe09 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:21.038511984 +0000 UTC m=+42.102482850 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert") pod "ingress-canary-zj7t4" (UID: "b19d258d-73bb-4e9b-aafa-b59379cbbe09") : secret "canary-serving-cert" not found
May 26 00:08:17.613713 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:17.613682    2576 generic.go:358] "Generic (PLEG): container finished" podID="70ca1622-3e99-47c4-a3a3-336fdcc4fb44" containerID="802e5ecbfe24a9a85536a1056d6ec1a2cc6e6580a8cdb04468702fc23901cc7e" exitCode=0
May 26 00:08:17.614116 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:17.613716    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v99mr" event={"ID":"70ca1622-3e99-47c4-a3a3-336fdcc4fb44","Type":"ContainerDied","Data":"802e5ecbfe24a9a85536a1056d6ec1a2cc6e6580a8cdb04468702fc23901cc7e"}
May 26 00:08:18.618670 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:18.618639    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v99mr" event={"ID":"70ca1622-3e99-47c4-a3a3-336fdcc4fb44","Type":"ContainerStarted","Data":"017a1ab37d716962ca62660f24da3f15ca462b0cac8f91db04688787524a3445"}
May 26 00:08:18.641035 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:18.640968    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v99mr" podStartSLOduration=5.460589968 podStartE2EDuration="39.640951178s" podCreationTimestamp="2026-05-26 00:07:39 +0000 UTC" firstStartedPulling="2026-05-26 00:07:42.144851523 +0000 UTC m=+3.208822388" lastFinishedPulling="2026-05-26 00:08:16.325212731 +0000 UTC m=+37.389183598" observedRunningTime="2026-05-26 00:08:18.639276723 +0000 UTC m=+39.703247607" watchObservedRunningTime="2026-05-26 00:08:18.640951178 +0000 UTC m=+39.704922066"
May 26 00:08:21.068441 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:21.068404    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert\") pod \"ingress-canary-zj7t4\" (UID: \"b19d258d-73bb-4e9b-aafa-b59379cbbe09\") " pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:08:21.068792 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:21.068470    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:21.068792 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:21.068555    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:21.068792 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:21.068580    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:21.068792 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:21.068617    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert podName:b19d258d-73bb-4e9b-aafa-b59379cbbe09 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:29.068603205 +0000 UTC m=+50.132574070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert") pod "ingress-canary-zj7t4" (UID: "b19d258d-73bb-4e9b-aafa-b59379cbbe09") : secret "canary-serving-cert" not found
May 26 00:08:21.068792 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:21.068631    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls podName:b88f291f-1680-43a6-8740-229cf439c90d nodeName:}" failed. No retries permitted until 2026-05-26 00:08:29.068625075 +0000 UTC m=+50.132595940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls") pod "dns-default-qswhg" (UID: "b88f291f-1680-43a6-8740-229cf439c90d") : secret "dns-default-metrics-tls" not found
May 26 00:08:29.122800 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:29.122764    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert\") pod \"ingress-canary-zj7t4\" (UID: \"b19d258d-73bb-4e9b-aafa-b59379cbbe09\") " pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:08:29.123336 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:29.122824    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:29.123336 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:29.122916    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:29.123336 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:29.122919    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:29.123336 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:29.122969    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls podName:b88f291f-1680-43a6-8740-229cf439c90d nodeName:}" failed. No retries permitted until 2026-05-26 00:08:45.122955385 +0000 UTC m=+66.186926250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls") pod "dns-default-qswhg" (UID: "b88f291f-1680-43a6-8740-229cf439c90d") : secret "dns-default-metrics-tls" not found
May 26 00:08:29.123336 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:29.122990    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert podName:b19d258d-73bb-4e9b-aafa-b59379cbbe09 nodeName:}" failed. No retries permitted until 2026-05-26 00:08:45.122975283 +0000 UTC m=+66.186946148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert") pod "ingress-canary-zj7t4" (UID: "b19d258d-73bb-4e9b-aafa-b59379cbbe09") : secret "canary-serving-cert" not found
May 26 00:08:40.607743 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:40.607712    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcsmb"
May 26 00:08:45.134428 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:45.134384    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert\") pod \"ingress-canary-zj7t4\" (UID: \"b19d258d-73bb-4e9b-aafa-b59379cbbe09\") " pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:08:45.134902 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:45.134437    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdtwb\" (UniqueName: \"kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb\") pod \"network-check-target-5kth8\" (UID: \"4f1376ca-33ab-4866-9065-c5fae5729ae5\") " pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:08:45.134902 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:45.134473    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:08:45.134902 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:45.134504    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:08:45.134902 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:45.134539    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 00:08:45.134902 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:45.134604    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert podName:b19d258d-73bb-4e9b-aafa-b59379cbbe09 nodeName:}" failed. No retries permitted until 2026-05-26 00:09:17.134589017 +0000 UTC m=+98.198559881 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert") pod "ingress-canary-zj7t4" (UID: "b19d258d-73bb-4e9b-aafa-b59379cbbe09") : secret "canary-serving-cert" not found
May 26 00:08:45.134902 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:45.134613    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 00:08:45.134902 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:45.134694    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls podName:b88f291f-1680-43a6-8740-229cf439c90d nodeName:}" failed. No retries permitted until 2026-05-26 00:09:17.134674824 +0000 UTC m=+98.198645694 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls") pod "dns-default-qswhg" (UID: "b88f291f-1680-43a6-8740-229cf439c90d") : secret "dns-default-metrics-tls" not found
May 26 00:08:45.137840 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:45.137822    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 00:08:45.137936 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:45.137887    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 00:08:45.145096 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:45.145080    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 00:08:45.145200 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:08:45.145129    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs podName:df89838f-af5c-4ca8-af8e-9dcfe5f6c321 nodeName:}" failed. No retries permitted until 2026-05-26 00:09:49.145118182 +0000 UTC m=+130.209089048 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs") pod "network-metrics-daemon-dflxx" (UID: "df89838f-af5c-4ca8-af8e-9dcfe5f6c321") : secret "metrics-daemon-secret" not found
May 26 00:08:45.147308 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:45.147294    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 00:08:45.159116 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:45.159085    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdtwb\" (UniqueName: \"kubernetes.io/projected/4f1376ca-33ab-4866-9065-c5fae5729ae5-kube-api-access-pdtwb\") pod \"network-check-target-5kth8\" (UID: \"4f1376ca-33ab-4866-9065-c5fae5729ae5\") " pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:08:45.300500 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:45.300466    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkcd9\""
May 26 00:08:45.307619 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:45.307601    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:08:45.482584 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:45.482545    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5kth8"]
May 26 00:08:45.486411 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:08:45.486383    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1376ca_33ab_4866_9065_c5fae5729ae5.slice/crio-5828da640cfe719d4810d9903e55a6991a415483d39472c2e2dbb4475bb80edb WatchSource:0}: Error finding container 5828da640cfe719d4810d9903e55a6991a415483d39472c2e2dbb4475bb80edb: Status 404 returned error can't find the container with id 5828da640cfe719d4810d9903e55a6991a415483d39472c2e2dbb4475bb80edb
May 26 00:08:45.669801 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:45.669706    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5kth8" event={"ID":"4f1376ca-33ab-4866-9065-c5fae5729ae5","Type":"ContainerStarted","Data":"5828da640cfe719d4810d9903e55a6991a415483d39472c2e2dbb4475bb80edb"}
May 26 00:08:46.142290 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:46.142245    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:08:46.145424 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:46.145400    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 00:08:46.155351 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:46.155309    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88963404-bad9-4411-8b30-b5f169b7ff47-original-pull-secret\") pod \"global-pull-secret-syncer-hpkbr\" (UID: \"88963404-bad9-4411-8b30-b5f169b7ff47\") " pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:08:46.297891 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:46.297850    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hpkbr"
May 26 00:08:46.437511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:46.437433    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hpkbr"]
May 26 00:08:46.441194 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:08:46.441164    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88963404_bad9_4411_8b30_b5f169b7ff47.slice/crio-d142e623b22eab454335c25eba33a81bc884d1198207fed7f93f03b89a15dff2 WatchSource:0}: Error finding container d142e623b22eab454335c25eba33a81bc884d1198207fed7f93f03b89a15dff2: Status 404 returned error can't find the container with id d142e623b22eab454335c25eba33a81bc884d1198207fed7f93f03b89a15dff2
May 26 00:08:46.673714 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:46.673676    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hpkbr" event={"ID":"88963404-bad9-4411-8b30-b5f169b7ff47","Type":"ContainerStarted","Data":"d142e623b22eab454335c25eba33a81bc884d1198207fed7f93f03b89a15dff2"}
May 26 00:08:48.681856 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:48.681816    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5kth8" event={"ID":"4f1376ca-33ab-4866-9065-c5fae5729ae5","Type":"ContainerStarted","Data":"51b58f7e9acd72bc92b11ea5263bdfd0386d6d95018a262c6fef462cd9f4d955"}
May 26 00:08:48.682318 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:48.682005    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:08:48.696483 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:48.696437    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5kth8" podStartSLOduration=66.625069661 podStartE2EDuration="1m9.696424629s" podCreationTimestamp="2026-05-26 00:07:39 +0000 UTC" firstStartedPulling="2026-05-26 00:08:45.488297048 +0000 UTC m=+66.552267913" lastFinishedPulling="2026-05-26 00:08:48.559652013 +0000 UTC m=+69.623622881" observedRunningTime="2026-05-26 00:08:48.695455702 +0000 UTC m=+69.759426593" watchObservedRunningTime="2026-05-26 00:08:48.696424629 +0000 UTC m=+69.760395515"
May 26 00:08:51.688550 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:51.688513    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hpkbr" event={"ID":"88963404-bad9-4411-8b30-b5f169b7ff47","Type":"ContainerStarted","Data":"2243202c2331509dcccf53867c0b133f98525a181e1db9363e2a22cafe98224e"}
May 26 00:08:51.702800 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:08:51.702751    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hpkbr" podStartSLOduration=65.226522506 podStartE2EDuration="1m9.702735295s" podCreationTimestamp="2026-05-26 00:07:42 +0000 UTC" firstStartedPulling="2026-05-26 00:08:46.443186732 +0000 UTC m=+67.507157597" lastFinishedPulling="2026-05-26 00:08:50.919399521 +0000 UTC m=+71.983370386" observedRunningTime="2026-05-26 00:08:51.702139237 +0000 UTC m=+72.766110125" watchObservedRunningTime="2026-05-26 00:08:51.702735295 +0000 UTC m=+72.766706527"
May 26 00:09:01.104141 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.104006    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"]
May 26 00:09:01.107892 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.107875    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"
May 26 00:09:01.110360 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.110337    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 26 00:09:01.110643 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.110616    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 26 00:09:01.110748 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.110699    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-smcsl\""
May 26 00:09:01.111556 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.111539    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 26 00:09:01.111665 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.111564    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 26 00:09:01.114611 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.114406    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"]
May 26 00:09:01.143787 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.143754    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/935c5842-1124-421f-9642-8984f62c9e00-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-sbzt8\" (UID: \"935c5842-1124-421f-9642-8984f62c9e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"
May 26 00:09:01.143787 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.143788    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/935c5842-1124-421f-9642-8984f62c9e00-config\") pod \"kube-storage-version-migrator-operator-565644f49-sbzt8\" (UID: \"935c5842-1124-421f-9642-8984f62c9e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"
May 26 00:09:01.143998 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.143837    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfhc4\" (UniqueName: \"kubernetes.io/projected/935c5842-1124-421f-9642-8984f62c9e00-kube-api-access-tfhc4\") pod \"kube-storage-version-migrator-operator-565644f49-sbzt8\" (UID: \"935c5842-1124-421f-9642-8984f62c9e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"
May 26 00:09:01.204801 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.204768    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-d6445459d-246wn"]
May 26 00:09:01.207724 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.207709    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.210462 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.210435    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t8c5l\""
May 26 00:09:01.210583 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.210488    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 26 00:09:01.210752 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.210728    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 26 00:09:01.210752 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.210734    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 26 00:09:01.210907 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.210798    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 26 00:09:01.210907 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.210881    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 26 00:09:01.211039 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.211004    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 26 00:09:01.217393 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.217373    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d6445459d-246wn"]
May 26 00:09:01.244948 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.244920    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.244948 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.244947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.245143 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.244966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr7qp\" (UniqueName: \"kubernetes.io/projected/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-kube-api-access-lr7qp\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.245143 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.244989    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhc4\" (UniqueName: \"kubernetes.io/projected/935c5842-1124-421f-9642-8984f62c9e00-kube-api-access-tfhc4\") pod \"kube-storage-version-migrator-operator-565644f49-sbzt8\" (UID: \"935c5842-1124-421f-9642-8984f62c9e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"
May 26 00:09:01.245143 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.245074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-stats-auth\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.245143 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.245134    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/935c5842-1124-421f-9642-8984f62c9e00-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-sbzt8\" (UID: \"935c5842-1124-421f-9642-8984f62c9e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"
May 26 00:09:01.245269 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.245153    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/935c5842-1124-421f-9642-8984f62c9e00-config\") pod \"kube-storage-version-migrator-operator-565644f49-sbzt8\" (UID: \"935c5842-1124-421f-9642-8984f62c9e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"
May 26 00:09:01.245269 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.245187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-default-certificate\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.245649 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.245631    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/935c5842-1124-421f-9642-8984f62c9e00-config\") pod \"kube-storage-version-migrator-operator-565644f49-sbzt8\" (UID: \"935c5842-1124-421f-9642-8984f62c9e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"
May 26 00:09:01.247460 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.247443    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/935c5842-1124-421f-9642-8984f62c9e00-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-sbzt8\" (UID: \"935c5842-1124-421f-9642-8984f62c9e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"
May 26 00:09:01.252854 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.252823    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfhc4\" (UniqueName: \"kubernetes.io/projected/935c5842-1124-421f-9642-8984f62c9e00-kube-api-access-tfhc4\") pod \"kube-storage-version-migrator-operator-565644f49-sbzt8\" (UID: \"935c5842-1124-421f-9642-8984f62c9e00\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"
May 26 00:09:01.305927 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.305895    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-rhr6z"]
May 26 00:09:01.308849 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.308831    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.311661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.311640    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 26 00:09:01.311869 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.311835    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-627zg"]
May 26 00:09:01.311944 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.311877    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 26 00:09:01.311944 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.311911    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-btjbv\""
May 26 00:09:01.312075 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.311979    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 26 00:09:01.312253 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.312233    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 26 00:09:01.315261 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.315241    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.317816 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.317795    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 26 00:09:01.317912 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.317901    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-csl8r\""
May 26 00:09:01.318264 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.318245    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 26 00:09:01.318264 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.318255    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 00:09:01.318466 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.318413    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 00:09:01.318528 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.318476    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 26 00:09:01.318770 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.318750    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-rhr6z"]
May 26 00:09:01.324456 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.324437    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 26 00:09:01.324647 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.324623    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-627zg"]
May 26 00:09:01.345896 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.345870    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/489e63ab-8393-4061-9e58-b90fdf908129-trusted-ca\") pod \"console-operator-76dff48d59-rhr6z\" (UID: \"489e63ab-8393-4061-9e58-b90fdf908129\") " pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.346084 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.345906    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-default-certificate\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.346084 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.345931    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c93fbefe-89d4-4b5a-9403-192340b41e89-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.346084 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.345948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c93fbefe-89d4-4b5a-9403-192340b41e89-serving-cert\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.346084 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.346049    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.346289 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.346092    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.346289 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.346121    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lr7qp\" (UniqueName: \"kubernetes.io/projected/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-kube-api-access-lr7qp\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.346289 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:01.346135    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle podName:7072f138-1367-4c4b-b1d7-77c96cfb5fdb nodeName:}" failed. No retries permitted until 2026-05-26 00:09:01.846118963 +0000 UTC m=+82.910089834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle") pod "router-default-d6445459d-246wn" (UID: "7072f138-1367-4c4b-b1d7-77c96cfb5fdb") : configmap references non-existent config key: service-ca.crt
May 26 00:09:01.346289 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.346169    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/489e63ab-8393-4061-9e58-b90fdf908129-serving-cert\") pod \"console-operator-76dff48d59-rhr6z\" (UID: \"489e63ab-8393-4061-9e58-b90fdf908129\") " pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.346289 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.346199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkfd8\" (UniqueName: \"kubernetes.io/projected/489e63ab-8393-4061-9e58-b90fdf908129-kube-api-access-kkfd8\") pod \"console-operator-76dff48d59-rhr6z\" (UID: \"489e63ab-8393-4061-9e58-b90fdf908129\") " pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.346289 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.346219    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c93fbefe-89d4-4b5a-9403-192340b41e89-snapshots\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.346289 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.346234    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grczq\" (UniqueName: \"kubernetes.io/projected/c93fbefe-89d4-4b5a-9403-192340b41e89-kube-api-access-grczq\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.346289 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:01.346243    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 00:09:01.346289 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.346260    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c93fbefe-89d4-4b5a-9403-192340b41e89-service-ca-bundle\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.346595 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:01.346317    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs podName:7072f138-1367-4c4b-b1d7-77c96cfb5fdb nodeName:}" failed. No retries permitted until 2026-05-26 00:09:01.846304463 +0000 UTC m=+82.910275334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs") pod "router-default-d6445459d-246wn" (UID: "7072f138-1367-4c4b-b1d7-77c96cfb5fdb") : secret "router-metrics-certs-default" not found
May 26 00:09:01.346595 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.346333    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-stats-auth\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.346595 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.346363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c93fbefe-89d4-4b5a-9403-192340b41e89-tmp\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.346595 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.346435    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/489e63ab-8393-4061-9e58-b90fdf908129-config\") pod \"console-operator-76dff48d59-rhr6z\" (UID: \"489e63ab-8393-4061-9e58-b90fdf908129\") " pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.348445 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.348427    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-default-certificate\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.348640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.348623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-stats-auth\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.367091 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.367025    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr7qp\" (UniqueName: \"kubernetes.io/projected/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-kube-api-access-lr7qp\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.417423 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.417385    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"
May 26 00:09:01.447556 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.447520    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c93fbefe-89d4-4b5a-9403-192340b41e89-service-ca-bundle\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.447733 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.447569    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c93fbefe-89d4-4b5a-9403-192340b41e89-tmp\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.447733 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.447608    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/489e63ab-8393-4061-9e58-b90fdf908129-config\") pod \"console-operator-76dff48d59-rhr6z\" (UID: \"489e63ab-8393-4061-9e58-b90fdf908129\") " pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.447733 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.447626    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/489e63ab-8393-4061-9e58-b90fdf908129-trusted-ca\") pod \"console-operator-76dff48d59-rhr6z\" (UID: \"489e63ab-8393-4061-9e58-b90fdf908129\") " pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.447733 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.447647    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c93fbefe-89d4-4b5a-9403-192340b41e89-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.447733 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.447672    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c93fbefe-89d4-4b5a-9403-192340b41e89-serving-cert\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.448000 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.447744    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/489e63ab-8393-4061-9e58-b90fdf908129-serving-cert\") pod \"console-operator-76dff48d59-rhr6z\" (UID: \"489e63ab-8393-4061-9e58-b90fdf908129\") " pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.448000 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.447766    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkfd8\" (UniqueName: \"kubernetes.io/projected/489e63ab-8393-4061-9e58-b90fdf908129-kube-api-access-kkfd8\") pod \"console-operator-76dff48d59-rhr6z\" (UID: \"489e63ab-8393-4061-9e58-b90fdf908129\") " pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.448000 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.447783    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c93fbefe-89d4-4b5a-9403-192340b41e89-snapshots\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.448000 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.447805    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grczq\" (UniqueName: \"kubernetes.io/projected/c93fbefe-89d4-4b5a-9403-192340b41e89-kube-api-access-grczq\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.448386 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.448356    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c93fbefe-89d4-4b5a-9403-192340b41e89-service-ca-bundle\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.448509 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.448446    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/489e63ab-8393-4061-9e58-b90fdf908129-config\") pod \"console-operator-76dff48d59-rhr6z\" (UID: \"489e63ab-8393-4061-9e58-b90fdf908129\") " pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.448684 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.448650    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c93fbefe-89d4-4b5a-9403-192340b41e89-tmp\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.448769 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.448736    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/489e63ab-8393-4061-9e58-b90fdf908129-trusted-ca\") pod \"console-operator-76dff48d59-rhr6z\" (UID: \"489e63ab-8393-4061-9e58-b90fdf908129\") " pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.449075 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.449004    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c93fbefe-89d4-4b5a-9403-192340b41e89-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.449168 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.449105    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c93fbefe-89d4-4b5a-9403-192340b41e89-snapshots\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.450493 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.450474    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/489e63ab-8393-4061-9e58-b90fdf908129-serving-cert\") pod \"console-operator-76dff48d59-rhr6z\" (UID: \"489e63ab-8393-4061-9e58-b90fdf908129\") " pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.450618 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.450600    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c93fbefe-89d4-4b5a-9403-192340b41e89-serving-cert\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.456468 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.456436    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkfd8\" (UniqueName: \"kubernetes.io/projected/489e63ab-8393-4061-9e58-b90fdf908129-kube-api-access-kkfd8\") pod \"console-operator-76dff48d59-rhr6z\" (UID: \"489e63ab-8393-4061-9e58-b90fdf908129\") " pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.456625 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.456608    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grczq\" (UniqueName: \"kubernetes.io/projected/c93fbefe-89d4-4b5a-9403-192340b41e89-kube-api-access-grczq\") pod \"insights-operator-78bdfb888c-627zg\" (UID: \"c93fbefe-89d4-4b5a-9403-192340b41e89\") " pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.535811 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.535779    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8"]
May 26 00:09:01.539141 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:09:01.539113    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod935c5842_1124_421f_9642_8984f62c9e00.slice/crio-028dd59ea5c4393e7f9c594be6cdefd27f0cd43e92865daadd353655e33ecf53 WatchSource:0}: Error finding container 028dd59ea5c4393e7f9c594be6cdefd27f0cd43e92865daadd353655e33ecf53: Status 404 returned error can't find the container with id 028dd59ea5c4393e7f9c594be6cdefd27f0cd43e92865daadd353655e33ecf53
May 26 00:09:01.619347 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.619254    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:01.628180 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.628156    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-627zg"
May 26 00:09:01.710342 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.710310    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8" event={"ID":"935c5842-1124-421f-9642-8984f62c9e00","Type":"ContainerStarted","Data":"028dd59ea5c4393e7f9c594be6cdefd27f0cd43e92865daadd353655e33ecf53"}
May 26 00:09:01.747397 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.747365    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-rhr6z"]
May 26 00:09:01.750305 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:09:01.750277    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489e63ab_8393_4061_9e58_b90fdf908129.slice/crio-6d763853f571381f81bb63c407275ebf93a58eddab73169435440b61680da379 WatchSource:0}: Error finding container 6d763853f571381f81bb63c407275ebf93a58eddab73169435440b61680da379: Status 404 returned error can't find the container with id 6d763853f571381f81bb63c407275ebf93a58eddab73169435440b61680da379
May 26 00:09:01.763315 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.763289    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-627zg"]
May 26 00:09:01.766245 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:09:01.766220    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93fbefe_89d4_4b5a_9403_192340b41e89.slice/crio-6ab3932de9cc46c6ac5366f8ad5605cd96bf225a06a7ce794679e7aeaa020c0c WatchSource:0}: Error finding container 6ab3932de9cc46c6ac5366f8ad5605cd96bf225a06a7ce794679e7aeaa020c0c: Status 404 returned error can't find the container with id 6ab3932de9cc46c6ac5366f8ad5605cd96bf225a06a7ce794679e7aeaa020c0c
May 26 00:09:01.850904 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.850866    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.850904 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:01.850903    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:01.851140 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:01.851042    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle podName:7072f138-1367-4c4b-b1d7-77c96cfb5fdb nodeName:}" failed. No retries permitted until 2026-05-26 00:09:02.851025413 +0000 UTC m=+83.914996292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle") pod "router-default-d6445459d-246wn" (UID: "7072f138-1367-4c4b-b1d7-77c96cfb5fdb") : configmap references non-existent config key: service-ca.crt
May 26 00:09:01.851140 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:01.851065    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 00:09:01.851140 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:01.851116    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs podName:7072f138-1367-4c4b-b1d7-77c96cfb5fdb nodeName:}" failed. No retries permitted until 2026-05-26 00:09:02.85110184 +0000 UTC m=+83.915072723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs") pod "router-default-d6445459d-246wn" (UID: "7072f138-1367-4c4b-b1d7-77c96cfb5fdb") : secret "router-metrics-certs-default" not found
May 26 00:09:02.713997 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:02.713964    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z" event={"ID":"489e63ab-8393-4061-9e58-b90fdf908129","Type":"ContainerStarted","Data":"6d763853f571381f81bb63c407275ebf93a58eddab73169435440b61680da379"}
May 26 00:09:02.715183 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:02.715159    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-627zg" event={"ID":"c93fbefe-89d4-4b5a-9403-192340b41e89","Type":"ContainerStarted","Data":"6ab3932de9cc46c6ac5366f8ad5605cd96bf225a06a7ce794679e7aeaa020c0c"}
May 26 00:09:02.859418 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:02.859385    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:02.859418 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:02.859418    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:02.859741 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:02.859553    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 00:09:02.859741 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:02.859567    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle podName:7072f138-1367-4c4b-b1d7-77c96cfb5fdb nodeName:}" failed. No retries permitted until 2026-05-26 00:09:04.859547346 +0000 UTC m=+85.923518225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle") pod "router-default-d6445459d-246wn" (UID: "7072f138-1367-4c4b-b1d7-77c96cfb5fdb") : configmap references non-existent config key: service-ca.crt
May 26 00:09:02.859741 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:02.859589    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs podName:7072f138-1367-4c4b-b1d7-77c96cfb5fdb nodeName:}" failed. No retries permitted until 2026-05-26 00:09:04.859579742 +0000 UTC m=+85.923550606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs") pod "router-default-d6445459d-246wn" (UID: "7072f138-1367-4c4b-b1d7-77c96cfb5fdb") : secret "router-metrics-certs-default" not found
May 26 00:09:04.877252 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:04.877229    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:04.877552 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:04.877261    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:04.877552 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:04.877359    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 00:09:04.877552 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:04.877403    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs podName:7072f138-1367-4c4b-b1d7-77c96cfb5fdb nodeName:}" failed. No retries permitted until 2026-05-26 00:09:08.877389669 +0000 UTC m=+89.941360534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs") pod "router-default-d6445459d-246wn" (UID: "7072f138-1367-4c4b-b1d7-77c96cfb5fdb") : secret "router-metrics-certs-default" not found
May 26 00:09:04.877552 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:04.877421    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle podName:7072f138-1367-4c4b-b1d7-77c96cfb5fdb nodeName:}" failed. No retries permitted until 2026-05-26 00:09:08.87741507 +0000 UTC m=+89.941385934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle") pod "router-default-d6445459d-246wn" (UID: "7072f138-1367-4c4b-b1d7-77c96cfb5fdb") : configmap references non-existent config key: service-ca.crt
May 26 00:09:05.723056 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:05.722996    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-627zg" event={"ID":"c93fbefe-89d4-4b5a-9403-192340b41e89","Type":"ContainerStarted","Data":"92dd2c28d8081beeb35f99bbe3c6ad3b05359b6c5a5660295c67a1614ee94802"}
May 26 00:09:05.724527 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:05.724503    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/0.log"
May 26 00:09:05.724659 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:05.724549    2576 generic.go:358] "Generic (PLEG): container finished" podID="489e63ab-8393-4061-9e58-b90fdf908129" containerID="d9d5b14cc36c829b96972f6b218e6c26eaad798de9a9f99930582dd1b40e1362" exitCode=255
May 26 00:09:05.724659 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:05.724637    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z" event={"ID":"489e63ab-8393-4061-9e58-b90fdf908129","Type":"ContainerDied","Data":"d9d5b14cc36c829b96972f6b218e6c26eaad798de9a9f99930582dd1b40e1362"}
May 26 00:09:05.724880 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:05.724858    2576 scope.go:117] "RemoveContainer" containerID="d9d5b14cc36c829b96972f6b218e6c26eaad798de9a9f99930582dd1b40e1362"
May 26 00:09:05.726069 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:05.726048    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8" event={"ID":"935c5842-1124-421f-9642-8984f62c9e00","Type":"ContainerStarted","Data":"97425213aa77b242fe9dfad7594d60abf0d5f4bfd63a230c293590d6a460bda9"}
May 26 00:09:05.738699 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:05.738650    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-627zg" podStartSLOduration=1.643626093 podStartE2EDuration="4.738637732s" podCreationTimestamp="2026-05-26 00:09:01 +0000 UTC" firstStartedPulling="2026-05-26 00:09:01.767891209 +0000 UTC m=+82.831862074" lastFinishedPulling="2026-05-26 00:09:04.862902843 +0000 UTC m=+85.926873713" observedRunningTime="2026-05-26 00:09:05.737636607 +0000 UTC m=+86.801607492" watchObservedRunningTime="2026-05-26 00:09:05.738637732 +0000 UTC m=+86.802608618"
May 26 00:09:05.760505 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:05.760443    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8" podStartSLOduration=1.4354922239999999 podStartE2EDuration="4.760423187s" podCreationTimestamp="2026-05-26 00:09:01 +0000 UTC" firstStartedPulling="2026-05-26 00:09:01.540867268 +0000 UTC m=+82.604838133" lastFinishedPulling="2026-05-26 00:09:04.865798231 +0000 UTC m=+85.929769096" observedRunningTime="2026-05-26 00:09:05.759427221 +0000 UTC m=+86.823398109" watchObservedRunningTime="2026-05-26 00:09:05.760423187 +0000 UTC m=+86.824394074"
May 26 00:09:06.730822 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:06.730791    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/1.log"
May 26 00:09:06.731223 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:06.731180    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/0.log"
May 26 00:09:06.731223 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:06.731211    2576 generic.go:358] "Generic (PLEG): container finished" podID="489e63ab-8393-4061-9e58-b90fdf908129" containerID="ab4a90b6464591f04bbfc5b562e3a5ca7bba80104506aa7b52be624b480f16a7" exitCode=255
May 26 00:09:06.731328 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:06.731305    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z" event={"ID":"489e63ab-8393-4061-9e58-b90fdf908129","Type":"ContainerDied","Data":"ab4a90b6464591f04bbfc5b562e3a5ca7bba80104506aa7b52be624b480f16a7"}
May 26 00:09:06.731360 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:06.731350    2576 scope.go:117] "RemoveContainer" containerID="d9d5b14cc36c829b96972f6b218e6c26eaad798de9a9f99930582dd1b40e1362"
May 26 00:09:06.731517 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:06.731493    2576 scope.go:117] "RemoveContainer" containerID="ab4a90b6464591f04bbfc5b562e3a5ca7bba80104506aa7b52be624b480f16a7"
May 26 00:09:06.731751 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:06.731725    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-rhr6z_openshift-console-operator(489e63ab-8393-4061-9e58-b90fdf908129)\"" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z" podUID="489e63ab-8393-4061-9e58-b90fdf908129"
May 26 00:09:07.734683 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:07.734657    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/1.log"
May 26 00:09:07.735178 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:07.735081    2576 scope.go:117] "RemoveContainer" containerID="ab4a90b6464591f04bbfc5b562e3a5ca7bba80104506aa7b52be624b480f16a7"
May 26 00:09:07.735309 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:07.735288    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-rhr6z_openshift-console-operator(489e63ab-8393-4061-9e58-b90fdf908129)\"" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z" podUID="489e63ab-8393-4061-9e58-b90fdf908129"
May 26 00:09:08.485246 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:08.485223    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4gsm7_ae9fbcfc-8941-4ba7-9f93-894158483ffe/dns-node-resolver/0.log"
May 26 00:09:08.911781 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:08.911736    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:08.911781 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:08.911781    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:08.912224 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:08.911930    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle podName:7072f138-1367-4c4b-b1d7-77c96cfb5fdb nodeName:}" failed. No retries permitted until 2026-05-26 00:09:16.91191325 +0000 UTC m=+97.975884114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle") pod "router-default-d6445459d-246wn" (UID: "7072f138-1367-4c4b-b1d7-77c96cfb5fdb") : configmap references non-existent config key: service-ca.crt
May 26 00:09:08.912224 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:08.911966    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 00:09:08.912224 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:08.912059    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs podName:7072f138-1367-4c4b-b1d7-77c96cfb5fdb nodeName:}" failed. No retries permitted until 2026-05-26 00:09:16.912041135 +0000 UTC m=+97.976012011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs") pod "router-default-d6445459d-246wn" (UID: "7072f138-1367-4c4b-b1d7-77c96cfb5fdb") : secret "router-metrics-certs-default" not found
May 26 00:09:09.368488 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.368454    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-hwkgm"]
May 26 00:09:09.372719 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.372704    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-hwkgm"
May 26 00:09:09.375282 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.375257    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 26 00:09:09.375282 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.375273    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 26 00:09:09.376722 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.376518    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 26 00:09:09.376722 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.376570    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 26 00:09:09.377144 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.376727    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-89hcb\""
May 26 00:09:09.377684 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.377666    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-hwkgm"]
May 26 00:09:09.415981 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.415948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fc922f3e-bf50-4971-9c52-7800dcecb800-signing-key\") pod \"service-ca-67d667c7d-hwkgm\" (UID: \"fc922f3e-bf50-4971-9c52-7800dcecb800\") " pod="openshift-service-ca/service-ca-67d667c7d-hwkgm"
May 26 00:09:09.416192 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.415999    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql89l\" (UniqueName: \"kubernetes.io/projected/fc922f3e-bf50-4971-9c52-7800dcecb800-kube-api-access-ql89l\") pod \"service-ca-67d667c7d-hwkgm\" (UID: \"fc922f3e-bf50-4971-9c52-7800dcecb800\") " pod="openshift-service-ca/service-ca-67d667c7d-hwkgm"
May 26 00:09:09.416192 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.416101    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fc922f3e-bf50-4971-9c52-7800dcecb800-signing-cabundle\") pod \"service-ca-67d667c7d-hwkgm\" (UID: \"fc922f3e-bf50-4971-9c52-7800dcecb800\") " pod="openshift-service-ca/service-ca-67d667c7d-hwkgm"
May 26 00:09:09.485372 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.485346    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b65d9_8baf0394-fbc4-46b5-b59f-99e4b3eb5221/node-ca/0.log"
May 26 00:09:09.517031 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.516987    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fc922f3e-bf50-4971-9c52-7800dcecb800-signing-key\") pod \"service-ca-67d667c7d-hwkgm\" (UID: \"fc922f3e-bf50-4971-9c52-7800dcecb800\") " pod="openshift-service-ca/service-ca-67d667c7d-hwkgm"
May 26 00:09:09.517181 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.517040    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ql89l\" (UniqueName: \"kubernetes.io/projected/fc922f3e-bf50-4971-9c52-7800dcecb800-kube-api-access-ql89l\") pod \"service-ca-67d667c7d-hwkgm\" (UID: \"fc922f3e-bf50-4971-9c52-7800dcecb800\") " pod="openshift-service-ca/service-ca-67d667c7d-hwkgm"
May 26 00:09:09.517181 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.517156    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fc922f3e-bf50-4971-9c52-7800dcecb800-signing-cabundle\") pod \"service-ca-67d667c7d-hwkgm\" (UID: \"fc922f3e-bf50-4971-9c52-7800dcecb800\") " pod="openshift-service-ca/service-ca-67d667c7d-hwkgm"
May 26 00:09:09.517732 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.517715    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/fc922f3e-bf50-4971-9c52-7800dcecb800-signing-cabundle\") pod \"service-ca-67d667c7d-hwkgm\" (UID: \"fc922f3e-bf50-4971-9c52-7800dcecb800\") " pod="openshift-service-ca/service-ca-67d667c7d-hwkgm"
May 26 00:09:09.519475 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.519453    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/fc922f3e-bf50-4971-9c52-7800dcecb800-signing-key\") pod \"service-ca-67d667c7d-hwkgm\" (UID: \"fc922f3e-bf50-4971-9c52-7800dcecb800\") " pod="openshift-service-ca/service-ca-67d667c7d-hwkgm"
May 26 00:09:09.524656 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.524631    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql89l\" (UniqueName: \"kubernetes.io/projected/fc922f3e-bf50-4971-9c52-7800dcecb800-kube-api-access-ql89l\") pod \"service-ca-67d667c7d-hwkgm\" (UID: \"fc922f3e-bf50-4971-9c52-7800dcecb800\") " pod="openshift-service-ca/service-ca-67d667c7d-hwkgm"
May 26 00:09:09.682174 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.682098    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-hwkgm"
May 26 00:09:09.799385 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:09.799347    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-hwkgm"]
May 26 00:09:09.803470 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:09:09.803429    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc922f3e_bf50_4971_9c52_7800dcecb800.slice/crio-d09c61f7c8a87295283173598ca2314056ef7494f7281e0a448e6bc20c930258 WatchSource:0}: Error finding container d09c61f7c8a87295283173598ca2314056ef7494f7281e0a448e6bc20c930258: Status 404 returned error can't find the container with id d09c61f7c8a87295283173598ca2314056ef7494f7281e0a448e6bc20c930258
May 26 00:09:10.742820 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:10.742788    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-hwkgm" event={"ID":"fc922f3e-bf50-4971-9c52-7800dcecb800","Type":"ContainerStarted","Data":"d09c61f7c8a87295283173598ca2314056ef7494f7281e0a448e6bc20c930258"}
May 26 00:09:11.086783 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:11.086753    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-sbzt8_935c5842-1124-421f-9642-8984f62c9e00/kube-storage-version-migrator-operator/0.log"
May 26 00:09:11.619914 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:11.619873    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:11.619914 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:11.619927    2576 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:11.620387 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:11.620372    2576 scope.go:117] "RemoveContainer" containerID="ab4a90b6464591f04bbfc5b562e3a5ca7bba80104506aa7b52be624b480f16a7"
May 26 00:09:11.620609 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:11.620579    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-rhr6z_openshift-console-operator(489e63ab-8393-4061-9e58-b90fdf908129)\"" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z" podUID="489e63ab-8393-4061-9e58-b90fdf908129"
May 26 00:09:12.748726 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:12.748693    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-hwkgm" event={"ID":"fc922f3e-bf50-4971-9c52-7800dcecb800","Type":"ContainerStarted","Data":"88cc8a03bb6e5a77ad284a0dc3ffa71882d34863598a5a68ab0883a4c0ff2fba"}
May 26 00:09:12.764624 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:12.764579    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-hwkgm" podStartSLOduration=1.808621112 podStartE2EDuration="3.764566563s" podCreationTimestamp="2026-05-26 00:09:09 +0000 UTC" firstStartedPulling="2026-05-26 00:09:09.805416901 +0000 UTC m=+90.869387779" lastFinishedPulling="2026-05-26 00:09:11.761362361 +0000 UTC m=+92.825333230" observedRunningTime="2026-05-26 00:09:12.76374962 +0000 UTC m=+93.827720536" watchObservedRunningTime="2026-05-26 00:09:12.764566563 +0000 UTC m=+93.828537455"
May 26 00:09:16.976453 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:16.976413    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:16.976845 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:16.976514    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:16.976845 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:16.976576    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 26 00:09:16.976845 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:16.976638    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs podName:7072f138-1367-4c4b-b1d7-77c96cfb5fdb nodeName:}" failed. No retries permitted until 2026-05-26 00:09:32.976622177 +0000 UTC m=+114.040593046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs") pod "router-default-d6445459d-246wn" (UID: "7072f138-1367-4c4b-b1d7-77c96cfb5fdb") : secret "router-metrics-certs-default" not found
May 26 00:09:16.976845 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:16.976654    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle podName:7072f138-1367-4c4b-b1d7-77c96cfb5fdb nodeName:}" failed. No retries permitted until 2026-05-26 00:09:32.976647555 +0000 UTC m=+114.040618419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle") pod "router-default-d6445459d-246wn" (UID: "7072f138-1367-4c4b-b1d7-77c96cfb5fdb") : configmap references non-existent config key: service-ca.crt
May 26 00:09:17.178924 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:17.178885    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert\") pod \"ingress-canary-zj7t4\" (UID: \"b19d258d-73bb-4e9b-aafa-b59379cbbe09\") " pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:09:17.178924 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:17.178929    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:09:17.181359 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:17.181328    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b88f291f-1680-43a6-8740-229cf439c90d-metrics-tls\") pod \"dns-default-qswhg\" (UID: \"b88f291f-1680-43a6-8740-229cf439c90d\") " pod="openshift-dns/dns-default-qswhg"
May 26 00:09:17.181559 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:17.181542    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b19d258d-73bb-4e9b-aafa-b59379cbbe09-cert\") pod \"ingress-canary-zj7t4\" (UID: \"b19d258d-73bb-4e9b-aafa-b59379cbbe09\") " pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:09:17.228259 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:17.228191    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vc6m6\""
May 26 00:09:17.234491 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:17.234475    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8ln8c\""
May 26 00:09:17.236125 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:17.236109    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zj7t4"
May 26 00:09:17.242799 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:17.242779    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qswhg"
May 26 00:09:17.369777 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:17.369746    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zj7t4"]
May 26 00:09:17.373034 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:09:17.372977    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19d258d_73bb_4e9b_aafa_b59379cbbe09.slice/crio-0c2fcfd893f4cd771a4c37063f2cee6a729e316458c21f4bcb543afe3d3f87eb WatchSource:0}: Error finding container 0c2fcfd893f4cd771a4c37063f2cee6a729e316458c21f4bcb543afe3d3f87eb: Status 404 returned error can't find the container with id 0c2fcfd893f4cd771a4c37063f2cee6a729e316458c21f4bcb543afe3d3f87eb
May 26 00:09:17.385149 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:17.385124    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qswhg"]
May 26 00:09:17.388234 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:09:17.388211    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88f291f_1680_43a6_8740_229cf439c90d.slice/crio-23574ed34b6eeaeb9a62eb54ce85a3828ce8f316574dde2cc7f960a64bbc9f5a WatchSource:0}: Error finding container 23574ed34b6eeaeb9a62eb54ce85a3828ce8f316574dde2cc7f960a64bbc9f5a: Status 404 returned error can't find the container with id 23574ed34b6eeaeb9a62eb54ce85a3828ce8f316574dde2cc7f960a64bbc9f5a
May 26 00:09:17.761841 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:17.761801    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qswhg" event={"ID":"b88f291f-1680-43a6-8740-229cf439c90d","Type":"ContainerStarted","Data":"23574ed34b6eeaeb9a62eb54ce85a3828ce8f316574dde2cc7f960a64bbc9f5a"}
May 26 00:09:17.762742 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:17.762724    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zj7t4" event={"ID":"b19d258d-73bb-4e9b-aafa-b59379cbbe09","Type":"ContainerStarted","Data":"0c2fcfd893f4cd771a4c37063f2cee6a729e316458c21f4bcb543afe3d3f87eb"}
May 26 00:09:19.687818 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:19.687737    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5kth8"
May 26 00:09:19.771036 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:19.770072    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qswhg" event={"ID":"b88f291f-1680-43a6-8740-229cf439c90d","Type":"ContainerStarted","Data":"e7908decde630f8373038ee8c7748de56ed6cc2ded4d81a6a1547afce175425e"}
May 26 00:09:20.774501 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:20.774466    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qswhg" event={"ID":"b88f291f-1680-43a6-8740-229cf439c90d","Type":"ContainerStarted","Data":"830b8d792ed6cc74369f2d19d904272e242dbe3177652436f43faf88074127a2"}
May 26 00:09:20.774949 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:20.774574    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qswhg"
May 26 00:09:20.775647 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:20.775626    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zj7t4" event={"ID":"b19d258d-73bb-4e9b-aafa-b59379cbbe09","Type":"ContainerStarted","Data":"2941937323a2b0223008286bb15aae0a8522d69e8d4325f642606a88bded9193"}
May 26 00:09:20.791068 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:20.790997    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-qswhg" podStartSLOduration=65.902854287 podStartE2EDuration="1m7.790984694s" podCreationTimestamp="2026-05-26 00:08:13 +0000 UTC" firstStartedPulling="2026-05-26 00:09:17.389860765 +0000 UTC m=+98.453831630" lastFinishedPulling="2026-05-26 00:09:19.277991159 +0000 UTC m=+100.341962037" observedRunningTime="2026-05-26 00:09:20.790294404 +0000 UTC m=+101.854265285" watchObservedRunningTime="2026-05-26 00:09:20.790984694 +0000 UTC m=+101.854955580"
May 26 00:09:20.803830 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:20.803779    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zj7t4" podStartSLOduration=64.939669184 podStartE2EDuration="1m7.803762564s" podCreationTimestamp="2026-05-26 00:08:13 +0000 UTC" firstStartedPulling="2026-05-26 00:09:17.374699026 +0000 UTC m=+98.438669891" lastFinishedPulling="2026-05-26 00:09:20.23879239 +0000 UTC m=+101.302763271" observedRunningTime="2026-05-26 00:09:20.803565788 +0000 UTC m=+101.867536676" watchObservedRunningTime="2026-05-26 00:09:20.803762564 +0000 UTC m=+101.867733455"
May 26 00:09:25.487813 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:25.487779    2576 scope.go:117] "RemoveContainer" containerID="ab4a90b6464591f04bbfc5b562e3a5ca7bba80104506aa7b52be624b480f16a7"
May 26 00:09:25.789877 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:25.789850    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:09:25.790243 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:25.790224    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/1.log"
May 26 00:09:25.790314 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:25.790260    2576 generic.go:358] "Generic (PLEG): container finished" podID="489e63ab-8393-4061-9e58-b90fdf908129" containerID="177747e171d992c415c40697d3dc0cce04203602cc0c6b9861b5d356b4600285" exitCode=255
May 26 00:09:25.790314 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:25.790291    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z" event={"ID":"489e63ab-8393-4061-9e58-b90fdf908129","Type":"ContainerDied","Data":"177747e171d992c415c40697d3dc0cce04203602cc0c6b9861b5d356b4600285"}
May 26 00:09:25.790413 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:25.790323    2576 scope.go:117] "RemoveContainer" containerID="ab4a90b6464591f04bbfc5b562e3a5ca7bba80104506aa7b52be624b480f16a7"
May 26 00:09:25.790674 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:25.790655    2576 scope.go:117] "RemoveContainer" containerID="177747e171d992c415c40697d3dc0cce04203602cc0c6b9861b5d356b4600285"
May 26 00:09:25.790930 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:25.790908    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-rhr6z_openshift-console-operator(489e63ab-8393-4061-9e58-b90fdf908129)\"" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z" podUID="489e63ab-8393-4061-9e58-b90fdf908129"
May 26 00:09:26.793915 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:26.793883    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:09:30.613857 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.613829    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl"]
May 26 00:09:30.616456 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.616438    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl"
May 26 00:09:30.619108 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.619093    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 26 00:09:30.620327 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.620308    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 26 00:09:30.620406 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.620338    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6vphb\""
May 26 00:09:30.623473 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.623449    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl"]
May 26 00:09:30.652878 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.652848    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wcqc6"]
May 26 00:09:30.654932 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.654916    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.657422 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.657403    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 00:09:30.657523 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.657421    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v5x2q\""
May 26 00:09:30.657523 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.657465    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 00:09:30.670336 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.670297    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wcqc6"]
May 26 00:09:30.732319 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.732289    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-868bc5c65b-blwhp"]
May 26 00:09:30.734070 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.734056    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.736686 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.736667    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 00:09:30.736686 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.736676    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 00:09:30.736837 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.736728    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w26pg\""
May 26 00:09:30.736907 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.736894    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 00:09:30.741581 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.741565    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 00:09:30.748064 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.748008    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-868bc5c65b-blwhp"]
May 26 00:09:30.779765 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.779738    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qswhg"
May 26 00:09:30.786050 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.786003    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e24198f1-dc69-4514-b6c6-8bc63a9713a8-crio-socket\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.786138 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.786082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e24198f1-dc69-4514-b6c6-8bc63a9713a8-data-volume\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.786138 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.786104    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7vbh\" (UniqueName: \"kubernetes.io/projected/e24198f1-dc69-4514-b6c6-8bc63a9713a8-kube-api-access-f7vbh\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.786138 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.786124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fbfc458a-55ce-41f9-a2e9-64046ca53997-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-wkkkl\" (UID: \"fbfc458a-55ce-41f9-a2e9-64046ca53997\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl"
May 26 00:09:30.786247 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.786147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbfc458a-55ce-41f9-a2e9-64046ca53997-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-wkkkl\" (UID: \"fbfc458a-55ce-41f9-a2e9-64046ca53997\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl"
May 26 00:09:30.786247 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.786201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e24198f1-dc69-4514-b6c6-8bc63a9713a8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.786247 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.786227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e24198f1-dc69-4514-b6c6-8bc63a9713a8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.887001 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.886929    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e24198f1-dc69-4514-b6c6-8bc63a9713a8-data-volume\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.887001 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.886963    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d3b611b-3ea0-46db-a265-5d3d46b9f222-bound-sa-token\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.887001 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.886986    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7vbh\" (UniqueName: \"kubernetes.io/projected/e24198f1-dc69-4514-b6c6-8bc63a9713a8-kube-api-access-f7vbh\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.887267 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d3b611b-3ea0-46db-a265-5d3d46b9f222-image-registry-private-configuration\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.887267 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d3b611b-3ea0-46db-a265-5d3d46b9f222-registry-tls\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.887267 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887114    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fbfc458a-55ce-41f9-a2e9-64046ca53997-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-wkkkl\" (UID: \"fbfc458a-55ce-41f9-a2e9-64046ca53997\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl"
May 26 00:09:30.887267 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887132    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d3b611b-3ea0-46db-a265-5d3d46b9f222-installation-pull-secrets\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.887267 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887240    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbfc458a-55ce-41f9-a2e9-64046ca53997-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-wkkkl\" (UID: \"fbfc458a-55ce-41f9-a2e9-64046ca53997\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl"
May 26 00:09:30.887522 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d3b611b-3ea0-46db-a265-5d3d46b9f222-registry-certificates\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.887522 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887322    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e24198f1-dc69-4514-b6c6-8bc63a9713a8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.887522 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887342    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e24198f1-dc69-4514-b6c6-8bc63a9713a8-data-volume\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.887522 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887371    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e24198f1-dc69-4514-b6c6-8bc63a9713a8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.887522 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwdzj\" (UniqueName: \"kubernetes.io/projected/7d3b611b-3ea0-46db-a265-5d3d46b9f222-kube-api-access-bwdzj\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.887522 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887460    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e24198f1-dc69-4514-b6c6-8bc63a9713a8-crio-socket\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.887522 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887486    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d3b611b-3ea0-46db-a265-5d3d46b9f222-trusted-ca\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.887851 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887526    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d3b611b-3ea0-46db-a265-5d3d46b9f222-ca-trust-extracted\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.887851 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887544    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e24198f1-dc69-4514-b6c6-8bc63a9713a8-crio-socket\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.887851 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887809    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fbfc458a-55ce-41f9-a2e9-64046ca53997-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-wkkkl\" (UID: \"fbfc458a-55ce-41f9-a2e9-64046ca53997\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl"
May 26 00:09:30.887948 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.887869    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e24198f1-dc69-4514-b6c6-8bc63a9713a8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.889713 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.889682    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e24198f1-dc69-4514-b6c6-8bc63a9713a8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.889822 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.889804    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fbfc458a-55ce-41f9-a2e9-64046ca53997-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-wkkkl\" (UID: \"fbfc458a-55ce-41f9-a2e9-64046ca53997\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl"
May 26 00:09:30.894788 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.894766    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7vbh\" (UniqueName: \"kubernetes.io/projected/e24198f1-dc69-4514-b6c6-8bc63a9713a8-kube-api-access-f7vbh\") pod \"insights-runtime-extractor-wcqc6\" (UID: \"e24198f1-dc69-4514-b6c6-8bc63a9713a8\") " pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.925506 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.925487    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl"
May 26 00:09:30.963786 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.963756    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wcqc6"
May 26 00:09:30.989623 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.988795    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d3b611b-3ea0-46db-a265-5d3d46b9f222-ca-trust-extracted\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.989623 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.988879    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d3b611b-3ea0-46db-a265-5d3d46b9f222-bound-sa-token\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.989623 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.988912    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d3b611b-3ea0-46db-a265-5d3d46b9f222-image-registry-private-configuration\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.989623 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.988946    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d3b611b-3ea0-46db-a265-5d3d46b9f222-registry-tls\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.989623 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.988976    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d3b611b-3ea0-46db-a265-5d3d46b9f222-installation-pull-secrets\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.989623 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.989042    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d3b611b-3ea0-46db-a265-5d3d46b9f222-registry-certificates\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.989623 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.989112    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bwdzj\" (UniqueName: \"kubernetes.io/projected/7d3b611b-3ea0-46db-a265-5d3d46b9f222-kube-api-access-bwdzj\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.989623 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.989139    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d3b611b-3ea0-46db-a265-5d3d46b9f222-trusted-ca\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.991135 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.990631    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7d3b611b-3ea0-46db-a265-5d3d46b9f222-registry-certificates\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.991135 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.990809    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7d3b611b-3ea0-46db-a265-5d3d46b9f222-ca-trust-extracted\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.991829 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.991653    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7d3b611b-3ea0-46db-a265-5d3d46b9f222-trusted-ca\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.993053 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.992991    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7d3b611b-3ea0-46db-a265-5d3d46b9f222-installation-pull-secrets\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.993869 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.993846    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7d3b611b-3ea0-46db-a265-5d3d46b9f222-registry-tls\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.994445 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.994428    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7d3b611b-3ea0-46db-a265-5d3d46b9f222-image-registry-private-configuration\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.997822 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.997803    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwdzj\" (UniqueName: \"kubernetes.io/projected/7d3b611b-3ea0-46db-a265-5d3d46b9f222-kube-api-access-bwdzj\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:30.997950 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:30.997927    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7d3b611b-3ea0-46db-a265-5d3d46b9f222-bound-sa-token\") pod \"image-registry-868bc5c65b-blwhp\" (UID: \"7d3b611b-3ea0-46db-a265-5d3d46b9f222\") " pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:31.043554 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.043514    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:31.058691 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.058143    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl"]
May 26 00:09:31.137079 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.136992    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wcqc6"]
May 26 00:09:31.189767 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.189738    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-868bc5c65b-blwhp"]
May 26 00:09:31.192526 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:09:31.192499    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3b611b_3ea0_46db_a265_5d3d46b9f222.slice/crio-35c921245ab62198206421c092d71014711ea037d27d4f4c66128cf994bbf645 WatchSource:0}: Error finding container 35c921245ab62198206421c092d71014711ea037d27d4f4c66128cf994bbf645: Status 404 returned error can't find the container with id 35c921245ab62198206421c092d71014711ea037d27d4f4c66128cf994bbf645
May 26 00:09:31.619913 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.619877    2576 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:31.619913 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.619916    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:31.620348 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.620270    2576 scope.go:117] "RemoveContainer" containerID="177747e171d992c415c40697d3dc0cce04203602cc0c6b9861b5d356b4600285"
May 26 00:09:31.620443 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:31.620427    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-rhr6z_openshift-console-operator(489e63ab-8393-4061-9e58-b90fdf908129)\"" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z" podUID="489e63ab-8393-4061-9e58-b90fdf908129"
May 26 00:09:31.807862 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.807825    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl" event={"ID":"fbfc458a-55ce-41f9-a2e9-64046ca53997","Type":"ContainerStarted","Data":"8b54dd0c858b7f2ad61dac2407118687ad569895d90759d4df6ca36afdb8e8b5"}
May 26 00:09:31.809378 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.809341    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wcqc6" event={"ID":"e24198f1-dc69-4514-b6c6-8bc63a9713a8","Type":"ContainerStarted","Data":"11172e8aa5af5ea6acbefa0ec84f62bbf96969ae41a211aefaf18662ef19ed53"}
May 26 00:09:31.809498 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.809382    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wcqc6" event={"ID":"e24198f1-dc69-4514-b6c6-8bc63a9713a8","Type":"ContainerStarted","Data":"7e38b3477192a1acc20260a86810b157ac6b894ab88b86db25a9757001c85b4e"}
May 26 00:09:31.810785 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.810760    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-868bc5c65b-blwhp" event={"ID":"7d3b611b-3ea0-46db-a265-5d3d46b9f222","Type":"ContainerStarted","Data":"ea9961ef1c97a92a6cbfd41a277fd2f8ab2801de754131dfc422fde397edf5ed"}
May 26 00:09:31.810912 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.810790    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-868bc5c65b-blwhp" event={"ID":"7d3b611b-3ea0-46db-a265-5d3d46b9f222","Type":"ContainerStarted","Data":"35c921245ab62198206421c092d71014711ea037d27d4f4c66128cf994bbf645"}
May 26 00:09:31.810912 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.810903    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:31.828566 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:31.828522    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-868bc5c65b-blwhp" podStartSLOduration=1.8285050630000002 podStartE2EDuration="1.828505063s" podCreationTimestamp="2026-05-26 00:09:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:09:31.827591861 +0000 UTC m=+112.891562751" watchObservedRunningTime="2026-05-26 00:09:31.828505063 +0000 UTC m=+112.892475952"
May 26 00:09:32.815575 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:32.815543    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl" event={"ID":"fbfc458a-55ce-41f9-a2e9-64046ca53997","Type":"ContainerStarted","Data":"3476ca7cc867d984c9f5121b9510a632558473ff57ff38a2e9af81f97b27b5ea"}
May 26 00:09:32.817564 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:32.817535    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wcqc6" event={"ID":"e24198f1-dc69-4514-b6c6-8bc63a9713a8","Type":"ContainerStarted","Data":"294d44b1c2246d60311ddd35c98ca366a3413b81013d4cb23997abf12ce1bae9"}
May 26 00:09:32.829467 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:32.829238    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-wkkkl" podStartSLOduration=1.578894369 podStartE2EDuration="2.82922113s" podCreationTimestamp="2026-05-26 00:09:30 +0000 UTC" firstStartedPulling="2026-05-26 00:09:31.068315004 +0000 UTC m=+112.132285882" lastFinishedPulling="2026-05-26 00:09:32.318641778 +0000 UTC m=+113.382612643" observedRunningTime="2026-05-26 00:09:32.829167413 +0000 UTC m=+113.893138301" watchObservedRunningTime="2026-05-26 00:09:32.82922113 +0000 UTC m=+113.893192018"
May 26 00:09:33.008644 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:33.008606    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:33.008644 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:33.008648    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:33.009408 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:33.009371    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-service-ca-bundle\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:33.011478 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:33.011456    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7072f138-1367-4c4b-b1d7-77c96cfb5fdb-metrics-certs\") pod \"router-default-d6445459d-246wn\" (UID: \"7072f138-1367-4c4b-b1d7-77c96cfb5fdb\") " pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:33.016321 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:33.016298    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:33.150277 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:33.150187    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-d6445459d-246wn"]
May 26 00:09:33.153001 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:09:33.152965    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7072f138_1367_4c4b_b1d7_77c96cfb5fdb.slice/crio-a6f33aa2798cf6dc7421513ed537c82d9820beb4f0d134a4011a2a16cbe333f4 WatchSource:0}: Error finding container a6f33aa2798cf6dc7421513ed537c82d9820beb4f0d134a4011a2a16cbe333f4: Status 404 returned error can't find the container with id a6f33aa2798cf6dc7421513ed537c82d9820beb4f0d134a4011a2a16cbe333f4
May 26 00:09:33.822065 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:33.822003    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wcqc6" event={"ID":"e24198f1-dc69-4514-b6c6-8bc63a9713a8","Type":"ContainerStarted","Data":"fc6d8bd0cf8ba0a621f4b1a741e1fa7011da9128272d8e0e254ad53dedf7134f"}
May 26 00:09:33.823291 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:33.823265    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d6445459d-246wn" event={"ID":"7072f138-1367-4c4b-b1d7-77c96cfb5fdb","Type":"ContainerStarted","Data":"7bf72585d1d9676423440f91cd35ed96ba07e3702763d37f2193d16528f9ccda"}
May 26 00:09:33.823406 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:33.823298    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-d6445459d-246wn" event={"ID":"7072f138-1367-4c4b-b1d7-77c96cfb5fdb","Type":"ContainerStarted","Data":"a6f33aa2798cf6dc7421513ed537c82d9820beb4f0d134a4011a2a16cbe333f4"}
May 26 00:09:33.838188 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:33.838090    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wcqc6" podStartSLOduration=1.447742193 podStartE2EDuration="3.83807406s" podCreationTimestamp="2026-05-26 00:09:30 +0000 UTC" firstStartedPulling="2026-05-26 00:09:31.19375691 +0000 UTC m=+112.257727778" lastFinishedPulling="2026-05-26 00:09:33.584088777 +0000 UTC m=+114.648059645" observedRunningTime="2026-05-26 00:09:33.837678957 +0000 UTC m=+114.901649834" watchObservedRunningTime="2026-05-26 00:09:33.83807406 +0000 UTC m=+114.902044941"
May 26 00:09:33.856480 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:33.856437    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-d6445459d-246wn" podStartSLOduration=32.85642266 podStartE2EDuration="32.85642266s" podCreationTimestamp="2026-05-26 00:09:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:09:33.855360309 +0000 UTC m=+114.919331197" watchObservedRunningTime="2026-05-26 00:09:33.85642266 +0000 UTC m=+114.920393546"
May 26 00:09:34.016982 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:34.016951    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:34.019575 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:34.019551    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:34.826333 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:34.826306    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:34.827332 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:34.827312    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-d6445459d-246wn"
May 26 00:09:43.487785 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:43.487749    2576 scope.go:117] "RemoveContainer" containerID="177747e171d992c415c40697d3dc0cce04203602cc0c6b9861b5d356b4600285"
May 26 00:09:43.488306 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:43.487945    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-rhr6z_openshift-console-operator(489e63ab-8393-4061-9e58-b90fdf908129)\"" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z" podUID="489e63ab-8393-4061-9e58-b90fdf908129"
May 26 00:09:44.598031 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.597980    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8gspp"]
May 26 00:09:44.601117 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.601096    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.603837 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.603814    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g7ggh\""
May 26 00:09:44.604046 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.603884    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 00:09:44.604046 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.603894    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 00:09:44.604250 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.603901    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 00:09:44.604849 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.604827    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 00:09:44.604998 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.604827    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 00:09:44.604998 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.604872    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 00:09:44.698520 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.698482    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c856369-c954-42a2-a717-09a592caca0e-sys\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.698701 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.698536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c856369-c954-42a2-a717-09a592caca0e-root\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.698701 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.698567    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-wtmp\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.698701 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.698596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.698701 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.698679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rjw7\" (UniqueName: \"kubernetes.io/projected/3c856369-c954-42a2-a717-09a592caca0e-kube-api-access-4rjw7\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.698859 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.698715    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-tls\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.698859 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.698739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.698859 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.698764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-textfile\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.698859 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.698816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c856369-c954-42a2-a717-09a592caca0e-metrics-client-ca\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.799475 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.799446    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c856369-c954-42a2-a717-09a592caca0e-metrics-client-ca\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.799661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.799491    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c856369-c954-42a2-a717-09a592caca0e-sys\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.799661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.799510    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c856369-c954-42a2-a717-09a592caca0e-root\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.799661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.799556    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-wtmp\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.799661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.799565    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c856369-c954-42a2-a717-09a592caca0e-sys\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.799661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.799565    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3c856369-c954-42a2-a717-09a592caca0e-root\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.799661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.799604    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.799661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.799645    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4rjw7\" (UniqueName: \"kubernetes.io/projected/3c856369-c954-42a2-a717-09a592caca0e-kube-api-access-4rjw7\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.800000 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.799683    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-tls\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.800000 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.799702    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-wtmp\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.800000 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.799717    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.800000 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.799856    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-textfile\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.800265 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.800248    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-textfile\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.800320 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.800298    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c856369-c954-42a2-a717-09a592caca0e-metrics-client-ca\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.800320 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.800305    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-accelerators-collector-config\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.802194 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.802178    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.802284 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.802269    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3c856369-c954-42a2-a717-09a592caca0e-node-exporter-tls\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.809582 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.809556    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rjw7\" (UniqueName: \"kubernetes.io/projected/3c856369-c954-42a2-a717-09a592caca0e-kube-api-access-4rjw7\") pod \"node-exporter-8gspp\" (UID: \"3c856369-c954-42a2-a717-09a592caca0e\") " pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.910946 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:44.910847    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8gspp"
May 26 00:09:44.919809 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:09:44.919775    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c856369_c954_42a2_a717_09a592caca0e.slice/crio-5cd98c89f08d7ea32ece1e51e8a7ccc000bbc8103ee8c43ef42d06948aecacc1 WatchSource:0}: Error finding container 5cd98c89f08d7ea32ece1e51e8a7ccc000bbc8103ee8c43ef42d06948aecacc1: Status 404 returned error can't find the container with id 5cd98c89f08d7ea32ece1e51e8a7ccc000bbc8103ee8c43ef42d06948aecacc1
May 26 00:09:45.656354 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.656253    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 00:09:45.661414 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.661388    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.663982 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.663958    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-t4wls\""
May 26 00:09:45.664143 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.664123    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 26 00:09:45.664565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.664257    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 26 00:09:45.664565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.664314    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 26 00:09:45.664565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.664336    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 26 00:09:45.664565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.664348    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 26 00:09:45.664565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.664475    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 26 00:09:45.664886 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.664597    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 26 00:09:45.664886 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.664658    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 26 00:09:45.664886 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.664669    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 26 00:09:45.670939 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.670910    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 00:09:45.706060 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.706001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnkhx\" (UniqueName: \"kubernetes.io/projected/6f2935b4-78b9-4250-9c7e-1be522ff3280-kube-api-access-nnkhx\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.706246 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.706073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-web-config\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.706246 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.706094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2935b4-78b9-4250-9c7e-1be522ff3280-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.706246 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.706163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f2935b4-78b9-4250-9c7e-1be522ff3280-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.706246 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.706206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f2935b4-78b9-4250-9c7e-1be522ff3280-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.706453 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.706254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.706453 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.706298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.706453 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.706386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.706453 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.706420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.706453 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.706450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.706688 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.706579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f2935b4-78b9-4250-9c7e-1be522ff3280-config-out\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.706688 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.706618    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2935b4-78b9-4250-9c7e-1be522ff3280-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.706789 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.706686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807116 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807085    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nnkhx\" (UniqueName: \"kubernetes.io/projected/6f2935b4-78b9-4250-9c7e-1be522ff3280-kube-api-access-nnkhx\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807293 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807128    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-web-config\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807293 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807261    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2935b4-78b9-4250-9c7e-1be522ff3280-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807424 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807322    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f2935b4-78b9-4250-9c7e-1be522ff3280-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807424 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807347    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f2935b4-78b9-4250-9c7e-1be522ff3280-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807424 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807373    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807576 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807433    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807576 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807555    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807683 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807586    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807683 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807621    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807773 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807703    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f2935b4-78b9-4250-9c7e-1be522ff3280-config-out\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807816 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807780    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2935b4-78b9-4250-9c7e-1be522ff3280-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807816 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807799    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f2935b4-78b9-4250-9c7e-1be522ff3280-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.807983 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.807824    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.808162 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:45.808096    2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
May 26 00:09:45.808217 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:09:45.808168    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-main-tls podName:6f2935b4-78b9-4250-9c7e-1be522ff3280 nodeName:}" failed. No retries permitted until 2026-05-26 00:09:46.308147579 +0000 UTC m=+127.372118445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280") : secret "alertmanager-main-tls" not found
May 26 00:09:45.809379 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.809350    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2935b4-78b9-4250-9c7e-1be522ff3280-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.809693 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.809671    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2935b4-78b9-4250-9c7e-1be522ff3280-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.810573 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.810547    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-web-config\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.811081 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.811031    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.811388 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.811362    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f2935b4-78b9-4250-9c7e-1be522ff3280-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.811485 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.811391    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.811752 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.811726    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.811839 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.811734    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.812223 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.812203    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f2935b4-78b9-4250-9c7e-1be522ff3280-config-out\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.813433 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.813415    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.814843 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.814826    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnkhx\" (UniqueName: \"kubernetes.io/projected/6f2935b4-78b9-4250-9c7e-1be522ff3280-kube-api-access-nnkhx\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:45.851677 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:45.851618    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8gspp" event={"ID":"3c856369-c954-42a2-a717-09a592caca0e","Type":"ContainerStarted","Data":"5cd98c89f08d7ea32ece1e51e8a7ccc000bbc8103ee8c43ef42d06948aecacc1"}
May 26 00:09:46.311608 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.311571    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:46.314207 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.314176    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:46.574308 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.574234    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 00:09:46.581974 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.581949    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"]
May 26 00:09:46.585055 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.585034    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.587794 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.587772    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 26 00:09:46.587932 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.587772    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 26 00:09:46.587998 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.587976    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 26 00:09:46.588190 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.588001    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 26 00:09:46.588320 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.588055    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f3fvecia92erp\""
May 26 00:09:46.588320 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.588161    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 26 00:09:46.588854 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.588838    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-r9vpg\""
May 26 00:09:46.598001 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.597974    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"]
May 26 00:09:46.614822 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.614791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-grpc-tls\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.614993 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.614826    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8mb2\" (UniqueName: \"kubernetes.io/projected/db937438-6699-4e04-a119-f0550284118d-kube-api-access-w8mb2\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.614993 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.614915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.614993 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.614944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.614993 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.614964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.615264 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.615037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-tls\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.615264 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.615058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.615264 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.615083    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db937438-6699-4e04-a119-f0550284118d-metrics-client-ca\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.715792 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.715756    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-grpc-tls\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.716215 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.715797    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8mb2\" (UniqueName: \"kubernetes.io/projected/db937438-6699-4e04-a119-f0550284118d-kube-api-access-w8mb2\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.716215 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.715845    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.716215 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.715871    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.716215 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.715890    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.716215 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.716076    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-tls\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.716215 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.716126    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.716215 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.716171    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db937438-6699-4e04-a119-f0550284118d-metrics-client-ca\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.717041 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.717003    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db937438-6699-4e04-a119-f0550284118d-metrics-client-ca\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.719559 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.719540    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-grpc-tls\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.720090 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.720056    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.720224 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.720116    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.720288 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.720266    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.720340 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.720304    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.721072 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.720981    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 00:09:46.721315 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.721296    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/db937438-6699-4e04-a119-f0550284118d-secret-thanos-querier-tls\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.722879 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:09:46.722832    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f2935b4_78b9_4250_9c7e_1be522ff3280.slice/crio-2f561d50668a93f92d652976e2a0669c6626b98b5a55947ace8396ea0da9ccc8 WatchSource:0}: Error finding container 2f561d50668a93f92d652976e2a0669c6626b98b5a55947ace8396ea0da9ccc8: Status 404 returned error can't find the container with id 2f561d50668a93f92d652976e2a0669c6626b98b5a55947ace8396ea0da9ccc8
May 26 00:09:46.725311 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.725293    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8mb2\" (UniqueName: \"kubernetes.io/projected/db937438-6699-4e04-a119-f0550284118d-kube-api-access-w8mb2\") pod \"thanos-querier-789bbb7b74-2c7vb\" (UID: \"db937438-6699-4e04-a119-f0550284118d\") " pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:46.855093 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.854984    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerStarted","Data":"2f561d50668a93f92d652976e2a0669c6626b98b5a55947ace8396ea0da9ccc8"}
May 26 00:09:46.856429 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.856391    2576 generic.go:358] "Generic (PLEG): container finished" podID="3c856369-c954-42a2-a717-09a592caca0e" containerID="ae78745648165779f9377aedc0fed305c8f9a24c446afca110d8b1656a5ebe9b" exitCode=0
May 26 00:09:46.856559 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.856430    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8gspp" event={"ID":"3c856369-c954-42a2-a717-09a592caca0e","Type":"ContainerDied","Data":"ae78745648165779f9377aedc0fed305c8f9a24c446afca110d8b1656a5ebe9b"}
May 26 00:09:46.896377 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:46.896354    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:47.036681 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:47.036652    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"]
May 26 00:09:47.040429 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:09:47.040395    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb937438_6699_4e04_a119_f0550284118d.slice/crio-ce94ee45963546a86d25a32eeed23eedad5cb1c4de0c7f900bb8068016b4f137 WatchSource:0}: Error finding container ce94ee45963546a86d25a32eeed23eedad5cb1c4de0c7f900bb8068016b4f137: Status 404 returned error can't find the container with id ce94ee45963546a86d25a32eeed23eedad5cb1c4de0c7f900bb8068016b4f137
May 26 00:09:47.862319 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:47.862276    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8gspp" event={"ID":"3c856369-c954-42a2-a717-09a592caca0e","Type":"ContainerStarted","Data":"ccf97e613a73369520048ca3edc9bd63641c210761646f1f9578338eaf7a5c6e"}
May 26 00:09:47.862822 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:47.862326    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8gspp" event={"ID":"3c856369-c954-42a2-a717-09a592caca0e","Type":"ContainerStarted","Data":"3d2510e8c60a384584325f2c1269e670bcc589121679ab3ccbe92e63b764348c"}
May 26 00:09:47.863455 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:47.863429    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb" event={"ID":"db937438-6699-4e04-a119-f0550284118d","Type":"ContainerStarted","Data":"ce94ee45963546a86d25a32eeed23eedad5cb1c4de0c7f900bb8068016b4f137"}
May 26 00:09:47.886845 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:47.886790    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8gspp" podStartSLOduration=2.961156472 podStartE2EDuration="3.886774265s" podCreationTimestamp="2026-05-26 00:09:44 +0000 UTC" firstStartedPulling="2026-05-26 00:09:44.922175627 +0000 UTC m=+125.986146505" lastFinishedPulling="2026-05-26 00:09:45.84779343 +0000 UTC m=+126.911764298" observedRunningTime="2026-05-26 00:09:47.884728512 +0000 UTC m=+128.948699399" watchObservedRunningTime="2026-05-26 00:09:47.886774265 +0000 UTC m=+128.950745155"
May 26 00:09:48.867981 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:48.867939    2576 generic.go:358] "Generic (PLEG): container finished" podID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerID="4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293" exitCode=0
May 26 00:09:48.868462 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:48.868137    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerDied","Data":"4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293"}
May 26 00:09:49.241032 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:49.240976    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:09:49.243670 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:49.243646    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/df89838f-af5c-4ca8-af8e-9dcfe5f6c321-metrics-certs\") pod \"network-metrics-daemon-dflxx\" (UID: \"df89838f-af5c-4ca8-af8e-9dcfe5f6c321\") " pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:09:49.306053 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:49.306003    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6mqgt\""
May 26 00:09:49.314531 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:49.314501    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dflxx"
May 26 00:09:49.454626 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:49.454595    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dflxx"]
May 26 00:09:49.457983 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:09:49.457953    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf89838f_af5c_4ca8_af8e_9dcfe5f6c321.slice/crio-fb1e6c0d7793dc57b7b3d578e3c7d5a9c09d7979b0da98487df26ca288fb1c42 WatchSource:0}: Error finding container fb1e6c0d7793dc57b7b3d578e3c7d5a9c09d7979b0da98487df26ca288fb1c42: Status 404 returned error can't find the container with id fb1e6c0d7793dc57b7b3d578e3c7d5a9c09d7979b0da98487df26ca288fb1c42
May 26 00:09:49.872349 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:49.872308    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dflxx" event={"ID":"df89838f-af5c-4ca8-af8e-9dcfe5f6c321","Type":"ContainerStarted","Data":"fb1e6c0d7793dc57b7b3d578e3c7d5a9c09d7979b0da98487df26ca288fb1c42"}
May 26 00:09:49.874639 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:49.874608    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb" event={"ID":"db937438-6699-4e04-a119-f0550284118d","Type":"ContainerStarted","Data":"6fd79e369ffc9ba55b43ec5f4ab30aa09f099b09859491d85443f737dffa39ad"}
May 26 00:09:49.874751 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:49.874648    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb" event={"ID":"db937438-6699-4e04-a119-f0550284118d","Type":"ContainerStarted","Data":"b77e0806596c644a88777b2b4ec47b2bb2dde4b302db1ccaab56548d266a9adb"}
May 26 00:09:49.874751 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:49.874662    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb" event={"ID":"db937438-6699-4e04-a119-f0550284118d","Type":"ContainerStarted","Data":"d706130958eeaae1363fb95a6f730de5ae37e7a315b721008bc1151e150c9140"}
May 26 00:09:50.883756 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:50.883697    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb" event={"ID":"db937438-6699-4e04-a119-f0550284118d","Type":"ContainerStarted","Data":"918822bb42e22caf84f813d55881af1723b804faa2f539c8afee9d0cadb98cd1"}
May 26 00:09:51.891953 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.891912    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerStarted","Data":"2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247"}
May 26 00:09:51.892379 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.891959    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerStarted","Data":"f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239"}
May 26 00:09:51.892379 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.891975    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerStarted","Data":"2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c"}
May 26 00:09:51.892379 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.891987    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerStarted","Data":"e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0"}
May 26 00:09:51.892379 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.892005    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerStarted","Data":"527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e"}
May 26 00:09:51.892379 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.892045    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerStarted","Data":"6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b"}
May 26 00:09:51.894417 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.894381    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb" event={"ID":"db937438-6699-4e04-a119-f0550284118d","Type":"ContainerStarted","Data":"20fda642fef451b5f50b55ce3aa985976da260676c1e2d00d6d931c34e230727"}
May 26 00:09:51.894555 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.894419    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb" event={"ID":"db937438-6699-4e04-a119-f0550284118d","Type":"ContainerStarted","Data":"1197d33856dfca7a980d6dae7c40f4c99293eb7a051c9177e36429a4e08a574d"}
May 26 00:09:51.894555 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.894539    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:51.895870 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.895848    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dflxx" event={"ID":"df89838f-af5c-4ca8-af8e-9dcfe5f6c321","Type":"ContainerStarted","Data":"3d5d96b6e390e9a7e3a61be5227c9b67a66d3d6b4a52405a0298bdf8d2a321f0"}
May 26 00:09:51.895981 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.895873    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dflxx" event={"ID":"df89838f-af5c-4ca8-af8e-9dcfe5f6c321","Type":"ContainerStarted","Data":"b0eb57e99975f31deae3ca9549fe3a8d4ccf7f8410e0abb2f9be524770edcea8"}
May 26 00:09:51.917848 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.917787    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.810779356 podStartE2EDuration="6.917767813s" podCreationTimestamp="2026-05-26 00:09:45 +0000 UTC" firstStartedPulling="2026-05-26 00:09:46.724908195 +0000 UTC m=+127.788879063" lastFinishedPulling="2026-05-26 00:09:50.831896652 +0000 UTC m=+131.895867520" observedRunningTime="2026-05-26 00:09:51.915620138 +0000 UTC m=+132.979591025" watchObservedRunningTime="2026-05-26 00:09:51.917767813 +0000 UTC m=+132.981738703"
May 26 00:09:51.941309 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.941249    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb" podStartSLOduration=2.819007132 podStartE2EDuration="5.941229354s" podCreationTimestamp="2026-05-26 00:09:46 +0000 UTC" firstStartedPulling="2026-05-26 00:09:47.042378062 +0000 UTC m=+128.106348927" lastFinishedPulling="2026-05-26 00:09:50.164600269 +0000 UTC m=+131.228571149" observedRunningTime="2026-05-26 00:09:51.940132329 +0000 UTC m=+133.004103219" watchObservedRunningTime="2026-05-26 00:09:51.941229354 +0000 UTC m=+133.005200242"
May 26 00:09:51.956746 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:51.956683    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dflxx" podStartSLOduration=131.585211109 podStartE2EDuration="2m12.956660682s" podCreationTimestamp="2026-05-26 00:07:39 +0000 UTC" firstStartedPulling="2026-05-26 00:09:49.460103826 +0000 UTC m=+130.524074694" lastFinishedPulling="2026-05-26 00:09:50.831553386 +0000 UTC m=+131.895524267" observedRunningTime="2026-05-26 00:09:51.954891925 +0000 UTC m=+133.018862812" watchObservedRunningTime="2026-05-26 00:09:51.956660682 +0000 UTC m=+133.020631571"
May 26 00:09:52.822128 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:52.822099    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-868bc5c65b-blwhp"
May 26 00:09:57.486848 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:57.486814    2576 scope.go:117] "RemoveContainer" containerID="177747e171d992c415c40697d3dc0cce04203602cc0c6b9861b5d356b4600285"
May 26 00:09:57.905041 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:57.904996    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-789bbb7b74-2c7vb"
May 26 00:09:57.914328 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:57.914306    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:09:57.914465 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:57.914421    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z" event={"ID":"489e63ab-8393-4061-9e58-b90fdf908129","Type":"ContainerStarted","Data":"17c4697a967b903562c7d06e3fba10b4ae8194516d974e3870762a86d5e7b3d4"}
May 26 00:09:57.914697 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:57.914683    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:57.943507 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:57.943461    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z" podStartSLOduration=53.828346028 podStartE2EDuration="56.943446537s" podCreationTimestamp="2026-05-26 00:09:01 +0000 UTC" firstStartedPulling="2026-05-26 00:09:01.752184449 +0000 UTC m=+82.816155313" lastFinishedPulling="2026-05-26 00:09:04.867284955 +0000 UTC m=+85.931255822" observedRunningTime="2026-05-26 00:09:57.942293935 +0000 UTC m=+139.006264825" watchObservedRunningTime="2026-05-26 00:09:57.943446537 +0000 UTC m=+139.007417424"
May 26 00:09:58.067838 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:58.067809    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-rhr6z"
May 26 00:09:58.239321 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:58.239243    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-z4vkc"]
May 26 00:09:58.242551 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:58.242530    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-z4vkc"
May 26 00:09:58.245332 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:58.245312    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-m2trn\""
May 26 00:09:58.245465 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:58.245446    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 26 00:09:58.245518 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:58.245505    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 26 00:09:58.251526 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:58.251505    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-z4vkc"]
May 26 00:09:58.321994 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:58.321955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtw7l\" (UniqueName: \"kubernetes.io/projected/9e060e16-2a7e-4edf-9837-a6d7690476df-kube-api-access-jtw7l\") pod \"downloads-57bd96b888-z4vkc\" (UID: \"9e060e16-2a7e-4edf-9837-a6d7690476df\") " pod="openshift-console/downloads-57bd96b888-z4vkc"
May 26 00:09:58.423153 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:58.423118    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtw7l\" (UniqueName: \"kubernetes.io/projected/9e060e16-2a7e-4edf-9837-a6d7690476df-kube-api-access-jtw7l\") pod \"downloads-57bd96b888-z4vkc\" (UID: \"9e060e16-2a7e-4edf-9837-a6d7690476df\") " pod="openshift-console/downloads-57bd96b888-z4vkc"
May 26 00:09:58.430956 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:58.430927    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtw7l\" (UniqueName: \"kubernetes.io/projected/9e060e16-2a7e-4edf-9837-a6d7690476df-kube-api-access-jtw7l\") pod \"downloads-57bd96b888-z4vkc\" (UID: \"9e060e16-2a7e-4edf-9837-a6d7690476df\") " pod="openshift-console/downloads-57bd96b888-z4vkc"
May 26 00:09:58.552300 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:58.552261    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-z4vkc"
May 26 00:09:58.682940 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:58.682904    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-z4vkc"]
May 26 00:09:58.685953 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:09:58.685925    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e060e16_2a7e_4edf_9837_a6d7690476df.slice/crio-4866da67daa55964198916241be721546b2edb628e8044aca23a9727b72c0e5a WatchSource:0}: Error finding container 4866da67daa55964198916241be721546b2edb628e8044aca23a9727b72c0e5a: Status 404 returned error can't find the container with id 4866da67daa55964198916241be721546b2edb628e8044aca23a9727b72c0e5a
May 26 00:09:58.918896 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:09:58.918809    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-z4vkc" event={"ID":"9e060e16-2a7e-4edf-9837-a6d7690476df","Type":"ContainerStarted","Data":"4866da67daa55964198916241be721546b2edb628e8044aca23a9727b72c0e5a"}
May 26 00:10:07.545385 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.545320    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-68dff676cf-tmjxx"]
May 26 00:10:07.549970 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.549945    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.552381 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.552356    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 26 00:10:07.552516 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.552484    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 26 00:10:07.553660 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.553639    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 26 00:10:07.553734 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.553665    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 26 00:10:07.553734 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.553672    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 26 00:10:07.553847 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.553748    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6d7xh\""
May 26 00:10:07.563119 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.563098    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68dff676cf-tmjxx"]
May 26 00:10:07.607166 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.607137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptq7m\" (UniqueName: \"kubernetes.io/projected/6cf0e759-a377-4aa2-bfd2-3885b96df144-kube-api-access-ptq7m\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.607373 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.607185    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-oauth-config\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.607373 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.607254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-oauth-serving-cert\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.607373 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.607351    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-serving-cert\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.607511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.607393    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-config\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.607511 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.607424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-service-ca\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.708689 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.708645    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-serving-cert\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.708963 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.708697    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-config\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.708963 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.708832    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-service-ca\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.708963 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.708941    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ptq7m\" (UniqueName: \"kubernetes.io/projected/6cf0e759-a377-4aa2-bfd2-3885b96df144-kube-api-access-ptq7m\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.709332 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.708983    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-oauth-config\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.709332 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.709040    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-oauth-serving-cert\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.709476 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.709415    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-config\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.709551 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.709506    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-service-ca\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.709923 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.709896    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-oauth-serving-cert\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.711801 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.711781    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-serving-cert\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.712904 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.712879    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-oauth-config\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.716786 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.716766    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptq7m\" (UniqueName: \"kubernetes.io/projected/6cf0e759-a377-4aa2-bfd2-3885b96df144-kube-api-access-ptq7m\") pod \"console-68dff676cf-tmjxx\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") " pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:07.861614 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:07.861531    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:08.013459 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:08.013416    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68dff676cf-tmjxx"]
May 26 00:10:08.957584 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:08.957495    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dff676cf-tmjxx" event={"ID":"6cf0e759-a377-4aa2-bfd2-3885b96df144","Type":"ContainerStarted","Data":"3eef91ef1dee74ba32bd04b9caca7ecacf9cfb3f72e0cf767d918fcdfa20ac98"}
May 26 00:10:11.344366 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.344334    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c99f4b488-9vwc9"]
May 26 00:10:11.346721 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.346702    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.355887 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.355808    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 26 00:10:11.357250 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.357227    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c99f4b488-9vwc9"]
May 26 00:10:11.443912 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.443876    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2233c59-9769-4c74-a275-a58658fa5bfb-console-oauth-config\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.444120 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.443928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-service-ca\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.444120 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.443961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-console-config\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.444120 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.444058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-oauth-serving-cert\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.444120 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.444104    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-trusted-ca-bundle\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.444323 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.444185    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2233c59-9769-4c74-a275-a58658fa5bfb-console-serving-cert\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.444323 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.444254    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvq66\" (UniqueName: \"kubernetes.io/projected/f2233c59-9769-4c74-a275-a58658fa5bfb-kube-api-access-dvq66\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.544889 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.544843    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dvq66\" (UniqueName: \"kubernetes.io/projected/f2233c59-9769-4c74-a275-a58658fa5bfb-kube-api-access-dvq66\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.545085 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.544917    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2233c59-9769-4c74-a275-a58658fa5bfb-console-oauth-config\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.545085 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.544957    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-service-ca\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.545085 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.544986    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-console-config\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.545085 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.545029    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-oauth-serving-cert\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.545085 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.545061    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-trusted-ca-bundle\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.545336 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.545125    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2233c59-9769-4c74-a275-a58658fa5bfb-console-serving-cert\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.546272 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.546243    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-service-ca\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.547649 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.547623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-oauth-serving-cert\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.547819 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.547767    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-console-config\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.548299 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.548265    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2233c59-9769-4c74-a275-a58658fa5bfb-console-serving-cert\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.549327 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.549306    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2233c59-9769-4c74-a275-a58658fa5bfb-console-oauth-config\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.549487 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.549469    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-trusted-ca-bundle\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.555366 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.555346    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvq66\" (UniqueName: \"kubernetes.io/projected/f2233c59-9769-4c74-a275-a58658fa5bfb-kube-api-access-dvq66\") pod \"console-6c99f4b488-9vwc9\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") " pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:11.659283 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:11.659201    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:17.920497 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:17.920457    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c99f4b488-9vwc9"]
May 26 00:10:17.923501 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:10:17.923478    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2233c59_9769_4c74_a275_a58658fa5bfb.slice/crio-9ba54636c33ae8ab6566138956d7f8f08a3f83dd77121fe936f1e8a66640adee WatchSource:0}: Error finding container 9ba54636c33ae8ab6566138956d7f8f08a3f83dd77121fe936f1e8a66640adee: Status 404 returned error can't find the container with id 9ba54636c33ae8ab6566138956d7f8f08a3f83dd77121fe936f1e8a66640adee
May 26 00:10:17.996949 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:17.996912    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-z4vkc" event={"ID":"9e060e16-2a7e-4edf-9837-a6d7690476df","Type":"ContainerStarted","Data":"cebf87d21e8e1ea92f22dc462bc2cfb0128075158d170b644f6e0c0a627d92e8"}
May 26 00:10:17.997302 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:17.997276    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-z4vkc"
May 26 00:10:17.998554 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:17.998531    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c99f4b488-9vwc9" event={"ID":"f2233c59-9769-4c74-a275-a58658fa5bfb","Type":"ContainerStarted","Data":"f423f64a8e4e708ef4e67556e6498f495ee1bc3ae3985ce1b8df3a6365011deb"}
May 26 00:10:17.998714 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:17.998694    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c99f4b488-9vwc9" event={"ID":"f2233c59-9769-4c74-a275-a58658fa5bfb","Type":"ContainerStarted","Data":"9ba54636c33ae8ab6566138956d7f8f08a3f83dd77121fe936f1e8a66640adee"}
May 26 00:10:17.998830 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:17.998616    2576 patch_prober.go:28] interesting pod/downloads-57bd96b888-z4vkc container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused" start-of-body=
May 26 00:10:17.998902 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:17.998859    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-57bd96b888-z4vkc" podUID="9e060e16-2a7e-4edf-9837-a6d7690476df" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused"
May 26 00:10:18.000061 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:18.000026    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dff676cf-tmjxx" event={"ID":"6cf0e759-a377-4aa2-bfd2-3885b96df144","Type":"ContainerStarted","Data":"eb8766308208d7a45813ea7364fd4d0ad80b030a31cebb5ff5a266ce572355a2"}
May 26 00:10:18.013370 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:18.013316    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-z4vkc" podStartSLOduration=0.870761631 podStartE2EDuration="20.013297544s" podCreationTimestamp="2026-05-26 00:09:58 +0000 UTC" firstStartedPulling="2026-05-26 00:09:58.687894644 +0000 UTC m=+139.751865510" lastFinishedPulling="2026-05-26 00:10:17.830430552 +0000 UTC m=+158.894401423" observedRunningTime="2026-05-26 00:10:18.012141558 +0000 UTC m=+159.076112446" watchObservedRunningTime="2026-05-26 00:10:18.013297544 +0000 UTC m=+159.077268431"
May 26 00:10:18.028403 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:18.028307    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6c99f4b488-9vwc9" podStartSLOduration=7.028290654 podStartE2EDuration="7.028290654s" podCreationTimestamp="2026-05-26 00:10:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:10:18.026661933 +0000 UTC m=+159.090632821" watchObservedRunningTime="2026-05-26 00:10:18.028290654 +0000 UTC m=+159.092261540"
May 26 00:10:18.044142 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:18.044092    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-68dff676cf-tmjxx" podStartSLOduration=1.281797829 podStartE2EDuration="11.044077859s" podCreationTimestamp="2026-05-26 00:10:07 +0000 UTC" firstStartedPulling="2026-05-26 00:10:08.020422805 +0000 UTC m=+149.084393670" lastFinishedPulling="2026-05-26 00:10:17.782702823 +0000 UTC m=+158.846673700" observedRunningTime="2026-05-26 00:10:18.042005413 +0000 UTC m=+159.105976301" watchObservedRunningTime="2026-05-26 00:10:18.044077859 +0000 UTC m=+159.108048747"
May 26 00:10:19.008436 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:19.008409    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-z4vkc"
May 26 00:10:21.014216 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:21.014165    2576 generic.go:358] "Generic (PLEG): container finished" podID="935c5842-1124-421f-9642-8984f62c9e00" containerID="97425213aa77b242fe9dfad7594d60abf0d5f4bfd63a230c293590d6a460bda9" exitCode=0
May 26 00:10:21.014668 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:21.014222    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8" event={"ID":"935c5842-1124-421f-9642-8984f62c9e00","Type":"ContainerDied","Data":"97425213aa77b242fe9dfad7594d60abf0d5f4bfd63a230c293590d6a460bda9"}
May 26 00:10:21.014668 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:21.014584    2576 scope.go:117] "RemoveContainer" containerID="97425213aa77b242fe9dfad7594d60abf0d5f4bfd63a230c293590d6a460bda9"
May 26 00:10:21.659724 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:21.659684    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:21.659907 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:21.659796    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:21.665399 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:21.665370    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:22.020429 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:22.020380    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-sbzt8" event={"ID":"935c5842-1124-421f-9642-8984f62c9e00","Type":"ContainerStarted","Data":"38ba0ded774879d7269f69a6c41d423b813eb36fa10a5c938964f112610be490"}
May 26 00:10:22.027117 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:22.027090    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:10:22.077544 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:22.077509    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68dff676cf-tmjxx"]
May 26 00:10:27.862420 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:27.862338    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:31.050384 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:31.050345    2576 generic.go:358] "Generic (PLEG): container finished" podID="c93fbefe-89d4-4b5a-9403-192340b41e89" containerID="92dd2c28d8081beeb35f99bbe3c6ad3b05359b6c5a5660295c67a1614ee94802" exitCode=0
May 26 00:10:31.050806 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:31.050413    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-627zg" event={"ID":"c93fbefe-89d4-4b5a-9403-192340b41e89","Type":"ContainerDied","Data":"92dd2c28d8081beeb35f99bbe3c6ad3b05359b6c5a5660295c67a1614ee94802"}
May 26 00:10:31.050806 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:31.050740    2576 scope.go:117] "RemoveContainer" containerID="92dd2c28d8081beeb35f99bbe3c6ad3b05359b6c5a5660295c67a1614ee94802"
May 26 00:10:32.054768 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:32.054737    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-627zg" event={"ID":"c93fbefe-89d4-4b5a-9403-192340b41e89","Type":"ContainerStarted","Data":"80461da3b9c115d902b7167e594e6c94bc6c273a7bc471fa1760c39309415da7"}
May 26 00:10:47.107130 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.107067    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-68dff676cf-tmjxx" podUID="6cf0e759-a377-4aa2-bfd2-3885b96df144" containerName="console" containerID="cri-o://eb8766308208d7a45813ea7364fd4d0ad80b030a31cebb5ff5a266ce572355a2" gracePeriod=15
May 26 00:10:47.405444 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.405423    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68dff676cf-tmjxx_6cf0e759-a377-4aa2-bfd2-3885b96df144/console/0.log"
May 26 00:10:47.405560 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.405494    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:47.478842 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.478812    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-oauth-serving-cert\") pod \"6cf0e759-a377-4aa2-bfd2-3885b96df144\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") "
May 26 00:10:47.478982 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.478873    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-oauth-config\") pod \"6cf0e759-a377-4aa2-bfd2-3885b96df144\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") "
May 26 00:10:47.478982 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.478940    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-serving-cert\") pod \"6cf0e759-a377-4aa2-bfd2-3885b96df144\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") "
May 26 00:10:47.478982 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.478962    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-service-ca\") pod \"6cf0e759-a377-4aa2-bfd2-3885b96df144\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") "
May 26 00:10:47.479156 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.479047    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-config\") pod \"6cf0e759-a377-4aa2-bfd2-3885b96df144\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") "
May 26 00:10:47.479156 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.479076    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptq7m\" (UniqueName: \"kubernetes.io/projected/6cf0e759-a377-4aa2-bfd2-3885b96df144-kube-api-access-ptq7m\") pod \"6cf0e759-a377-4aa2-bfd2-3885b96df144\" (UID: \"6cf0e759-a377-4aa2-bfd2-3885b96df144\") "
May 26 00:10:47.479412 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.479374    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6cf0e759-a377-4aa2-bfd2-3885b96df144" (UID: "6cf0e759-a377-4aa2-bfd2-3885b96df144"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:10:47.479412 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.479397    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-config" (OuterVolumeSpecName: "console-config") pod "6cf0e759-a377-4aa2-bfd2-3885b96df144" (UID: "6cf0e759-a377-4aa2-bfd2-3885b96df144"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:10:47.479565 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.479383    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-service-ca" (OuterVolumeSpecName: "service-ca") pod "6cf0e759-a377-4aa2-bfd2-3885b96df144" (UID: "6cf0e759-a377-4aa2-bfd2-3885b96df144"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:10:47.481436 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.481406    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6cf0e759-a377-4aa2-bfd2-3885b96df144" (UID: "6cf0e759-a377-4aa2-bfd2-3885b96df144"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:10:47.481436 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.481421    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6cf0e759-a377-4aa2-bfd2-3885b96df144" (UID: "6cf0e759-a377-4aa2-bfd2-3885b96df144"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:10:47.481568 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.481457    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cf0e759-a377-4aa2-bfd2-3885b96df144-kube-api-access-ptq7m" (OuterVolumeSpecName: "kube-api-access-ptq7m") pod "6cf0e759-a377-4aa2-bfd2-3885b96df144" (UID: "6cf0e759-a377-4aa2-bfd2-3885b96df144"). InnerVolumeSpecName "kube-api-access-ptq7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:10:47.579973 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.579942    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:10:47.579973 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.579968    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:10:47.579973 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.579977    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:10:47.580284 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.579985    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptq7m\" (UniqueName: \"kubernetes.io/projected/6cf0e759-a377-4aa2-bfd2-3885b96df144-kube-api-access-ptq7m\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:10:47.580284 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.579996    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6cf0e759-a377-4aa2-bfd2-3885b96df144-oauth-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:10:47.580284 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:47.580006    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6cf0e759-a377-4aa2-bfd2-3885b96df144-console-oauth-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:10:48.109773 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:48.109746    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-68dff676cf-tmjxx_6cf0e759-a377-4aa2-bfd2-3885b96df144/console/0.log"
May 26 00:10:48.110172 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:48.109789    2576 generic.go:358] "Generic (PLEG): container finished" podID="6cf0e759-a377-4aa2-bfd2-3885b96df144" containerID="eb8766308208d7a45813ea7364fd4d0ad80b030a31cebb5ff5a266ce572355a2" exitCode=2
May 26 00:10:48.110172 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:48.109851    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dff676cf-tmjxx" event={"ID":"6cf0e759-a377-4aa2-bfd2-3885b96df144","Type":"ContainerDied","Data":"eb8766308208d7a45813ea7364fd4d0ad80b030a31cebb5ff5a266ce572355a2"}
May 26 00:10:48.110172 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:48.109877    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68dff676cf-tmjxx" event={"ID":"6cf0e759-a377-4aa2-bfd2-3885b96df144","Type":"ContainerDied","Data":"3eef91ef1dee74ba32bd04b9caca7ecacf9cfb3f72e0cf767d918fcdfa20ac98"}
May 26 00:10:48.110172 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:48.109880    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68dff676cf-tmjxx"
May 26 00:10:48.110172 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:48.109903    2576 scope.go:117] "RemoveContainer" containerID="eb8766308208d7a45813ea7364fd4d0ad80b030a31cebb5ff5a266ce572355a2"
May 26 00:10:48.117947 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:48.117932    2576 scope.go:117] "RemoveContainer" containerID="eb8766308208d7a45813ea7364fd4d0ad80b030a31cebb5ff5a266ce572355a2"
May 26 00:10:48.118212 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:10:48.118195    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb8766308208d7a45813ea7364fd4d0ad80b030a31cebb5ff5a266ce572355a2\": container with ID starting with eb8766308208d7a45813ea7364fd4d0ad80b030a31cebb5ff5a266ce572355a2 not found: ID does not exist" containerID="eb8766308208d7a45813ea7364fd4d0ad80b030a31cebb5ff5a266ce572355a2"
May 26 00:10:48.118265 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:48.118219    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8766308208d7a45813ea7364fd4d0ad80b030a31cebb5ff5a266ce572355a2"} err="failed to get container status \"eb8766308208d7a45813ea7364fd4d0ad80b030a31cebb5ff5a266ce572355a2\": rpc error: code = NotFound desc = could not find container \"eb8766308208d7a45813ea7364fd4d0ad80b030a31cebb5ff5a266ce572355a2\": container with ID starting with eb8766308208d7a45813ea7364fd4d0ad80b030a31cebb5ff5a266ce572355a2 not found: ID does not exist"
May 26 00:10:48.125356 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:48.125335    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68dff676cf-tmjxx"]
May 26 00:10:48.128671 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:48.128653    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68dff676cf-tmjxx"]
May 26 00:10:49.490914 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:10:49.490878    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cf0e759-a377-4aa2-bfd2-3885b96df144" path="/var/lib/kubelet/pods/6cf0e759-a377-4aa2-bfd2-3885b96df144/volumes"
May 26 00:11:04.807939 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:04.807907    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 00:11:04.808417 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:04.808372    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="alertmanager" containerID="cri-o://6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b" gracePeriod=120
May 26 00:11:04.808562 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:04.808465    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="kube-rbac-proxy-metric" containerID="cri-o://f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239" gracePeriod=120
May 26 00:11:04.808704 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:04.808498    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="config-reloader" containerID="cri-o://527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e" gracePeriod=120
May 26 00:11:04.808774 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:04.808497    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="kube-rbac-proxy-web" containerID="cri-o://e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0" gracePeriod=120
May 26 00:11:04.809218 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:04.808531    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="kube-rbac-proxy" containerID="cri-o://2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c" gracePeriod=120
May 26 00:11:04.809218 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:04.808579    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="prom-label-proxy" containerID="cri-o://2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247" gracePeriod=120
May 26 00:11:05.160548 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:05.160462    2576 generic.go:358] "Generic (PLEG): container finished" podID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerID="2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247" exitCode=0
May 26 00:11:05.160548 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:05.160487    2576 generic.go:358] "Generic (PLEG): container finished" podID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerID="2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c" exitCode=0
May 26 00:11:05.160548 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:05.160494    2576 generic.go:358] "Generic (PLEG): container finished" podID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerID="527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e" exitCode=0
May 26 00:11:05.160548 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:05.160499    2576 generic.go:358] "Generic (PLEG): container finished" podID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerID="6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b" exitCode=0
May 26 00:11:05.160776 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:05.160545    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerDied","Data":"2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247"}
May 26 00:11:05.160776 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:05.160580    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerDied","Data":"2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c"}
May 26 00:11:05.160776 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:05.160590    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerDied","Data":"527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e"}
May 26 00:11:05.160776 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:05.160600    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerDied","Data":"6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b"}
May 26 00:11:06.054710 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.054689    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.165842 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.165753    2576 generic.go:358] "Generic (PLEG): container finished" podID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerID="f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239" exitCode=0
May 26 00:11:06.165842 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.165784    2576 generic.go:358] "Generic (PLEG): container finished" podID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerID="e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0" exitCode=0
May 26 00:11:06.165842 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.165830    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerDied","Data":"f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239"}
May 26 00:11:06.166083 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.165874    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerDied","Data":"e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0"}
May 26 00:11:06.166083 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.165878    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.166083 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.165884    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f2935b4-78b9-4250-9c7e-1be522ff3280","Type":"ContainerDied","Data":"2f561d50668a93f92d652976e2a0669c6626b98b5a55947ace8396ea0da9ccc8"}
May 26 00:11:06.166083 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.165902    2576 scope.go:117] "RemoveContainer" containerID="2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247"
May 26 00:11:06.173283 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.173266    2576 scope.go:117] "RemoveContainer" containerID="f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239"
May 26 00:11:06.179915 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.179890    2576 scope.go:117] "RemoveContainer" containerID="2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c"
May 26 00:11:06.187291 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.187274    2576 scope.go:117] "RemoveContainer" containerID="e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0"
May 26 00:11:06.193663 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.193646    2576 scope.go:117] "RemoveContainer" containerID="527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e"
May 26 00:11:06.199979 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.199964    2576 scope.go:117] "RemoveContainer" containerID="6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b"
May 26 00:11:06.206280 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.206262    2576 scope.go:117] "RemoveContainer" containerID="4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293"
May 26 00:11:06.212448 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.212433    2576 scope.go:117] "RemoveContainer" containerID="2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247"
May 26 00:11:06.212684 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:11:06.212666    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247\": container with ID starting with 2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247 not found: ID does not exist" containerID="2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247"
May 26 00:11:06.212728 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.212694    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247"} err="failed to get container status \"2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247\": rpc error: code = NotFound desc = could not find container \"2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247\": container with ID starting with 2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247 not found: ID does not exist"
May 26 00:11:06.212728 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.212714    2576 scope.go:117] "RemoveContainer" containerID="f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239"
May 26 00:11:06.212930 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:11:06.212914    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239\": container with ID starting with f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239 not found: ID does not exist" containerID="f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239"
May 26 00:11:06.212972 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.212937    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239"} err="failed to get container status \"f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239\": rpc error: code = NotFound desc = could not find container \"f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239\": container with ID starting with f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239 not found: ID does not exist"
May 26 00:11:06.212972 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.212953    2576 scope.go:117] "RemoveContainer" containerID="2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c"
May 26 00:11:06.213215 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:11:06.213200    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c\": container with ID starting with 2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c not found: ID does not exist" containerID="2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c"
May 26 00:11:06.213263 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.213217    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c"} err="failed to get container status \"2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c\": rpc error: code = NotFound desc = could not find container \"2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c\": container with ID starting with 2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c not found: ID does not exist"
May 26 00:11:06.213263 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.213231    2576 scope.go:117] "RemoveContainer" containerID="e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0"
May 26 00:11:06.213411 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:11:06.213397    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0\": container with ID starting with e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0 not found: ID does not exist" containerID="e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0"
May 26 00:11:06.213498 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.213414    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0"} err="failed to get container status \"e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0\": rpc error: code = NotFound desc = could not find container \"e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0\": container with ID starting with e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0 not found: ID does not exist"
May 26 00:11:06.213498 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.213426    2576 scope.go:117] "RemoveContainer" containerID="527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e"
May 26 00:11:06.213635 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:11:06.213617    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e\": container with ID starting with 527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e not found: ID does not exist" containerID="527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e"
May 26 00:11:06.213698 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.213643    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e"} err="failed to get container status \"527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e\": rpc error: code = NotFound desc = could not find container \"527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e\": container with ID starting with 527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e not found: ID does not exist"
May 26 00:11:06.213698 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.213666    2576 scope.go:117] "RemoveContainer" containerID="6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b"
May 26 00:11:06.213891 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:11:06.213875    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b\": container with ID starting with 6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b not found: ID does not exist" containerID="6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b"
May 26 00:11:06.213928 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.213895    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b"} err="failed to get container status \"6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b\": rpc error: code = NotFound desc = could not find container \"6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b\": container with ID starting with 6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b not found: ID does not exist"
May 26 00:11:06.213928 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.213911    2576 scope.go:117] "RemoveContainer" containerID="4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293"
May 26 00:11:06.214130 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:11:06.214113    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293\": container with ID starting with 4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293 not found: ID does not exist" containerID="4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293"
May 26 00:11:06.214202 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.214138    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293"} err="failed to get container status \"4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293\": rpc error: code = NotFound desc = could not find container \"4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293\": container with ID starting with 4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293 not found: ID does not exist"
May 26 00:11:06.214202 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.214160    2576 scope.go:117] "RemoveContainer" containerID="2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247"
May 26 00:11:06.214398 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.214381    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247"} err="failed to get container status \"2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247\": rpc error: code = NotFound desc = could not find container \"2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247\": container with ID starting with 2a2a6d7895b3392ab7d9827a4110a733ac4d95a035844040bb40fe301bc6a247 not found: ID does not exist"
May 26 00:11:06.214443 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.214399    2576 scope.go:117] "RemoveContainer" containerID="f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239"
May 26 00:11:06.214609 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.214592    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239"} err="failed to get container status \"f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239\": rpc error: code = NotFound desc = could not find container \"f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239\": container with ID starting with f8c6a760448d9e029ec7a4d0617823eafe5f35f1819899905db0caf4c0d32239 not found: ID does not exist"
May 26 00:11:06.214649 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.214611    2576 scope.go:117] "RemoveContainer" containerID="2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c"
May 26 00:11:06.214827 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.214808    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c"} err="failed to get container status \"2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c\": rpc error: code = NotFound desc = could not find container \"2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c\": container with ID starting with 2533ac86ce66e11b0b20060abfe6bd40d5e9d6657068c555ff2f7221a40ed30c not found: ID does not exist"
May 26 00:11:06.214877 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.214827    2576 scope.go:117] "RemoveContainer" containerID="e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0"
May 26 00:11:06.215025 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.214994    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0"} err="failed to get container status \"e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0\": rpc error: code = NotFound desc = could not find container \"e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0\": container with ID starting with e3872f4fdaf9a9b35774f710c2c1ec66c3826d53fbe346bb4455e4f8b5cc12c0 not found: ID does not exist"
May 26 00:11:06.215066 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.215027    2576 scope.go:117] "RemoveContainer" containerID="527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e"
May 26 00:11:06.215239 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.215222    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e"} err="failed to get container status \"527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e\": rpc error: code = NotFound desc = could not find container \"527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e\": container with ID starting with 527f8b63cd98450eebc34e53772cd700dcc94ed08f8cdeb40b0b2b95bc312d2e not found: ID does not exist"
May 26 00:11:06.215303 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.215240    2576 scope.go:117] "RemoveContainer" containerID="6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b"
May 26 00:11:06.215443 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.215424    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b"} err="failed to get container status \"6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b\": rpc error: code = NotFound desc = could not find container \"6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b\": container with ID starting with 6ee7e4506559df0de79d71d5856f12e93a442ac757bc621b6f01f163c3d2426b not found: ID does not exist"
May 26 00:11:06.215509 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.215445    2576 scope.go:117] "RemoveContainer" containerID="4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293"
May 26 00:11:06.215679 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.215659    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293"} err="failed to get container status \"4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293\": rpc error: code = NotFound desc = could not find container \"4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293\": container with ID starting with 4a7f38981c110f402cd798504ca64158d58973b985e3484d3f2c4c495e789293 not found: ID does not exist"
May 26 00:11:06.235960 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.235939    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f2935b4-78b9-4250-9c7e-1be522ff3280-alertmanager-main-db\") pod \"6f2935b4-78b9-4250-9c7e-1be522ff3280\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") "
May 26 00:11:06.236063 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.235975    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy\") pod \"6f2935b4-78b9-4250-9c7e-1be522ff3280\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") "
May 26 00:11:06.236063 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.235999    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-web-config\") pod \"6f2935b4-78b9-4250-9c7e-1be522ff3280\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") "
May 26 00:11:06.236063 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236032    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-cluster-tls-config\") pod \"6f2935b4-78b9-4250-9c7e-1be522ff3280\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") "
May 26 00:11:06.236226 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236084    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6f2935b4-78b9-4250-9c7e-1be522ff3280\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") "
May 26 00:11:06.236226 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236100    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f2935b4-78b9-4250-9c7e-1be522ff3280-config-out\") pod \"6f2935b4-78b9-4250-9c7e-1be522ff3280\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") "
May 26 00:11:06.236226 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236124    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy-web\") pod \"6f2935b4-78b9-4250-9c7e-1be522ff3280\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") "
May 26 00:11:06.236226 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236162    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2935b4-78b9-4250-9c7e-1be522ff3280-alertmanager-trusted-ca-bundle\") pod \"6f2935b4-78b9-4250-9c7e-1be522ff3280\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") "
May 26 00:11:06.236226 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236188    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2935b4-78b9-4250-9c7e-1be522ff3280-metrics-client-ca\") pod \"6f2935b4-78b9-4250-9c7e-1be522ff3280\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") "
May 26 00:11:06.236226 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236216    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-main-tls\") pod \"6f2935b4-78b9-4250-9c7e-1be522ff3280\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") "
May 26 00:11:06.236524 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236241    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-config-volume\") pod \"6f2935b4-78b9-4250-9c7e-1be522ff3280\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") "
May 26 00:11:06.236524 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236268    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f2935b4-78b9-4250-9c7e-1be522ff3280-tls-assets\") pod \"6f2935b4-78b9-4250-9c7e-1be522ff3280\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") "
May 26 00:11:06.236524 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236312    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f2935b4-78b9-4250-9c7e-1be522ff3280-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6f2935b4-78b9-4250-9c7e-1be522ff3280" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:11:06.236524 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236347    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnkhx\" (UniqueName: \"kubernetes.io/projected/6f2935b4-78b9-4250-9c7e-1be522ff3280-kube-api-access-nnkhx\") pod \"6f2935b4-78b9-4250-9c7e-1be522ff3280\" (UID: \"6f2935b4-78b9-4250-9c7e-1be522ff3280\") "
May 26 00:11:06.236723 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236639    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f2935b4-78b9-4250-9c7e-1be522ff3280-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6f2935b4-78b9-4250-9c7e-1be522ff3280" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:11:06.236723 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236628    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f2935b4-78b9-4250-9c7e-1be522ff3280-alertmanager-main-db\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:06.236988 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.236959    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f2935b4-78b9-4250-9c7e-1be522ff3280-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6f2935b4-78b9-4250-9c7e-1be522ff3280" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:11:06.239270 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.239120    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6f2935b4-78b9-4250-9c7e-1be522ff3280" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:06.239585 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.239564    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f2935b4-78b9-4250-9c7e-1be522ff3280-kube-api-access-nnkhx" (OuterVolumeSpecName: "kube-api-access-nnkhx") pod "6f2935b4-78b9-4250-9c7e-1be522ff3280" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280"). InnerVolumeSpecName "kube-api-access-nnkhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:11:06.240152 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.240110    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f2935b4-78b9-4250-9c7e-1be522ff3280-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6f2935b4-78b9-4250-9c7e-1be522ff3280" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:11:06.240276 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.240239    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6f2935b4-78b9-4250-9c7e-1be522ff3280" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:06.240276 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.240258    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6f2935b4-78b9-4250-9c7e-1be522ff3280" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:06.240406 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.240280    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f2935b4-78b9-4250-9c7e-1be522ff3280-config-out" (OuterVolumeSpecName: "config-out") pod "6f2935b4-78b9-4250-9c7e-1be522ff3280" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:11:06.240481 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.240461    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-config-volume" (OuterVolumeSpecName: "config-volume") pod "6f2935b4-78b9-4250-9c7e-1be522ff3280" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:06.240760 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.240742    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6f2935b4-78b9-4250-9c7e-1be522ff3280" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:06.244438 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.244415    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6f2935b4-78b9-4250-9c7e-1be522ff3280" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:06.250434 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.250411    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-web-config" (OuterVolumeSpecName: "web-config") pod "6f2935b4-78b9-4250-9c7e-1be522ff3280" (UID: "6f2935b4-78b9-4250-9c7e-1be522ff3280"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:06.337892 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.337855    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f2935b4-78b9-4250-9c7e-1be522ff3280-tls-assets\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:06.337892 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.337888    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnkhx\" (UniqueName: \"kubernetes.io/projected/6f2935b4-78b9-4250-9c7e-1be522ff3280-kube-api-access-nnkhx\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:06.337892 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.337899    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:06.338131 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.337932    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-web-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:06.338131 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.337943    2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-cluster-tls-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:06.338131 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.337952    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:06.338131 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.337962    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f2935b4-78b9-4250-9c7e-1be522ff3280-config-out\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:06.338131 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.337971    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:06.338131 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.337980    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f2935b4-78b9-4250-9c7e-1be522ff3280-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:06.338131 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.337989    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f2935b4-78b9-4250-9c7e-1be522ff3280-metrics-client-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:06.338131 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.337999    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-secret-alertmanager-main-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:06.338131 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.338030    2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f2935b4-78b9-4250-9c7e-1be522ff3280-config-volume\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:06.489153 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.489121    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 00:11:06.496048 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.496024    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 00:11:06.518078 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518050    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 00:11:06.518314 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518302    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="kube-rbac-proxy"
May 26 00:11:06.518355 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518315    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="kube-rbac-proxy"
May 26 00:11:06.518355 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518323    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cf0e759-a377-4aa2-bfd2-3885b96df144" containerName="console"
May 26 00:11:06.518355 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518329    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cf0e759-a377-4aa2-bfd2-3885b96df144" containerName="console"
May 26 00:11:06.518355 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518337    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="config-reloader"
May 26 00:11:06.518355 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518342    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="config-reloader"
May 26 00:11:06.518355 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518349    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="init-config-reloader"
May 26 00:11:06.518355 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518354    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="init-config-reloader"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518366    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="alertmanager"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518371    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="alertmanager"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518377    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="kube-rbac-proxy-web"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518383    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="kube-rbac-proxy-web"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518392    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="prom-label-proxy"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518397    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="prom-label-proxy"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518405    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="kube-rbac-proxy-metric"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518410    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="kube-rbac-proxy-metric"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518455    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="kube-rbac-proxy"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518464    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="prom-label-proxy"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518472    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="alertmanager"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518481    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="config-reloader"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518487    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="kube-rbac-proxy-metric"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518494    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" containerName="kube-rbac-proxy-web"
May 26 00:11:06.518546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.518500    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6cf0e759-a377-4aa2-bfd2-3885b96df144" containerName="console"
May 26 00:11:06.521991 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.521975    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.524700 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.524672    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 26 00:11:06.524795 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.524672    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 26 00:11:06.524795 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.524709    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 26 00:11:06.524878 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.524673    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 26 00:11:06.524978 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.524961    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 26 00:11:06.525109 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.525093    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 26 00:11:06.525170 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.525131    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-t4wls\""
May 26 00:11:06.525234 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.525165    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 26 00:11:06.525889 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.525863    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 26 00:11:06.530657 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.530562    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 26 00:11:06.533490 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.533462    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 00:11:06.639744 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.639701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-web-config\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.639900 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.639753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.639900 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.639778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.639900 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.639796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4nnp\" (UniqueName: \"kubernetes.io/projected/a9844eae-07db-493b-bf99-5501e98d00e3-kube-api-access-l4nnp\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.639900 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.639814    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-config-volume\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.639900 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.639833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.639900 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.639856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a9844eae-07db-493b-bf99-5501e98d00e3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.640107 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.639909    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9844eae-07db-493b-bf99-5501e98d00e3-config-out\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.640107 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.639941    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.640107 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.639967    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9844eae-07db-493b-bf99-5501e98d00e3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.640107 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.639996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9844eae-07db-493b-bf99-5501e98d00e3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.640107 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.640044    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9844eae-07db-493b-bf99-5501e98d00e3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.640107 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.640075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.740528 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740438    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.740528 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740488    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a9844eae-07db-493b-bf99-5501e98d00e3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.740528 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740515    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9844eae-07db-493b-bf99-5501e98d00e3-config-out\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.740792 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740539    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.740792 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740567    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9844eae-07db-493b-bf99-5501e98d00e3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.740792 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740603    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9844eae-07db-493b-bf99-5501e98d00e3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.740792 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740643    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9844eae-07db-493b-bf99-5501e98d00e3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.740792 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740693    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.740792 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740724    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-web-config\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.740792 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740758    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.740792 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740786    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.741218 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740809    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4nnp\" (UniqueName: \"kubernetes.io/projected/a9844eae-07db-493b-bf99-5501e98d00e3-kube-api-access-l4nnp\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.741218 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740837    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-config-volume\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.741218 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.740930    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a9844eae-07db-493b-bf99-5501e98d00e3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.741535 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.741392    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9844eae-07db-493b-bf99-5501e98d00e3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.741727 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.741699    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9844eae-07db-493b-bf99-5501e98d00e3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.743772 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.743660    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9844eae-07db-493b-bf99-5501e98d00e3-config-out\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.744157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.743946    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9844eae-07db-493b-bf99-5501e98d00e3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.744157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.743948    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.744157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.744084    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.744157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.744118    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-config-volume\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.744342 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.744215    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.744487 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.744471    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.744629 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.744613    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.745869 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.745853    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9844eae-07db-493b-bf99-5501e98d00e3-web-config\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.749736 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.749715    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4nnp\" (UniqueName: \"kubernetes.io/projected/a9844eae-07db-493b-bf99-5501e98d00e3-kube-api-access-l4nnp\") pod \"alertmanager-main-0\" (UID: \"a9844eae-07db-493b-bf99-5501e98d00e3\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.833756 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.833705    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 00:11:06.972492 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:06.972458    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 00:11:06.976270 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:11:06.976238    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9844eae_07db_493b_bf99_5501e98d00e3.slice/crio-330639e88c9bdb199d82db839577dae5c62b0f4c8e7a13257a36197d3284a934 WatchSource:0}: Error finding container 330639e88c9bdb199d82db839577dae5c62b0f4c8e7a13257a36197d3284a934: Status 404 returned error can't find the container with id 330639e88c9bdb199d82db839577dae5c62b0f4c8e7a13257a36197d3284a934
May 26 00:11:07.170797 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:07.170759    2576 generic.go:358] "Generic (PLEG): container finished" podID="a9844eae-07db-493b-bf99-5501e98d00e3" containerID="677f2fdfb6a863e4a840b97b951d1b4fbfe00f8c8584a929b774e280b585ba15" exitCode=0
May 26 00:11:07.171189 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:07.170856    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9844eae-07db-493b-bf99-5501e98d00e3","Type":"ContainerDied","Data":"677f2fdfb6a863e4a840b97b951d1b4fbfe00f8c8584a929b774e280b585ba15"}
May 26 00:11:07.171189 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:07.170892    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9844eae-07db-493b-bf99-5501e98d00e3","Type":"ContainerStarted","Data":"330639e88c9bdb199d82db839577dae5c62b0f4c8e7a13257a36197d3284a934"}
May 26 00:11:07.491747 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:07.491715    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f2935b4-78b9-4250-9c7e-1be522ff3280" path="/var/lib/kubelet/pods/6f2935b4-78b9-4250-9c7e-1be522ff3280/volumes"
May 26 00:11:08.177104 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.176999    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9844eae-07db-493b-bf99-5501e98d00e3","Type":"ContainerStarted","Data":"3d4f617545c8ba7a376d27630079296855d3d0ebb2ae11b8961b69c0dfe4f4b6"}
May 26 00:11:08.177104 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.177051    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9844eae-07db-493b-bf99-5501e98d00e3","Type":"ContainerStarted","Data":"34e0760a6c7e158f93000fe928983bc065b3b623f8f9f730b675b1d5e01cd614"}
May 26 00:11:08.177104 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.177064    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9844eae-07db-493b-bf99-5501e98d00e3","Type":"ContainerStarted","Data":"cefd0ceff6a73081c7c6c3001083f75fc78a29354e9e736bc0b0deddaa4cc3c7"}
May 26 00:11:08.177104 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.177075    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9844eae-07db-493b-bf99-5501e98d00e3","Type":"ContainerStarted","Data":"557b249a242f037498759d585dd8efb87a404765e04d0fe1e6b7e3a16a8a053f"}
May 26 00:11:08.177104 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.177086    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9844eae-07db-493b-bf99-5501e98d00e3","Type":"ContainerStarted","Data":"c1e4ec1328a8f7364c9d9a137f04de346c861baf70ae5608ac8c79b6085c319a"}
May 26 00:11:08.177104 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.177097    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9844eae-07db-493b-bf99-5501e98d00e3","Type":"ContainerStarted","Data":"6d5dc5bc995c31ec92917ccb71a5dcabb456cee1a615ddc15d561fa5f5080c97"}
May 26 00:11:08.204658 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.204611    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.204595994 podStartE2EDuration="2.204595994s" podCreationTimestamp="2026-05-26 00:11:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:11:08.201978948 +0000 UTC m=+209.265949835" watchObservedRunningTime="2026-05-26 00:11:08.204595994 +0000 UTC m=+209.268566881"
May 26 00:11:08.839563 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.839531    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-f89745d5-pvclv"]
May 26 00:11:08.841895 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.841873    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:08.844290 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.844271    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 26 00:11:08.844406 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.844277    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 26 00:11:08.844471 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.844433    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 26 00:11:08.844518 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.844471    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 26 00:11:08.844688 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.844675    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-k4q8p\""
May 26 00:11:08.844721 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.844704    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 26 00:11:08.850690 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.850659    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 26 00:11:08.852931 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.852910    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f89745d5-pvclv"]
May 26 00:11:08.960881 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.960833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjpqp\" (UniqueName: \"kubernetes.io/projected/61fa891c-e05b-45c5-b657-cc7a931bf435-kube-api-access-fjpqp\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:08.961087 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.960887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61fa891c-e05b-45c5-b657-cc7a931bf435-federate-client-tls\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:08.961087 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.960947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fa891c-e05b-45c5-b657-cc7a931bf435-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:08.961087 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.961060    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61fa891c-e05b-45c5-b657-cc7a931bf435-metrics-client-ca\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:08.961204 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.961094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fa891c-e05b-45c5-b657-cc7a931bf435-serving-certs-ca-bundle\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:08.961204 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.961167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61fa891c-e05b-45c5-b657-cc7a931bf435-telemeter-client-tls\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:08.961269 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.961212    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61fa891c-e05b-45c5-b657-cc7a931bf435-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:08.961269 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:08.961237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61fa891c-e05b-45c5-b657-cc7a931bf435-secret-telemeter-client\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.061986 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.061948    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61fa891c-e05b-45c5-b657-cc7a931bf435-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.061986 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.061987    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61fa891c-e05b-45c5-b657-cc7a931bf435-secret-telemeter-client\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.062216 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.062033    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fjpqp\" (UniqueName: \"kubernetes.io/projected/61fa891c-e05b-45c5-b657-cc7a931bf435-kube-api-access-fjpqp\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.062216 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.062059    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61fa891c-e05b-45c5-b657-cc7a931bf435-federate-client-tls\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.062216 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.062094    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fa891c-e05b-45c5-b657-cc7a931bf435-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.062216 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.062120    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61fa891c-e05b-45c5-b657-cc7a931bf435-metrics-client-ca\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.062216 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.062145    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fa891c-e05b-45c5-b657-cc7a931bf435-serving-certs-ca-bundle\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.062216 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.062194    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61fa891c-e05b-45c5-b657-cc7a931bf435-telemeter-client-tls\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.063071 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.062939    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fa891c-e05b-45c5-b657-cc7a931bf435-serving-certs-ca-bundle\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.063342 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.063185    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61fa891c-e05b-45c5-b657-cc7a931bf435-telemeter-trusted-ca-bundle\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.063342 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.063189    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61fa891c-e05b-45c5-b657-cc7a931bf435-metrics-client-ca\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.064777 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.064747    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61fa891c-e05b-45c5-b657-cc7a931bf435-federate-client-tls\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.064882 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.064793    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61fa891c-e05b-45c5-b657-cc7a931bf435-secret-telemeter-client\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.064944 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.064922    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61fa891c-e05b-45c5-b657-cc7a931bf435-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.064982 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.064954    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61fa891c-e05b-45c5-b657-cc7a931bf435-telemeter-client-tls\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.069400 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.069378    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjpqp\" (UniqueName: \"kubernetes.io/projected/61fa891c-e05b-45c5-b657-cc7a931bf435-kube-api-access-fjpqp\") pod \"telemeter-client-f89745d5-pvclv\" (UID: \"61fa891c-e05b-45c5-b657-cc7a931bf435\") " pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.152228 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.152140    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-f89745d5-pvclv"
May 26 00:11:09.281103 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:09.281076    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-f89745d5-pvclv"]
May 26 00:11:09.283687 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:11:09.283657    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61fa891c_e05b_45c5_b657_cc7a931bf435.slice/crio-fc783aee868ce223adbab264a267379f21f1ed551ef19a1b77530c24f415383e WatchSource:0}: Error finding container fc783aee868ce223adbab264a267379f21f1ed551ef19a1b77530c24f415383e: Status 404 returned error can't find the container with id fc783aee868ce223adbab264a267379f21f1ed551ef19a1b77530c24f415383e
May 26 00:11:10.184532 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:10.184496    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f89745d5-pvclv" event={"ID":"61fa891c-e05b-45c5-b657-cc7a931bf435","Type":"ContainerStarted","Data":"fc783aee868ce223adbab264a267379f21f1ed551ef19a1b77530c24f415383e"}
May 26 00:11:12.192172 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.192135    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f89745d5-pvclv" event={"ID":"61fa891c-e05b-45c5-b657-cc7a931bf435","Type":"ContainerStarted","Data":"8aeea401111072117d378e3465b48a585e1d7535a09b0ec5b1c520fa075ebb33"}
May 26 00:11:12.192172 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.192174    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f89745d5-pvclv" event={"ID":"61fa891c-e05b-45c5-b657-cc7a931bf435","Type":"ContainerStarted","Data":"6a85d27b75612de360fe5486eb258c6db8b218864853c095549f287b5ec24b57"}
May 26 00:11:12.192622 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.192183    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-f89745d5-pvclv" event={"ID":"61fa891c-e05b-45c5-b657-cc7a931bf435","Type":"ContainerStarted","Data":"1f5f9974d10215b12905871018ffc18b24b9c03105d148c79d186e402e0e7f44"}
May 26 00:11:12.213705 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.213664    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-f89745d5-pvclv" podStartSLOduration=1.743941692 podStartE2EDuration="4.213650931s" podCreationTimestamp="2026-05-26 00:11:08 +0000 UTC" firstStartedPulling="2026-05-26 00:11:09.285430572 +0000 UTC m=+210.349401438" lastFinishedPulling="2026-05-26 00:11:11.755139794 +0000 UTC m=+212.819110677" observedRunningTime="2026-05-26 00:11:12.211677781 +0000 UTC m=+213.275648668" watchObservedRunningTime="2026-05-26 00:11:12.213650931 +0000 UTC m=+213.277621819"
May 26 00:11:12.784171 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.784129    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-99cc5f865-kr5vq"]
May 26 00:11:12.792681 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.792654    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.796622 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.796599    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-99cc5f865-kr5vq"]
May 26 00:11:12.895386 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.895348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-config\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.895540 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.895394    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-oauth-config\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.895540 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.895452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-oauth-serving-cert\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.895540 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.895520    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-service-ca\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.895636 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.895555    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkwdr\" (UniqueName: \"kubernetes.io/projected/6567a1be-87ab-4d31-9e2e-fff95eccd534-kube-api-access-vkwdr\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.895636 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.895608    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-serving-cert\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.895701 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.895643    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-trusted-ca-bundle\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.996956 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.996913    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-oauth-serving-cert\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.996956 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.996963    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-service-ca\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.997228 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.996997    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwdr\" (UniqueName: \"kubernetes.io/projected/6567a1be-87ab-4d31-9e2e-fff95eccd534-kube-api-access-vkwdr\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.997228 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.997073    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-serving-cert\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.997228 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.997115    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-trusted-ca-bundle\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.997228 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.997142    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-config\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.997228 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.997183    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-oauth-config\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.997806 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.997777    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-oauth-serving-cert\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.998102 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.997777    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-service-ca\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.998102 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.997908    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-config\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.998102 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.998054    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-trusted-ca-bundle\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.999674 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.999643    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-serving-cert\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:12.999766 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:12.999648    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-oauth-config\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:13.004450 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:13.004432    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkwdr\" (UniqueName: \"kubernetes.io/projected/6567a1be-87ab-4d31-9e2e-fff95eccd534-kube-api-access-vkwdr\") pod \"console-99cc5f865-kr5vq\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") " pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:13.103602 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:13.103501    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:13.228699 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:13.228675    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-99cc5f865-kr5vq"]
May 26 00:11:13.231444 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:11:13.231419    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6567a1be_87ab_4d31_9e2e_fff95eccd534.slice/crio-0a88d7ce0203606e3884849385bd4e665942bae0ed3fbef62118a710a8432545 WatchSource:0}: Error finding container 0a88d7ce0203606e3884849385bd4e665942bae0ed3fbef62118a710a8432545: Status 404 returned error can't find the container with id 0a88d7ce0203606e3884849385bd4e665942bae0ed3fbef62118a710a8432545
May 26 00:11:14.199527 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:14.199488    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99cc5f865-kr5vq" event={"ID":"6567a1be-87ab-4d31-9e2e-fff95eccd534","Type":"ContainerStarted","Data":"1a06953311256bd6527bb97fb6bf6ee9b28be694c310155aea9137ab82992eae"}
May 26 00:11:14.199527 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:14.199531    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99cc5f865-kr5vq" event={"ID":"6567a1be-87ab-4d31-9e2e-fff95eccd534","Type":"ContainerStarted","Data":"0a88d7ce0203606e3884849385bd4e665942bae0ed3fbef62118a710a8432545"}
May 26 00:11:14.217238 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:14.217197    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-99cc5f865-kr5vq" podStartSLOduration=2.217183576 podStartE2EDuration="2.217183576s" podCreationTimestamp="2026-05-26 00:11:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:11:14.215935086 +0000 UTC m=+215.279905974" watchObservedRunningTime="2026-05-26 00:11:14.217183576 +0000 UTC m=+215.281154463"
May 26 00:11:23.104622 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:23.104591    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:23.104622 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:23.104627    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:23.109206 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:23.109184    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:23.230117 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:23.230091    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:11:23.270376 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:23.270349    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c99f4b488-9vwc9"]
May 26 00:11:48.293855 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.293791    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6c99f4b488-9vwc9" podUID="f2233c59-9769-4c74-a275-a58658fa5bfb" containerName="console" containerID="cri-o://f423f64a8e4e708ef4e67556e6498f495ee1bc3ae3985ce1b8df3a6365011deb" gracePeriod=15
May 26 00:11:48.542031 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.541991    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c99f4b488-9vwc9_f2233c59-9769-4c74-a275-a58658fa5bfb/console/0.log"
May 26 00:11:48.542150 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.542077    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:11:48.616394 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.616299    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-oauth-serving-cert\") pod \"f2233c59-9769-4c74-a275-a58658fa5bfb\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") "
May 26 00:11:48.616394 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.616349    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2233c59-9769-4c74-a275-a58658fa5bfb-console-serving-cert\") pod \"f2233c59-9769-4c74-a275-a58658fa5bfb\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") "
May 26 00:11:48.616394 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.616373    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2233c59-9769-4c74-a275-a58658fa5bfb-console-oauth-config\") pod \"f2233c59-9769-4c74-a275-a58658fa5bfb\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") "
May 26 00:11:48.616661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.616402    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-service-ca\") pod \"f2233c59-9769-4c74-a275-a58658fa5bfb\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") "
May 26 00:11:48.616661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.616436    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvq66\" (UniqueName: \"kubernetes.io/projected/f2233c59-9769-4c74-a275-a58658fa5bfb-kube-api-access-dvq66\") pod \"f2233c59-9769-4c74-a275-a58658fa5bfb\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") "
May 26 00:11:48.616661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.616462    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-trusted-ca-bundle\") pod \"f2233c59-9769-4c74-a275-a58658fa5bfb\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") "
May 26 00:11:48.616661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.616537    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-console-config\") pod \"f2233c59-9769-4c74-a275-a58658fa5bfb\" (UID: \"f2233c59-9769-4c74-a275-a58658fa5bfb\") "
May 26 00:11:48.616866 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.616793    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f2233c59-9769-4c74-a275-a58658fa5bfb" (UID: "f2233c59-9769-4c74-a275-a58658fa5bfb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:11:48.616931 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.616852    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-service-ca" (OuterVolumeSpecName: "service-ca") pod "f2233c59-9769-4c74-a275-a58658fa5bfb" (UID: "f2233c59-9769-4c74-a275-a58658fa5bfb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:11:48.616931 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.616880    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f2233c59-9769-4c74-a275-a58658fa5bfb" (UID: "f2233c59-9769-4c74-a275-a58658fa5bfb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:11:48.617108 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.617088    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-console-config" (OuterVolumeSpecName: "console-config") pod "f2233c59-9769-4c74-a275-a58658fa5bfb" (UID: "f2233c59-9769-4c74-a275-a58658fa5bfb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:11:48.618618 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.618591    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2233c59-9769-4c74-a275-a58658fa5bfb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f2233c59-9769-4c74-a275-a58658fa5bfb" (UID: "f2233c59-9769-4c74-a275-a58658fa5bfb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:48.618744 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.618618    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2233c59-9769-4c74-a275-a58658fa5bfb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f2233c59-9769-4c74-a275-a58658fa5bfb" (UID: "f2233c59-9769-4c74-a275-a58658fa5bfb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:11:48.618744 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.618734    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2233c59-9769-4c74-a275-a58658fa5bfb-kube-api-access-dvq66" (OuterVolumeSpecName: "kube-api-access-dvq66") pod "f2233c59-9769-4c74-a275-a58658fa5bfb" (UID: "f2233c59-9769-4c74-a275-a58658fa5bfb"). InnerVolumeSpecName "kube-api-access-dvq66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:11:48.717973 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.717935    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvq66\" (UniqueName: \"kubernetes.io/projected/f2233c59-9769-4c74-a275-a58658fa5bfb-kube-api-access-dvq66\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:48.717973 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.717966    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-trusted-ca-bundle\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:48.717973 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.717977    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-console-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:48.717973 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.717986    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-oauth-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:48.718287 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.717995    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2233c59-9769-4c74-a275-a58658fa5bfb-console-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:48.718287 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.718005    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2233c59-9769-4c74-a275-a58658fa5bfb-console-oauth-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:48.718287 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:48.718036    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2233c59-9769-4c74-a275-a58658fa5bfb-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:11:49.305556 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:49.305530    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c99f4b488-9vwc9_f2233c59-9769-4c74-a275-a58658fa5bfb/console/0.log"
May 26 00:11:49.306061 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:49.305569    2576 generic.go:358] "Generic (PLEG): container finished" podID="f2233c59-9769-4c74-a275-a58658fa5bfb" containerID="f423f64a8e4e708ef4e67556e6498f495ee1bc3ae3985ce1b8df3a6365011deb" exitCode=2
May 26 00:11:49.306061 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:49.305618    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c99f4b488-9vwc9" event={"ID":"f2233c59-9769-4c74-a275-a58658fa5bfb","Type":"ContainerDied","Data":"f423f64a8e4e708ef4e67556e6498f495ee1bc3ae3985ce1b8df3a6365011deb"}
May 26 00:11:49.306061 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:49.305641    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c99f4b488-9vwc9" event={"ID":"f2233c59-9769-4c74-a275-a58658fa5bfb","Type":"ContainerDied","Data":"9ba54636c33ae8ab6566138956d7f8f08a3f83dd77121fe936f1e8a66640adee"}
May 26 00:11:49.306061 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:49.305655    2576 scope.go:117] "RemoveContainer" containerID="f423f64a8e4e708ef4e67556e6498f495ee1bc3ae3985ce1b8df3a6365011deb"
May 26 00:11:49.306061 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:49.305654    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c99f4b488-9vwc9"
May 26 00:11:49.314170 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:49.314149    2576 scope.go:117] "RemoveContainer" containerID="f423f64a8e4e708ef4e67556e6498f495ee1bc3ae3985ce1b8df3a6365011deb"
May 26 00:11:49.314412 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:11:49.314394    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f423f64a8e4e708ef4e67556e6498f495ee1bc3ae3985ce1b8df3a6365011deb\": container with ID starting with f423f64a8e4e708ef4e67556e6498f495ee1bc3ae3985ce1b8df3a6365011deb not found: ID does not exist" containerID="f423f64a8e4e708ef4e67556e6498f495ee1bc3ae3985ce1b8df3a6365011deb"
May 26 00:11:49.314471 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:49.314423    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f423f64a8e4e708ef4e67556e6498f495ee1bc3ae3985ce1b8df3a6365011deb"} err="failed to get container status \"f423f64a8e4e708ef4e67556e6498f495ee1bc3ae3985ce1b8df3a6365011deb\": rpc error: code = NotFound desc = could not find container \"f423f64a8e4e708ef4e67556e6498f495ee1bc3ae3985ce1b8df3a6365011deb\": container with ID starting with f423f64a8e4e708ef4e67556e6498f495ee1bc3ae3985ce1b8df3a6365011deb not found: ID does not exist"
May 26 00:11:49.326120 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:49.326097    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c99f4b488-9vwc9"]
May 26 00:11:49.329411 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:49.329391    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c99f4b488-9vwc9"]
May 26 00:11:49.491058 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:11:49.490993    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2233c59-9769-4c74-a275-a58658fa5bfb" path="/var/lib/kubelet/pods/f2233c59-9769-4c74-a275-a58658fa5bfb/volumes"
May 26 00:12:27.128091 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.128056    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dc4f7bc79-dh7kv"]
May 26 00:12:27.128674 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.128501    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2233c59-9769-4c74-a275-a58658fa5bfb" containerName="console"
May 26 00:12:27.128674 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.128521    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2233c59-9769-4c74-a275-a58658fa5bfb" containerName="console"
May 26 00:12:27.128674 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.128637    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="f2233c59-9769-4c74-a275-a58658fa5bfb" containerName="console"
May 26 00:12:27.132206 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.132186    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.142905 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.142880    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc4f7bc79-dh7kv"]
May 26 00:12:27.251974 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.251942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-serving-cert\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.252214 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.252170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-trusted-ca-bundle\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.252393 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.252357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-service-ca\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.252459 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.252436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-oauth-serving-cert\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.252633 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.252600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-oauth-config\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.252690 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.252649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59sk7\" (UniqueName: \"kubernetes.io/projected/2d9693f7-4f82-4b94-86c5-8256b27cb44f-kube-api-access-59sk7\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.252738 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.252688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-config\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.354201 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.354157    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-oauth-serving-cert\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.354385 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.354215    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-oauth-config\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.354385 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.354233    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-59sk7\" (UniqueName: \"kubernetes.io/projected/2d9693f7-4f82-4b94-86c5-8256b27cb44f-kube-api-access-59sk7\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.354385 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.354252    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-config\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.354385 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.354310    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-serving-cert\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.354385 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.354326    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-trusted-ca-bundle\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.354680 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.354494    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-service-ca\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.354980 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.354952    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-oauth-serving-cert\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.355180 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.355159    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-trusted-ca-bundle\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.355235 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.355162    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-service-ca\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.355322 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.355300    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-config\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.356999 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.356982    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-serving-cert\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.357067 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.357032    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-oauth-config\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.362987 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.362967    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59sk7\" (UniqueName: \"kubernetes.io/projected/2d9693f7-4f82-4b94-86c5-8256b27cb44f-kube-api-access-59sk7\") pod \"console-7dc4f7bc79-dh7kv\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") " pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.441946 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.441855    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:27.570630 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:27.570513    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc4f7bc79-dh7kv"]
May 26 00:12:27.573343 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:12:27.573307    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d9693f7_4f82_4b94_86c5_8256b27cb44f.slice/crio-44ca6e2906dfcf28c933bb55c8c8cbf9fca3b4eea487e0e39cc15a4d1a964265 WatchSource:0}: Error finding container 44ca6e2906dfcf28c933bb55c8c8cbf9fca3b4eea487e0e39cc15a4d1a964265: Status 404 returned error can't find the container with id 44ca6e2906dfcf28c933bb55c8c8cbf9fca3b4eea487e0e39cc15a4d1a964265
May 26 00:12:28.418876 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:28.418832    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc4f7bc79-dh7kv" event={"ID":"2d9693f7-4f82-4b94-86c5-8256b27cb44f","Type":"ContainerStarted","Data":"78aef036068244190dde84f4c76c491a84383f03e1854ff42d2e27de3c6134ac"}
May 26 00:12:28.418876 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:28.418879    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc4f7bc79-dh7kv" event={"ID":"2d9693f7-4f82-4b94-86c5-8256b27cb44f","Type":"ContainerStarted","Data":"44ca6e2906dfcf28c933bb55c8c8cbf9fca3b4eea487e0e39cc15a4d1a964265"}
May 26 00:12:28.437123 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:28.437076    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7dc4f7bc79-dh7kv" podStartSLOduration=1.437062258 podStartE2EDuration="1.437062258s" podCreationTimestamp="2026-05-26 00:12:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:12:28.435309539 +0000 UTC m=+289.499280429" watchObservedRunningTime="2026-05-26 00:12:28.437062258 +0000 UTC m=+289.501033146"
May 26 00:12:37.442247 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:37.442204    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:37.442247 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:37.442253    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:37.446947 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:37.446927    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:37.453528 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:37.453506    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:12:37.508319 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:37.508276    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-99cc5f865-kr5vq"]
May 26 00:12:39.349356 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:39.349327    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:12:39.351312 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:39.351290    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:12:39.357810 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:12:39.357784    2576 kubelet.go:1628] "Image garbage collection succeeded"
May 26 00:13:02.532154 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.532093    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-99cc5f865-kr5vq" podUID="6567a1be-87ab-4d31-9e2e-fff95eccd534" containerName="console" containerID="cri-o://1a06953311256bd6527bb97fb6bf6ee9b28be694c310155aea9137ab82992eae" gracePeriod=15
May 26 00:13:02.771168 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.771148    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-99cc5f865-kr5vq_6567a1be-87ab-4d31-9e2e-fff95eccd534/console/0.log"
May 26 00:13:02.771274 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.771208    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:13:02.868265 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.868170    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-trusted-ca-bundle\") pod \"6567a1be-87ab-4d31-9e2e-fff95eccd534\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") "
May 26 00:13:02.868265 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.868253    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-serving-cert\") pod \"6567a1be-87ab-4d31-9e2e-fff95eccd534\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") "
May 26 00:13:02.868517 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.868287    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-oauth-serving-cert\") pod \"6567a1be-87ab-4d31-9e2e-fff95eccd534\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") "
May 26 00:13:02.868517 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.868317    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-config\") pod \"6567a1be-87ab-4d31-9e2e-fff95eccd534\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") "
May 26 00:13:02.868517 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.868355    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkwdr\" (UniqueName: \"kubernetes.io/projected/6567a1be-87ab-4d31-9e2e-fff95eccd534-kube-api-access-vkwdr\") pod \"6567a1be-87ab-4d31-9e2e-fff95eccd534\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") "
May 26 00:13:02.868517 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.868389    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-oauth-config\") pod \"6567a1be-87ab-4d31-9e2e-fff95eccd534\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") "
May 26 00:13:02.868517 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.868406    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-service-ca\") pod \"6567a1be-87ab-4d31-9e2e-fff95eccd534\" (UID: \"6567a1be-87ab-4d31-9e2e-fff95eccd534\") "
May 26 00:13:02.868758 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.868652    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6567a1be-87ab-4d31-9e2e-fff95eccd534" (UID: "6567a1be-87ab-4d31-9e2e-fff95eccd534"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:13:02.868758 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.868712    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-config" (OuterVolumeSpecName: "console-config") pod "6567a1be-87ab-4d31-9e2e-fff95eccd534" (UID: "6567a1be-87ab-4d31-9e2e-fff95eccd534"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:13:02.868879 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.868765    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6567a1be-87ab-4d31-9e2e-fff95eccd534" (UID: "6567a1be-87ab-4d31-9e2e-fff95eccd534"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:13:02.868923 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.868895    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-service-ca" (OuterVolumeSpecName: "service-ca") pod "6567a1be-87ab-4d31-9e2e-fff95eccd534" (UID: "6567a1be-87ab-4d31-9e2e-fff95eccd534"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:13:02.870685 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.870654    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6567a1be-87ab-4d31-9e2e-fff95eccd534" (UID: "6567a1be-87ab-4d31-9e2e-fff95eccd534"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:13:02.870789 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.870681    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6567a1be-87ab-4d31-9e2e-fff95eccd534" (UID: "6567a1be-87ab-4d31-9e2e-fff95eccd534"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:13:02.870789 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.870747    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6567a1be-87ab-4d31-9e2e-fff95eccd534-kube-api-access-vkwdr" (OuterVolumeSpecName: "kube-api-access-vkwdr") pod "6567a1be-87ab-4d31-9e2e-fff95eccd534" (UID: "6567a1be-87ab-4d31-9e2e-fff95eccd534"). InnerVolumeSpecName "kube-api-access-vkwdr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:13:02.969744 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.969708    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:13:02.969915 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.969760    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkwdr\" (UniqueName: \"kubernetes.io/projected/6567a1be-87ab-4d31-9e2e-fff95eccd534-kube-api-access-vkwdr\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:13:02.969915 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.969770    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-oauth-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:13:02.969915 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.969779    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:13:02.969915 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.969789    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-trusted-ca-bundle\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:13:02.969915 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.969797    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6567a1be-87ab-4d31-9e2e-fff95eccd534-console-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:13:02.969915 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:02.969805    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6567a1be-87ab-4d31-9e2e-fff95eccd534-oauth-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:13:03.524857 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:03.524833    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-99cc5f865-kr5vq_6567a1be-87ab-4d31-9e2e-fff95eccd534/console/0.log"
May 26 00:13:03.524996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:03.524871    2576 generic.go:358] "Generic (PLEG): container finished" podID="6567a1be-87ab-4d31-9e2e-fff95eccd534" containerID="1a06953311256bd6527bb97fb6bf6ee9b28be694c310155aea9137ab82992eae" exitCode=2
May 26 00:13:03.524996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:03.524933    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99cc5f865-kr5vq" event={"ID":"6567a1be-87ab-4d31-9e2e-fff95eccd534","Type":"ContainerDied","Data":"1a06953311256bd6527bb97fb6bf6ee9b28be694c310155aea9137ab82992eae"}
May 26 00:13:03.524996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:03.524937    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99cc5f865-kr5vq"
May 26 00:13:03.524996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:03.524959    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99cc5f865-kr5vq" event={"ID":"6567a1be-87ab-4d31-9e2e-fff95eccd534","Type":"ContainerDied","Data":"0a88d7ce0203606e3884849385bd4e665942bae0ed3fbef62118a710a8432545"}
May 26 00:13:03.524996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:03.524972    2576 scope.go:117] "RemoveContainer" containerID="1a06953311256bd6527bb97fb6bf6ee9b28be694c310155aea9137ab82992eae"
May 26 00:13:03.534127 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:03.534106    2576 scope.go:117] "RemoveContainer" containerID="1a06953311256bd6527bb97fb6bf6ee9b28be694c310155aea9137ab82992eae"
May 26 00:13:03.534438 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:13:03.534412    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a06953311256bd6527bb97fb6bf6ee9b28be694c310155aea9137ab82992eae\": container with ID starting with 1a06953311256bd6527bb97fb6bf6ee9b28be694c310155aea9137ab82992eae not found: ID does not exist" containerID="1a06953311256bd6527bb97fb6bf6ee9b28be694c310155aea9137ab82992eae"
May 26 00:13:03.534495 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:03.534437    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a06953311256bd6527bb97fb6bf6ee9b28be694c310155aea9137ab82992eae"} err="failed to get container status \"1a06953311256bd6527bb97fb6bf6ee9b28be694c310155aea9137ab82992eae\": rpc error: code = NotFound desc = could not find container \"1a06953311256bd6527bb97fb6bf6ee9b28be694c310155aea9137ab82992eae\": container with ID starting with 1a06953311256bd6527bb97fb6bf6ee9b28be694c310155aea9137ab82992eae not found: ID does not exist"
May 26 00:13:03.543397 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:03.543374    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-99cc5f865-kr5vq"]
May 26 00:13:03.546630 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:03.546605    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-99cc5f865-kr5vq"]
May 26 00:13:05.490706 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:13:05.490673    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6567a1be-87ab-4d31-9e2e-fff95eccd534" path="/var/lib/kubelet/pods/6567a1be-87ab-4d31-9e2e-fff95eccd534/volumes"
May 26 00:14:20.810343 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:20.810307    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"]
May 26 00:14:20.810775 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:20.810626    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6567a1be-87ab-4d31-9e2e-fff95eccd534" containerName="console"
May 26 00:14:20.810775 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:20.810638    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6567a1be-87ab-4d31-9e2e-fff95eccd534" containerName="console"
May 26 00:14:20.810775 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:20.810699    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6567a1be-87ab-4d31-9e2e-fff95eccd534" containerName="console"
May 26 00:14:20.813455 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:20.813440    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"
May 26 00:14:20.815801 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:20.815777    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 26 00:14:20.815920 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:20.815884    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 26 00:14:20.816973 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:20.816953    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-dshzc\""
May 26 00:14:20.817366 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:20.817344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99rjw\" (UniqueName: \"kubernetes.io/projected/c6746f5d-ba6e-47e8-be57-29fff08ea846-kube-api-access-99rjw\") pod \"feast-operator-controller-manager-5c4fdc7476-5645r\" (UID: \"c6746f5d-ba6e-47e8-be57-29fff08ea846\") " pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"
May 26 00:14:20.820407 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:20.820194    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"]
May 26 00:14:20.918481 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:20.918445    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99rjw\" (UniqueName: \"kubernetes.io/projected/c6746f5d-ba6e-47e8-be57-29fff08ea846-kube-api-access-99rjw\") pod \"feast-operator-controller-manager-5c4fdc7476-5645r\" (UID: \"c6746f5d-ba6e-47e8-be57-29fff08ea846\") " pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"
May 26 00:14:20.927149 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:20.927113    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99rjw\" (UniqueName: \"kubernetes.io/projected/c6746f5d-ba6e-47e8-be57-29fff08ea846-kube-api-access-99rjw\") pod \"feast-operator-controller-manager-5c4fdc7476-5645r\" (UID: \"c6746f5d-ba6e-47e8-be57-29fff08ea846\") " pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"
May 26 00:14:21.124135 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:21.124048    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"
May 26 00:14:21.249552 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:21.249514    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"]
May 26 00:14:21.252786 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:14:21.252753    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6746f5d_ba6e_47e8_be57_29fff08ea846.slice/crio-103e08af717ddfab467386e77dc1cc26f541c155d627a0a37c7fd3c1acfd9fdc WatchSource:0}: Error finding container 103e08af717ddfab467386e77dc1cc26f541c155d627a0a37c7fd3c1acfd9fdc: Status 404 returned error can't find the container with id 103e08af717ddfab467386e77dc1cc26f541c155d627a0a37c7fd3c1acfd9fdc
May 26 00:14:21.254526 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:21.254510    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 00:14:21.755469 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:21.755424    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r" event={"ID":"c6746f5d-ba6e-47e8-be57-29fff08ea846","Type":"ContainerStarted","Data":"103e08af717ddfab467386e77dc1cc26f541c155d627a0a37c7fd3c1acfd9fdc"}
May 26 00:14:24.773848 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:24.773808    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r" event={"ID":"c6746f5d-ba6e-47e8-be57-29fff08ea846","Type":"ContainerStarted","Data":"b726f6dfbe359902372da22ef86545373d886bf240a9d4868194cd3331cfbd4f"}
May 26 00:14:24.774229 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:24.774049    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"
May 26 00:14:24.789164 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:24.789100    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r" podStartSLOduration=1.40059863 podStartE2EDuration="4.789084373s" podCreationTimestamp="2026-05-26 00:14:20 +0000 UTC" firstStartedPulling="2026-05-26 00:14:21.254633367 +0000 UTC m=+402.318604232" lastFinishedPulling="2026-05-26 00:14:24.643119107 +0000 UTC m=+405.707089975" observedRunningTime="2026-05-26 00:14:24.787720707 +0000 UTC m=+405.851691594" watchObservedRunningTime="2026-05-26 00:14:24.789084373 +0000 UTC m=+405.853055301"
May 26 00:14:35.779242 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:14:35.779211    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"
May 26 00:16:13.847700 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.847663    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-798f444dc6-82j2m"]
May 26 00:16:13.849960 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.849938    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.861645 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.861620    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798f444dc6-82j2m"]
May 26 00:16:13.881976 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.881946    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20c6fcc2-fa43-408c-a369-9e9a8225f19a-console-oauth-config\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.882140 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.881991    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20c6fcc2-fa43-408c-a369-9e9a8225f19a-service-ca\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.882140 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.882036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20c6fcc2-fa43-408c-a369-9e9a8225f19a-oauth-serving-cert\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.882140 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.882075    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20c6fcc2-fa43-408c-a369-9e9a8225f19a-trusted-ca-bundle\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.882140 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.882099    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20c6fcc2-fa43-408c-a369-9e9a8225f19a-console-serving-cert\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.882140 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.882113    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkbtg\" (UniqueName: \"kubernetes.io/projected/20c6fcc2-fa43-408c-a369-9e9a8225f19a-kube-api-access-nkbtg\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.882308 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.882149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20c6fcc2-fa43-408c-a369-9e9a8225f19a-console-config\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.983389 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.983351    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20c6fcc2-fa43-408c-a369-9e9a8225f19a-console-serving-cert\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.983389 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.983387    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkbtg\" (UniqueName: \"kubernetes.io/projected/20c6fcc2-fa43-408c-a369-9e9a8225f19a-kube-api-access-nkbtg\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.983642 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.983412    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20c6fcc2-fa43-408c-a369-9e9a8225f19a-console-config\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.983642 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.983451    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20c6fcc2-fa43-408c-a369-9e9a8225f19a-console-oauth-config\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.983642 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.983477    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20c6fcc2-fa43-408c-a369-9e9a8225f19a-service-ca\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.983642 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.983493    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20c6fcc2-fa43-408c-a369-9e9a8225f19a-oauth-serving-cert\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.983642 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.983512    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20c6fcc2-fa43-408c-a369-9e9a8225f19a-trusted-ca-bundle\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.984267 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.984229    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/20c6fcc2-fa43-408c-a369-9e9a8225f19a-service-ca\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.984407 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.984385    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/20c6fcc2-fa43-408c-a369-9e9a8225f19a-oauth-serving-cert\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.984507 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.984490    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20c6fcc2-fa43-408c-a369-9e9a8225f19a-trusted-ca-bundle\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.984593 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.984571    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/20c6fcc2-fa43-408c-a369-9e9a8225f19a-console-config\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.985907 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.985881    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/20c6fcc2-fa43-408c-a369-9e9a8225f19a-console-oauth-config\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.986062 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.986043    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/20c6fcc2-fa43-408c-a369-9e9a8225f19a-console-serving-cert\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:13.991183 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:13.991163    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkbtg\" (UniqueName: \"kubernetes.io/projected/20c6fcc2-fa43-408c-a369-9e9a8225f19a-kube-api-access-nkbtg\") pod \"console-798f444dc6-82j2m\" (UID: \"20c6fcc2-fa43-408c-a369-9e9a8225f19a\") " pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:14.161308 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:14.161217    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:14.288566 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:14.288389    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-798f444dc6-82j2m"]
May 26 00:16:14.291359 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:16:14.291335    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c6fcc2_fa43_408c_a369_9e9a8225f19a.slice/crio-9325aa9213b97d43a458994b401e0afa4311010174d842b24ee1b1dd83c716d5 WatchSource:0}: Error finding container 9325aa9213b97d43a458994b401e0afa4311010174d842b24ee1b1dd83c716d5: Status 404 returned error can't find the container with id 9325aa9213b97d43a458994b401e0afa4311010174d842b24ee1b1dd83c716d5
May 26 00:16:15.100239 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:15.100200    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798f444dc6-82j2m" event={"ID":"20c6fcc2-fa43-408c-a369-9e9a8225f19a","Type":"ContainerStarted","Data":"17c933070c0ea43a54ce06cb29fc35999eb2eb127ec359ba16e8cc2f97c5062f"}
May 26 00:16:15.100239 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:15.100239    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-798f444dc6-82j2m" event={"ID":"20c6fcc2-fa43-408c-a369-9e9a8225f19a","Type":"ContainerStarted","Data":"9325aa9213b97d43a458994b401e0afa4311010174d842b24ee1b1dd83c716d5"}
May 26 00:16:15.119242 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:15.119190    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-798f444dc6-82j2m" podStartSLOduration=2.1191762 podStartE2EDuration="2.1191762s" podCreationTimestamp="2026-05-26 00:16:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:16:15.118723769 +0000 UTC m=+516.182694657" watchObservedRunningTime="2026-05-26 00:16:15.1191762 +0000 UTC m=+516.183147087"
May 26 00:16:24.162305 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:24.162263    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:24.162305 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:24.162309    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:24.167139 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:24.167116    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:25.130980 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:25.130946    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-798f444dc6-82j2m"
May 26 00:16:25.174372 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:25.174342    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc4f7bc79-dh7kv"]
May 26 00:16:50.201863 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.201824    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7dc4f7bc79-dh7kv" podUID="2d9693f7-4f82-4b94-86c5-8256b27cb44f" containerName="console" containerID="cri-o://78aef036068244190dde84f4c76c491a84383f03e1854ff42d2e27de3c6134ac" gracePeriod=15
May 26 00:16:50.434358 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.434338    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dc4f7bc79-dh7kv_2d9693f7-4f82-4b94-86c5-8256b27cb44f/console/0.log"
May 26 00:16:50.434474 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.434400    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:16:50.504838 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.504751    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-trusted-ca-bundle\") pod \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") "
May 26 00:16:50.504838 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.504802    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-service-ca\") pod \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") "
May 26 00:16:50.505061 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.504850    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-oauth-serving-cert\") pod \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") "
May 26 00:16:50.505061 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.504879    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-config\") pod \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") "
May 26 00:16:50.505061 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.505045    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-serving-cert\") pod \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") "
May 26 00:16:50.505214 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.505093    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59sk7\" (UniqueName: \"kubernetes.io/projected/2d9693f7-4f82-4b94-86c5-8256b27cb44f-kube-api-access-59sk7\") pod \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") "
May 26 00:16:50.505214 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.505126    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-oauth-config\") pod \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\" (UID: \"2d9693f7-4f82-4b94-86c5-8256b27cb44f\") "
May 26 00:16:50.505318 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.505275    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2d9693f7-4f82-4b94-86c5-8256b27cb44f" (UID: "2d9693f7-4f82-4b94-86c5-8256b27cb44f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:16:50.505318 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.505299    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-config" (OuterVolumeSpecName: "console-config") pod "2d9693f7-4f82-4b94-86c5-8256b27cb44f" (UID: "2d9693f7-4f82-4b94-86c5-8256b27cb44f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:16:50.505416 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.505317    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-service-ca" (OuterVolumeSpecName: "service-ca") pod "2d9693f7-4f82-4b94-86c5-8256b27cb44f" (UID: "2d9693f7-4f82-4b94-86c5-8256b27cb44f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:16:50.505416 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.505327    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2d9693f7-4f82-4b94-86c5-8256b27cb44f" (UID: "2d9693f7-4f82-4b94-86c5-8256b27cb44f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:16:50.505504 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.505436    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-oauth-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:16:50.505504 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.505459    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:16:50.505504 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.505476    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-trusted-ca-bundle\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:16:50.505504 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.505492    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d9693f7-4f82-4b94-86c5-8256b27cb44f-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:16:50.507271 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.507245    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2d9693f7-4f82-4b94-86c5-8256b27cb44f" (UID: "2d9693f7-4f82-4b94-86c5-8256b27cb44f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:16:50.507357 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.507334    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2d9693f7-4f82-4b94-86c5-8256b27cb44f" (UID: "2d9693f7-4f82-4b94-86c5-8256b27cb44f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:16:50.507396 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.507383    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d9693f7-4f82-4b94-86c5-8256b27cb44f-kube-api-access-59sk7" (OuterVolumeSpecName: "kube-api-access-59sk7") pod "2d9693f7-4f82-4b94-86c5-8256b27cb44f" (UID: "2d9693f7-4f82-4b94-86c5-8256b27cb44f"). InnerVolumeSpecName "kube-api-access-59sk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:16:50.606713 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.606678    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:16:50.606713 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.606707    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59sk7\" (UniqueName: \"kubernetes.io/projected/2d9693f7-4f82-4b94-86c5-8256b27cb44f-kube-api-access-59sk7\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:16:50.606713 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:50.606716    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d9693f7-4f82-4b94-86c5-8256b27cb44f-console-oauth-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:16:51.202417 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:51.202390    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dc4f7bc79-dh7kv_2d9693f7-4f82-4b94-86c5-8256b27cb44f/console/0.log"
May 26 00:16:51.202797 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:51.202429    2576 generic.go:358] "Generic (PLEG): container finished" podID="2d9693f7-4f82-4b94-86c5-8256b27cb44f" containerID="78aef036068244190dde84f4c76c491a84383f03e1854ff42d2e27de3c6134ac" exitCode=2
May 26 00:16:51.202797 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:51.202520    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc4f7bc79-dh7kv"
May 26 00:16:51.202797 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:51.202520    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc4f7bc79-dh7kv" event={"ID":"2d9693f7-4f82-4b94-86c5-8256b27cb44f","Type":"ContainerDied","Data":"78aef036068244190dde84f4c76c491a84383f03e1854ff42d2e27de3c6134ac"}
May 26 00:16:51.202797 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:51.202619    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc4f7bc79-dh7kv" event={"ID":"2d9693f7-4f82-4b94-86c5-8256b27cb44f","Type":"ContainerDied","Data":"44ca6e2906dfcf28c933bb55c8c8cbf9fca3b4eea487e0e39cc15a4d1a964265"}
May 26 00:16:51.202797 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:51.202634    2576 scope.go:117] "RemoveContainer" containerID="78aef036068244190dde84f4c76c491a84383f03e1854ff42d2e27de3c6134ac"
May 26 00:16:51.211578 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:51.211561    2576 scope.go:117] "RemoveContainer" containerID="78aef036068244190dde84f4c76c491a84383f03e1854ff42d2e27de3c6134ac"
May 26 00:16:51.211832 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:16:51.211811    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78aef036068244190dde84f4c76c491a84383f03e1854ff42d2e27de3c6134ac\": container with ID starting with 78aef036068244190dde84f4c76c491a84383f03e1854ff42d2e27de3c6134ac not found: ID does not exist" containerID="78aef036068244190dde84f4c76c491a84383f03e1854ff42d2e27de3c6134ac"
May 26 00:16:51.211887 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:51.211841    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78aef036068244190dde84f4c76c491a84383f03e1854ff42d2e27de3c6134ac"} err="failed to get container status \"78aef036068244190dde84f4c76c491a84383f03e1854ff42d2e27de3c6134ac\": rpc error: code = NotFound desc = could not find container \"78aef036068244190dde84f4c76c491a84383f03e1854ff42d2e27de3c6134ac\": container with ID starting with 78aef036068244190dde84f4c76c491a84383f03e1854ff42d2e27de3c6134ac not found: ID does not exist"
May 26 00:16:51.222844 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:51.222815    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc4f7bc79-dh7kv"]
May 26 00:16:51.226339 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:51.226317    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dc4f7bc79-dh7kv"]
May 26 00:16:51.490684 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:16:51.490607    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d9693f7-4f82-4b94-86c5-8256b27cb44f" path="/var/lib/kubelet/pods/2d9693f7-4f82-4b94-86c5-8256b27cb44f/volumes"
May 26 00:17:39.373981 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:17:39.373950    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:17:39.374508 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:17:39.374313    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:20:23.872666 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:23.872631    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-x6dcz"]
May 26 00:20:23.873154 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:23.872957    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d9693f7-4f82-4b94-86c5-8256b27cb44f" containerName="console"
May 26 00:20:23.873154 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:23.872968    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d9693f7-4f82-4b94-86c5-8256b27cb44f" containerName="console"
May 26 00:20:23.873154 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:23.873042    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d9693f7-4f82-4b94-86c5-8256b27cb44f" containerName="console"
May 26 00:20:23.876067 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:23.876043    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-x6dcz"
May 26 00:20:23.878534 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:23.878508    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-5w5cs\""
May 26 00:20:23.878681 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:23.878532    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 00:20:23.879656 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:23.879635    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 00:20:23.885265 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:23.884950    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-x6dcz"]
May 26 00:20:23.988901 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:23.988866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb9wb\" (UniqueName: \"kubernetes.io/projected/478c56c2-8fe1-495f-be93-7b49149fb8bc-kube-api-access-zb9wb\") pod \"redis-854544c579-x6dcz\" (UID: \"478c56c2-8fe1-495f-be93-7b49149fb8bc\") " pod="test-ns-feast/redis-854544c579-x6dcz"
May 26 00:20:24.090387 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:24.090350    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zb9wb\" (UniqueName: \"kubernetes.io/projected/478c56c2-8fe1-495f-be93-7b49149fb8bc-kube-api-access-zb9wb\") pod \"redis-854544c579-x6dcz\" (UID: \"478c56c2-8fe1-495f-be93-7b49149fb8bc\") " pod="test-ns-feast/redis-854544c579-x6dcz"
May 26 00:20:24.098164 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:24.098134    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb9wb\" (UniqueName: \"kubernetes.io/projected/478c56c2-8fe1-495f-be93-7b49149fb8bc-kube-api-access-zb9wb\") pod \"redis-854544c579-x6dcz\" (UID: \"478c56c2-8fe1-495f-be93-7b49149fb8bc\") " pod="test-ns-feast/redis-854544c579-x6dcz"
May 26 00:20:24.196285 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:24.196202    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-x6dcz"
May 26 00:20:24.323889 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:24.323812    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-x6dcz"]
May 26 00:20:24.326426 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:20:24.326398    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod478c56c2_8fe1_495f_be93_7b49149fb8bc.slice/crio-ab34676a632ff24fe9bd40f8f4cb6d4f245471d57692dbe28e8f71b1a88279e1 WatchSource:0}: Error finding container ab34676a632ff24fe9bd40f8f4cb6d4f245471d57692dbe28e8f71b1a88279e1: Status 404 returned error can't find the container with id ab34676a632ff24fe9bd40f8f4cb6d4f245471d57692dbe28e8f71b1a88279e1
May 26 00:20:24.328002 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:24.327986    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 00:20:24.821158 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:24.821114    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-x6dcz" event={"ID":"478c56c2-8fe1-495f-be93-7b49149fb8bc","Type":"ContainerStarted","Data":"ab34676a632ff24fe9bd40f8f4cb6d4f245471d57692dbe28e8f71b1a88279e1"}
May 26 00:20:26.828289 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:26.828243    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-x6dcz" event={"ID":"478c56c2-8fe1-495f-be93-7b49149fb8bc","Type":"ContainerStarted","Data":"c2d86734e42346db539f86ef3af54f979e2c50ccbd3402c5b090d13d77d72cb4"}
May 26 00:20:26.842842 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:20:26.842787    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-x6dcz" podStartSLOduration=2.257641911 podStartE2EDuration="3.842772518s" podCreationTimestamp="2026-05-26 00:20:23 +0000 UTC" firstStartedPulling="2026-05-26 00:20:24.328135881 +0000 UTC m=+765.392106746" lastFinishedPulling="2026-05-26 00:20:25.913266478 +0000 UTC m=+766.977237353" observedRunningTime="2026-05-26 00:20:26.841399705 +0000 UTC m=+767.905370593" watchObservedRunningTime="2026-05-26 00:20:26.842772518 +0000 UTC m=+767.906743406"
May 26 00:21:55.698606 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:55.698573    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-x6dcz"]
May 26 00:21:55.699130 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:55.698770    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-x6dcz" podUID="478c56c2-8fe1-495f-be93-7b49149fb8bc" containerName="redis" containerID="cri-o://c2d86734e42346db539f86ef3af54f979e2c50ccbd3402c5b090d13d77d72cb4" gracePeriod=30
May 26 00:21:55.939425 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:55.939402    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-x6dcz"
May 26 00:21:55.977249 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:55.977178    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb9wb\" (UniqueName: \"kubernetes.io/projected/478c56c2-8fe1-495f-be93-7b49149fb8bc-kube-api-access-zb9wb\") pod \"478c56c2-8fe1-495f-be93-7b49149fb8bc\" (UID: \"478c56c2-8fe1-495f-be93-7b49149fb8bc\") "
May 26 00:21:55.979446 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:55.979415    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/478c56c2-8fe1-495f-be93-7b49149fb8bc-kube-api-access-zb9wb" (OuterVolumeSpecName: "kube-api-access-zb9wb") pod "478c56c2-8fe1-495f-be93-7b49149fb8bc" (UID: "478c56c2-8fe1-495f-be93-7b49149fb8bc"). InnerVolumeSpecName "kube-api-access-zb9wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:21:56.077796 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:56.077763    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb9wb\" (UniqueName: \"kubernetes.io/projected/478c56c2-8fe1-495f-be93-7b49149fb8bc-kube-api-access-zb9wb\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:21:56.087559 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:56.087528    2576 generic.go:358] "Generic (PLEG): container finished" podID="478c56c2-8fe1-495f-be93-7b49149fb8bc" containerID="c2d86734e42346db539f86ef3af54f979e2c50ccbd3402c5b090d13d77d72cb4" exitCode=0
May 26 00:21:56.087800 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:56.087586    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-x6dcz"
May 26 00:21:56.087800 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:56.087629    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-x6dcz" event={"ID":"478c56c2-8fe1-495f-be93-7b49149fb8bc","Type":"ContainerDied","Data":"c2d86734e42346db539f86ef3af54f979e2c50ccbd3402c5b090d13d77d72cb4"}
May 26 00:21:56.087800 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:56.087679    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-x6dcz" event={"ID":"478c56c2-8fe1-495f-be93-7b49149fb8bc","Type":"ContainerDied","Data":"ab34676a632ff24fe9bd40f8f4cb6d4f245471d57692dbe28e8f71b1a88279e1"}
May 26 00:21:56.087800 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:56.087704    2576 scope.go:117] "RemoveContainer" containerID="c2d86734e42346db539f86ef3af54f979e2c50ccbd3402c5b090d13d77d72cb4"
May 26 00:21:56.095918 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:56.095902    2576 scope.go:117] "RemoveContainer" containerID="c2d86734e42346db539f86ef3af54f979e2c50ccbd3402c5b090d13d77d72cb4"
May 26 00:21:56.096223 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:21:56.096204    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2d86734e42346db539f86ef3af54f979e2c50ccbd3402c5b090d13d77d72cb4\": container with ID starting with c2d86734e42346db539f86ef3af54f979e2c50ccbd3402c5b090d13d77d72cb4 not found: ID does not exist" containerID="c2d86734e42346db539f86ef3af54f979e2c50ccbd3402c5b090d13d77d72cb4"
May 26 00:21:56.096296 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:56.096230    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d86734e42346db539f86ef3af54f979e2c50ccbd3402c5b090d13d77d72cb4"} err="failed to get container status \"c2d86734e42346db539f86ef3af54f979e2c50ccbd3402c5b090d13d77d72cb4\": rpc error: code = NotFound desc = could not find container \"c2d86734e42346db539f86ef3af54f979e2c50ccbd3402c5b090d13d77d72cb4\": container with ID starting with c2d86734e42346db539f86ef3af54f979e2c50ccbd3402c5b090d13d77d72cb4 not found: ID does not exist"
May 26 00:21:56.106735 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:56.106713    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-x6dcz"]
May 26 00:21:56.108070 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:56.108047    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-x6dcz"]
May 26 00:21:57.490508 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:21:57.490475    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="478c56c2-8fe1-495f-be93-7b49149fb8bc" path="/var/lib/kubelet/pods/478c56c2-8fe1-495f-be93-7b49149fb8bc/volumes"
May 26 00:22:39.394689 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:22:39.394662    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:22:39.396025 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:22:39.395990    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:26:21.343907 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.343873    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"]
May 26 00:26:21.344460 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.344129    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r" podUID="c6746f5d-ba6e-47e8-be57-29fff08ea846" containerName="manager" containerID="cri-o://b726f6dfbe359902372da22ef86545373d886bf240a9d4868194cd3331cfbd4f" gracePeriod=10
May 26 00:26:21.618935 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.618911    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"
May 26 00:26:21.767953 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.767916    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99rjw\" (UniqueName: \"kubernetes.io/projected/c6746f5d-ba6e-47e8-be57-29fff08ea846-kube-api-access-99rjw\") pod \"c6746f5d-ba6e-47e8-be57-29fff08ea846\" (UID: \"c6746f5d-ba6e-47e8-be57-29fff08ea846\") "
May 26 00:26:21.770217 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.770191    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6746f5d-ba6e-47e8-be57-29fff08ea846-kube-api-access-99rjw" (OuterVolumeSpecName: "kube-api-access-99rjw") pod "c6746f5d-ba6e-47e8-be57-29fff08ea846" (UID: "c6746f5d-ba6e-47e8-be57-29fff08ea846"). InnerVolumeSpecName "kube-api-access-99rjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:26:21.859930 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.859849    2576 generic.go:358] "Generic (PLEG): container finished" podID="c6746f5d-ba6e-47e8-be57-29fff08ea846" containerID="b726f6dfbe359902372da22ef86545373d886bf240a9d4868194cd3331cfbd4f" exitCode=0
May 26 00:26:21.859930 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.859912    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"
May 26 00:26:21.860169 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.859933    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r" event={"ID":"c6746f5d-ba6e-47e8-be57-29fff08ea846","Type":"ContainerDied","Data":"b726f6dfbe359902372da22ef86545373d886bf240a9d4868194cd3331cfbd4f"}
May 26 00:26:21.860169 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.859969    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r" event={"ID":"c6746f5d-ba6e-47e8-be57-29fff08ea846","Type":"ContainerDied","Data":"103e08af717ddfab467386e77dc1cc26f541c155d627a0a37c7fd3c1acfd9fdc"}
May 26 00:26:21.860169 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.859984    2576 scope.go:117] "RemoveContainer" containerID="b726f6dfbe359902372da22ef86545373d886bf240a9d4868194cd3331cfbd4f"
May 26 00:26:21.868706 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.868665    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99rjw\" (UniqueName: \"kubernetes.io/projected/c6746f5d-ba6e-47e8-be57-29fff08ea846-kube-api-access-99rjw\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:26:21.869037 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.868991    2576 scope.go:117] "RemoveContainer" containerID="b726f6dfbe359902372da22ef86545373d886bf240a9d4868194cd3331cfbd4f"
May 26 00:26:21.869321 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:26:21.869303    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b726f6dfbe359902372da22ef86545373d886bf240a9d4868194cd3331cfbd4f\": container with ID starting with b726f6dfbe359902372da22ef86545373d886bf240a9d4868194cd3331cfbd4f not found: ID does not exist" containerID="b726f6dfbe359902372da22ef86545373d886bf240a9d4868194cd3331cfbd4f"
May 26 00:26:21.869396 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.869328    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b726f6dfbe359902372da22ef86545373d886bf240a9d4868194cd3331cfbd4f"} err="failed to get container status \"b726f6dfbe359902372da22ef86545373d886bf240a9d4868194cd3331cfbd4f\": rpc error: code = NotFound desc = could not find container \"b726f6dfbe359902372da22ef86545373d886bf240a9d4868194cd3331cfbd4f\": container with ID starting with b726f6dfbe359902372da22ef86545373d886bf240a9d4868194cd3331cfbd4f not found: ID does not exist"
May 26 00:26:21.881482 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.881460    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"]
May 26 00:26:21.882827 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:21.882807    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-5c4fdc7476-5645r"]
May 26 00:26:23.490590 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:23.490546    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6746f5d-ba6e-47e8-be57-29fff08ea846" path="/var/lib/kubelet/pods/c6746f5d-ba6e-47e8-be57-29fff08ea846/volumes"
May 26 00:26:32.095361 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.095319    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"]
May 26 00:26:32.095737 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.095642    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6746f5d-ba6e-47e8-be57-29fff08ea846" containerName="manager"
May 26 00:26:32.095737 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.095653    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6746f5d-ba6e-47e8-be57-29fff08ea846" containerName="manager"
May 26 00:26:32.095737 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.095674    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478c56c2-8fe1-495f-be93-7b49149fb8bc" containerName="redis"
May 26 00:26:32.095737 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.095679    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="478c56c2-8fe1-495f-be93-7b49149fb8bc" containerName="redis"
May 26 00:26:32.095737 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.095730    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="478c56c2-8fe1-495f-be93-7b49149fb8bc" containerName="redis"
May 26 00:26:32.095737 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.095739    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="c6746f5d-ba6e-47e8-be57-29fff08ea846" containerName="manager"
May 26 00:26:32.098531 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.098514    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"
May 26 00:26:32.101254 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.101229    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 26 00:26:32.102212 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.102198    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 26 00:26:32.102281 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.102216    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-wzklf\""
May 26 00:26:32.108123 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.108099    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"]
May 26 00:26:32.260332 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.260286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q597\" (UniqueName: \"kubernetes.io/projected/eebe44d6-46e2-4caf-a906-ac7345b44624-kube-api-access-2q597\") pod \"feast-operator-controller-manager-cf99db75-sptf8\" (UID: \"eebe44d6-46e2-4caf-a906-ac7345b44624\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"
May 26 00:26:32.361239 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.361149    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2q597\" (UniqueName: \"kubernetes.io/projected/eebe44d6-46e2-4caf-a906-ac7345b44624-kube-api-access-2q597\") pod \"feast-operator-controller-manager-cf99db75-sptf8\" (UID: \"eebe44d6-46e2-4caf-a906-ac7345b44624\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"
May 26 00:26:32.370989 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.370963    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q597\" (UniqueName: \"kubernetes.io/projected/eebe44d6-46e2-4caf-a906-ac7345b44624-kube-api-access-2q597\") pod \"feast-operator-controller-manager-cf99db75-sptf8\" (UID: \"eebe44d6-46e2-4caf-a906-ac7345b44624\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"
May 26 00:26:32.409024 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.408994    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"
May 26 00:26:32.541762 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.541725    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"]
May 26 00:26:32.545591 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:26:32.545563    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeebe44d6_46e2_4caf_a906_ac7345b44624.slice/crio-828ba120edec4b5b4af48cc26238ec575dd3a9e4fbfbc80c650c37c3db888322 WatchSource:0}: Error finding container 828ba120edec4b5b4af48cc26238ec575dd3a9e4fbfbc80c650c37c3db888322: Status 404 returned error can't find the container with id 828ba120edec4b5b4af48cc26238ec575dd3a9e4fbfbc80c650c37c3db888322
May 26 00:26:32.547307 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.547291    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 00:26:32.896121 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:32.896078    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8" event={"ID":"eebe44d6-46e2-4caf-a906-ac7345b44624","Type":"ContainerStarted","Data":"828ba120edec4b5b4af48cc26238ec575dd3a9e4fbfbc80c650c37c3db888322"}
May 26 00:26:34.903742 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:34.903705    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8" event={"ID":"eebe44d6-46e2-4caf-a906-ac7345b44624","Type":"ContainerStarted","Data":"7beb6bd03ab1a3513d4aa007996862355eed1d66ddbde6488830f91a3963e909"}
May 26 00:26:34.904143 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:34.903787    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"
May 26 00:26:34.919928 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:34.919885    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8" podStartSLOduration=0.723030567 podStartE2EDuration="2.919867259s" podCreationTimestamp="2026-05-26 00:26:32 +0000 UTC" firstStartedPulling="2026-05-26 00:26:32.547417131 +0000 UTC m=+1133.611387997" lastFinishedPulling="2026-05-26 00:26:34.744253806 +0000 UTC m=+1135.808224689" observedRunningTime="2026-05-26 00:26:34.918887962 +0000 UTC m=+1135.982858848" watchObservedRunningTime="2026-05-26 00:26:34.919867259 +0000 UTC m=+1135.983838148"
May 26 00:26:45.910505 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:45.910468    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"
May 26 00:26:57.221255 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.221159    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"]
May 26 00:26:57.226835 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.226813    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.229722 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.229697    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-gkqvs\""
May 26 00:26:57.229722 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.229719    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 00:26:57.229722 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.229707    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 00:26:57.230035 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.229842    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 00:26:57.230035 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.229911    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 00:26:57.230190 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.229708    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 00:26:57.231105 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.231082    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 00:26:57.233527 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.233506    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"]
May 26 00:26:57.268522 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.268493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/31acf1cf-716c-4de4-8299-3cec49bdba57-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.268697 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.268537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.268697 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.268561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.268697 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.268625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.268697 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.268671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.268830 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.268698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkg8d\" (UniqueName: \"kubernetes.io/projected/31acf1cf-716c-4de4-8299-3cec49bdba57-kube-api-access-gkg8d\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.369448 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.369393    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.369649 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.369474    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.369649 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.369510    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.369649 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.369534    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gkg8d\" (UniqueName: \"kubernetes.io/projected/31acf1cf-716c-4de4-8299-3cec49bdba57-kube-api-access-gkg8d\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.369649 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.369576    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/31acf1cf-716c-4de4-8299-3cec49bdba57-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.369649 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.369626    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.370032 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.369991    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/31acf1cf-716c-4de4-8299-3cec49bdba57-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.372247 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.372219    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.372374 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.372267    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.372374 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.372356    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.372488 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.372400    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.377734 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.377710    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkg8d\" (UniqueName: \"kubernetes.io/projected/31acf1cf-716c-4de4-8299-3cec49bdba57-kube-api-access-gkg8d\") pod \"feast-simple-feast-setup-664fcfcc58-x67rw\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.546539 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.546470    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:26:57.685370 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.685330    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"]
May 26 00:26:57.689782 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:26:57.689747    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31acf1cf_716c_4de4_8299_3cec49bdba57.slice/crio-402f94ec1aae53523744d6a73779230d351a0b32e5c031075ab9f019c11c25b9 WatchSource:0}: Error finding container 402f94ec1aae53523744d6a73779230d351a0b32e5c031075ab9f019c11c25b9: Status 404 returned error can't find the container with id 402f94ec1aae53523744d6a73779230d351a0b32e5c031075ab9f019c11c25b9
May 26 00:26:57.972369 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:26:57.972280    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerStarted","Data":"402f94ec1aae53523744d6a73779230d351a0b32e5c031075ab9f019c11c25b9"}
May 26 00:27:12.040669 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:12.039915    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerStarted","Data":"6eece06550fd903e1147c1bbfcfd7ecb2aa444b834704cac2f8ae194c363acad"}
May 26 00:27:17.055871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:17.055836    2576 generic.go:358] "Generic (PLEG): container finished" podID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerID="6eece06550fd903e1147c1bbfcfd7ecb2aa444b834704cac2f8ae194c363acad" exitCode=0
May 26 00:27:17.056256 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:17.055913    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerDied","Data":"6eece06550fd903e1147c1bbfcfd7ecb2aa444b834704cac2f8ae194c363acad"}
May 26 00:27:18.060853 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:18.060818    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerStarted","Data":"2c11988fe23498d92cc3246290dc86b0b5c1292254f3ffa93fb1d4b169888a2f"}
May 26 00:27:23.077844 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:23.077809    2576 generic.go:358] "Generic (PLEG): container finished" podID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerID="2c11988fe23498d92cc3246290dc86b0b5c1292254f3ffa93fb1d4b169888a2f" exitCode=0
May 26 00:27:23.078348 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:23.077868    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerDied","Data":"2c11988fe23498d92cc3246290dc86b0b5c1292254f3ffa93fb1d4b169888a2f"}
May 26 00:27:24.086063 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:24.086002    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerStarted","Data":"e71255861ebf5b2ee14cdbfd649157381f469333ba585616046e2f75bcfb695c"}
May 26 00:27:24.086520 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:24.086073    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerStarted","Data":"7a0c9c85655645a6137218acc2717f44e518aa9d2642bfff7a250639ad72c618"}
May 26 00:27:24.086520 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:24.086088    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerStarted","Data":"d3bf6aa2aa48d854fce1ed9e87fd09f1992e4c328d98bfa3b2ce887cc3f768cf"}
May 26 00:27:24.086520 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:24.086100    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerStarted","Data":"914619dda355c0046f61f115b4e0daca2509bd9cad72718b72ac6f66c8d1fff8"}
May 26 00:27:24.110920 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:24.110856    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podStartSLOduration=13.084340549 podStartE2EDuration="27.110836503s" podCreationTimestamp="2026-05-26 00:26:57 +0000 UTC" firstStartedPulling="2026-05-26 00:26:57.692077136 +0000 UTC m=+1158.756048000" lastFinishedPulling="2026-05-26 00:27:11.71857309 +0000 UTC m=+1172.782543954" observedRunningTime="2026-05-26 00:27:24.108569172 +0000 UTC m=+1185.172540061" watchObservedRunningTime="2026-05-26 00:27:24.110836503 +0000 UTC m=+1185.174807395"
May 26 00:27:24.547447 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:24.547405    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:24.547447 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:24.547455    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:24.547707 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:24.547469    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:24.547707 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:24.547482    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:24.549700 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:24.549638    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
May 26 00:27:24.549700 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:24.549686    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
May 26 00:27:24.549916 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:24.549689    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
May 26 00:27:24.549916 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:24.549856    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused"
May 26 00:27:27.547602 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:27.547558    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:27.548202 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:27.548164    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:27.548202 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:27.548192    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:27.548202 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:27.548206    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:27.548431 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:27.547955    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
May 26 00:27:27.548431 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:27.547807    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
May 26 00:27:27.548431 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:27.547811    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
May 26 00:27:27.548431 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:27.547872    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused"
May 26 00:27:30.548148 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:30.548085    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:30.548574 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:30.548252    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:30.548574 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:30.548455    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:30.549086 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:30.549057    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:30.549211 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:30.549127    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:30.549370 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:30.549350    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:30.552850 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:30.552828    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:31.114555 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:31.114530    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:27:39.420220 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:39.420193    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:27:39.420663 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:27:39.420192    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:28:33.819133 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:33.819100    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"]
May 26 00:28:33.821754 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:33.819550    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="registry" containerID="cri-o://914619dda355c0046f61f115b4e0daca2509bd9cad72718b72ac6f66c8d1fff8" gracePeriod=30
May 26 00:28:33.821754 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:33.819694    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="offline" containerID="cri-o://7a0c9c85655645a6137218acc2717f44e518aa9d2642bfff7a250639ad72c618" gracePeriod=30
May 26 00:28:33.821754 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:33.819694    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="online" containerID="cri-o://d3bf6aa2aa48d854fce1ed9e87fd09f1992e4c328d98bfa3b2ce887cc3f768cf" gracePeriod=30
May 26 00:28:33.821754 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:33.819798    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="ui" containerID="cri-o://e71255861ebf5b2ee14cdbfd649157381f469333ba585616046e2f75bcfb695c" gracePeriod=30
May 26 00:28:34.185651 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.185554    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"]
May 26 00:28:34.190288 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.190258    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.200994 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.200964    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-88lbf\""
May 26 00:28:34.209259 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.209230    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"]
May 26 00:28:34.228663 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.228348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.228663 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.228430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.228663 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.228457    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.228663 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.228521    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.228663 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.228573    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.228663 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.228604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsqft\" (UniqueName: \"kubernetes.io/projected/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-kube-api-access-rsqft\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.329893 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.329863    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.330062 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.329909    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rsqft\" (UniqueName: \"kubernetes.io/projected/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-kube-api-access-rsqft\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.330134 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:28:34.330061    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 26 00:28:34.330189 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:28:34.330150    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-online-tls podName:a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf nodeName:}" failed. No retries permitted until 2026-05-26 00:28:34.830128139 +0000 UTC m=+1255.894099007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-online-tls") pod "feast-simple-feast-setup-664fcfcc58-6t59p" (UID: "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf") : secret "feast-simple-feast-setup-online-tls" not found
May 26 00:28:34.330312 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.330274    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.330393 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.330372    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.330448 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.330409    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.330500 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:28:34.330444    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 26 00:28:34.330500 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.330459    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.330500 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:28:34.330492    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-ui-tls podName:a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf nodeName:}" failed. No retries permitted until 2026-05-26 00:28:34.830476354 +0000 UTC m=+1255.894447225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-6t59p" (UID: "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf") : secret "feast-simple-feast-setup-ui-tls" not found
May 26 00:28:34.330645 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:28:34.330631    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 26 00:28:34.330697 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:28:34.330666    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-registry-tls podName:a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf nodeName:}" failed. No retries permitted until 2026-05-26 00:28:34.830655028 +0000 UTC m=+1255.894625895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-registry-tls") pod "feast-simple-feast-setup-664fcfcc58-6t59p" (UID: "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf") : secret "feast-simple-feast-setup-registry-tls" not found
May 26 00:28:34.331041 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.330997    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.333102 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.333081    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.341312 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.341288    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsqft\" (UniqueName: \"kubernetes.io/projected/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-kube-api-access-rsqft\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.835795 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.835761    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.835795 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.835801    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.836208 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.835843    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.838367 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.838335    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.838367 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.838355    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:34.838542 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:34.838484    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-6t59p\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:35.103491 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:35.103405    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:35.236200 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:35.236155    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"]
May 26 00:28:35.238362 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:28:35.238340    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8e0a159_ce8d_48ce_8cbf_aed1e9ecd6bf.slice/crio-250427a085aa0885be3da01a9c8b7ff4573fa49cc6f38da7b9a3c763a5a41d5c WatchSource:0}: Error finding container 250427a085aa0885be3da01a9c8b7ff4573fa49cc6f38da7b9a3c763a5a41d5c: Status 404 returned error can't find the container with id 250427a085aa0885be3da01a9c8b7ff4573fa49cc6f38da7b9a3c763a5a41d5c
May 26 00:28:35.307171 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:35.307143    2576 generic.go:358] "Generic (PLEG): container finished" podID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerID="e71255861ebf5b2ee14cdbfd649157381f469333ba585616046e2f75bcfb695c" exitCode=0
May 26 00:28:35.307171 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:35.307169    2576 generic.go:358] "Generic (PLEG): container finished" podID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerID="d3bf6aa2aa48d854fce1ed9e87fd09f1992e4c328d98bfa3b2ce887cc3f768cf" exitCode=0
May 26 00:28:35.307332 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:35.307215    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerDied","Data":"e71255861ebf5b2ee14cdbfd649157381f469333ba585616046e2f75bcfb695c"}
May 26 00:28:35.307332 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:35.307253    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerDied","Data":"d3bf6aa2aa48d854fce1ed9e87fd09f1992e4c328d98bfa3b2ce887cc3f768cf"}
May 26 00:28:35.308660 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:35.308636    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerStarted","Data":"250427a085aa0885be3da01a9c8b7ff4573fa49cc6f38da7b9a3c763a5a41d5c"}
May 26 00:28:36.312983 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:36.312944    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerStarted","Data":"99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e"}
May 26 00:28:40.326534 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:40.326499    2576 generic.go:358] "Generic (PLEG): container finished" podID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerID="99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e" exitCode=0
May 26 00:28:40.326993 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:40.326569    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerDied","Data":"99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e"}
May 26 00:28:40.552832 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:40.552529    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
May 26 00:28:41.112236 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:41.112194    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
May 26 00:28:41.331432 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:41.331398    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerStarted","Data":"31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1"}
May 26 00:28:46.347906 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:46.347871    2576 generic.go:358] "Generic (PLEG): container finished" podID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerID="31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1" exitCode=0
May 26 00:28:46.348302 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:46.347940    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerDied","Data":"31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1"}
May 26 00:28:47.355958 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:47.355916    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerStarted","Data":"d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4"}
May 26 00:28:47.356432 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:47.355970    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerStarted","Data":"dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0"}
May 26 00:28:47.356432 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:47.355987    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerStarted","Data":"bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086"}
May 26 00:28:47.356432 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:47.356001    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerStarted","Data":"b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a"}
May 26 00:28:47.379617 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:47.379528    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podStartSLOduration=13.379492647 podStartE2EDuration="13.379492647s" podCreationTimestamp="2026-05-26 00:28:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:28:47.377527631 +0000 UTC m=+1268.441498518" watchObservedRunningTime="2026-05-26 00:28:47.379492647 +0000 UTC m=+1268.443463535"
May 26 00:28:50.104472 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:50.104430    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:50.104957 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:50.104482    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:50.104957 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:50.104497    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:50.104957 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:50.104509    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:50.106580 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:50.106543    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused"
May 26 00:28:50.106814 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:50.106566    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
May 26 00:28:50.107032 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:50.106576    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused"
May 26 00:28:50.107032 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:50.106633    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
May 26 00:28:50.550056 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:50.549980    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
May 26 00:28:51.112581 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:51.112534    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
May 26 00:28:53.104663 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:53.104628    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:53.105117 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:53.104972    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:53.105213 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:53.105197    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:53.105495 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:53.105470    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:53.105590 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:53.105506    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:53.105590 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:53.105520    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:53.105801 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:53.105778    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:53.105904 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:53.105838    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:53.105964 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:53.105951    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:53.109312 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:53.109294    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:53.379874 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:53.379789    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:28:53.382827 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:28:53.382806    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:29:00.548994 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:00.548950    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
May 26 00:29:00.549550 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:00.549113    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:29:01.112656 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:01.112616    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
May 26 00:29:01.112831 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:01.112740    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:29:04.419717 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.419682    2576 generic.go:358] "Generic (PLEG): container finished" podID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerID="7a0c9c85655645a6137218acc2717f44e518aa9d2642bfff7a250639ad72c618" exitCode=137
May 26 00:29:04.419717 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.419712    2576 generic.go:358] "Generic (PLEG): container finished" podID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerID="914619dda355c0046f61f115b4e0daca2509bd9cad72718b72ac6f66c8d1fff8" exitCode=137
May 26 00:29:04.420143 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.419756    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerDied","Data":"7a0c9c85655645a6137218acc2717f44e518aa9d2642bfff7a250639ad72c618"}
May 26 00:29:04.420143 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.419798    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerDied","Data":"914619dda355c0046f61f115b4e0daca2509bd9cad72718b72ac6f66c8d1fff8"}
May 26 00:29:04.471860 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.471837    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:29:04.618234 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.618144    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-offline-tls\") pod \"31acf1cf-716c-4de4-8299-3cec49bdba57\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") "
May 26 00:29:04.618409 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.618237    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-online-tls\") pod \"31acf1cf-716c-4de4-8299-3cec49bdba57\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") "
May 26 00:29:04.618409 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.618253    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-registry-tls\") pod \"31acf1cf-716c-4de4-8299-3cec49bdba57\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") "
May 26 00:29:04.618409 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.618275    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/31acf1cf-716c-4de4-8299-3cec49bdba57-feast-data\") pod \"31acf1cf-716c-4de4-8299-3cec49bdba57\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") "
May 26 00:29:04.618409 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.618289    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-ui-tls\") pod \"31acf1cf-716c-4de4-8299-3cec49bdba57\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") "
May 26 00:29:04.618409 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.618306    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkg8d\" (UniqueName: \"kubernetes.io/projected/31acf1cf-716c-4de4-8299-3cec49bdba57-kube-api-access-gkg8d\") pod \"31acf1cf-716c-4de4-8299-3cec49bdba57\" (UID: \"31acf1cf-716c-4de4-8299-3cec49bdba57\") "
May 26 00:29:04.618905 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.618870    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31acf1cf-716c-4de4-8299-3cec49bdba57-feast-data" (OuterVolumeSpecName: "feast-data") pod "31acf1cf-716c-4de4-8299-3cec49bdba57" (UID: "31acf1cf-716c-4de4-8299-3cec49bdba57"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:29:04.620639 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.620611    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "31acf1cf-716c-4de4-8299-3cec49bdba57" (UID: "31acf1cf-716c-4de4-8299-3cec49bdba57"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:29:04.620749 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.620666    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "31acf1cf-716c-4de4-8299-3cec49bdba57" (UID: "31acf1cf-716c-4de4-8299-3cec49bdba57"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:29:04.620749 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.620676    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-online-tls" (OuterVolumeSpecName: "online-tls") pod "31acf1cf-716c-4de4-8299-3cec49bdba57" (UID: "31acf1cf-716c-4de4-8299-3cec49bdba57"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:29:04.621045 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.621002    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "31acf1cf-716c-4de4-8299-3cec49bdba57" (UID: "31acf1cf-716c-4de4-8299-3cec49bdba57"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:29:04.621109 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.621066    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31acf1cf-716c-4de4-8299-3cec49bdba57-kube-api-access-gkg8d" (OuterVolumeSpecName: "kube-api-access-gkg8d") pod "31acf1cf-716c-4de4-8299-3cec49bdba57" (UID: "31acf1cf-716c-4de4-8299-3cec49bdba57"). InnerVolumeSpecName "kube-api-access-gkg8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:29:04.719851 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.719812    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-online-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:29:04.719851 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.719843    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-registry-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:29:04.719851 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.719853    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/31acf1cf-716c-4de4-8299-3cec49bdba57-feast-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:29:04.719851 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.719860    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-ui-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:29:04.720189 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.719868    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkg8d\" (UniqueName: \"kubernetes.io/projected/31acf1cf-716c-4de4-8299-3cec49bdba57-kube-api-access-gkg8d\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:29:04.720189 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:04.719877    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/31acf1cf-716c-4de4-8299-3cec49bdba57-offline-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:29:05.425520 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:05.425476    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw" event={"ID":"31acf1cf-716c-4de4-8299-3cec49bdba57","Type":"ContainerDied","Data":"402f94ec1aae53523744d6a73779230d351a0b32e5c031075ab9f019c11c25b9"}
May 26 00:29:05.426005 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:05.425536    2576 scope.go:117] "RemoveContainer" containerID="e71255861ebf5b2ee14cdbfd649157381f469333ba585616046e2f75bcfb695c"
May 26 00:29:05.426005 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:05.425551    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"
May 26 00:29:05.434323 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:05.434303    2576 scope.go:117] "RemoveContainer" containerID="7a0c9c85655645a6137218acc2717f44e518aa9d2642bfff7a250639ad72c618"
May 26 00:29:05.441671 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:05.441654    2576 scope.go:117] "RemoveContainer" containerID="d3bf6aa2aa48d854fce1ed9e87fd09f1992e4c328d98bfa3b2ce887cc3f768cf"
May 26 00:29:05.449042 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:05.448982    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"]
May 26 00:29:05.450542 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:05.450519    2576 scope.go:117] "RemoveContainer" containerID="914619dda355c0046f61f115b4e0daca2509bd9cad72718b72ac6f66c8d1fff8"
May 26 00:29:05.451189 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:05.451162    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-x67rw"]
May 26 00:29:05.457769 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:05.457752    2576 scope.go:117] "RemoveContainer" containerID="2c11988fe23498d92cc3246290dc86b0b5c1292254f3ffa93fb1d4b169888a2f"
May 26 00:29:05.464723 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:05.464710    2576 scope.go:117] "RemoveContainer" containerID="6eece06550fd903e1147c1bbfcfd7ecb2aa444b834704cac2f8ae194c363acad"
May 26 00:29:05.491379 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:05.491352    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" path="/var/lib/kubelet/pods/31acf1cf-716c-4de4-8299-3cec49bdba57/volumes"
May 26 00:29:55.793058 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.792949    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"]
May 26 00:29:55.793484 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793429    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="feast-apply"
May 26 00:29:55.793484 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793443    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="feast-apply"
May 26 00:29:55.793484 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793463    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="offline"
May 26 00:29:55.793484 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793472    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="offline"
May 26 00:29:55.793616 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793487    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="online"
May 26 00:29:55.793616 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793496    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="online"
May 26 00:29:55.793616 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793513    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="ui"
May 26 00:29:55.793616 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793520    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="ui"
May 26 00:29:55.793616 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793532    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="registry"
May 26 00:29:55.793616 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793540    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="registry"
May 26 00:29:55.793616 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793553    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="feast-init"
May 26 00:29:55.793616 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793560    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="feast-init"
May 26 00:29:55.793838 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793625    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="offline"
May 26 00:29:55.793838 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793639    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="registry"
May 26 00:29:55.793838 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793650    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="online"
May 26 00:29:55.793838 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.793660    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="31acf1cf-716c-4de4-8299-3cec49bdba57" containerName="ui"
May 26 00:29:55.806580 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.806543    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"]
May 26 00:29:55.806725 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.806682    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:55.809167 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.809137    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 26 00:29:55.809388 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.809362    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 26 00:29:55.809477 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.809391    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 26 00:29:55.809477 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.809459    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 26 00:29:55.809703 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.809684    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-dsfbq\""
May 26 00:29:55.809816 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.809723    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 26 00:29:55.809885 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.809762    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 26 00:29:55.955806 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.955772    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:55.955968 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.955819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt8qz\" (UniqueName: \"kubernetes.io/projected/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-kube-api-access-mt8qz\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:55.955968 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.955882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:55.955968 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.955935    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:55.955968 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.955965    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:55.956214 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:55.956111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.056575 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.056489    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.056575 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.056533    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.056762 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.056659    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.056762 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.056733    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.056842 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.056775    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.056842 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.056803    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mt8qz\" (UniqueName: \"kubernetes.io/projected/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-kube-api-access-mt8qz\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.057141 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.057116    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.057385 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.057367    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.059246 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.059216    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.059602 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.059584    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.059674 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.059608    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.066280 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.066256    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt8qz\" (UniqueName: \"kubernetes.io/projected/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-kube-api-access-mt8qz\") pod \"feast-simple-feast-remote-setup-5cff94746b-wf8nd\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.117329 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.117288    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:29:56.248456 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.248402    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"]
May 26 00:29:56.250656 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:29:56.250623    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae7c0cfb_2e7d_449f_8c0e_06a5e7654a5d.slice/crio-96ba935a4597e42dc48b8df9fb5a900bab34ab90c49faeb186fa556da8edee9d WatchSource:0}: Error finding container 96ba935a4597e42dc48b8df9fb5a900bab34ab90c49faeb186fa556da8edee9d: Status 404 returned error can't find the container with id 96ba935a4597e42dc48b8df9fb5a900bab34ab90c49faeb186fa556da8edee9d
May 26 00:29:56.573933 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.573810    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" event={"ID":"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d","Type":"ContainerStarted","Data":"1fcf1b31d9a2a40fb2c5869dec7b060f6d943582a8fee2f28caffdab851d8947"}
May 26 00:29:56.573933 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:29:56.573852    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" event={"ID":"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d","Type":"ContainerStarted","Data":"96ba935a4597e42dc48b8df9fb5a900bab34ab90c49faeb186fa556da8edee9d"}
May 26 00:30:01.589693 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:01.589656    2576 generic.go:358] "Generic (PLEG): container finished" podID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerID="1fcf1b31d9a2a40fb2c5869dec7b060f6d943582a8fee2f28caffdab851d8947" exitCode=0
May 26 00:30:01.590114 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:01.589737    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" event={"ID":"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d","Type":"ContainerDied","Data":"1fcf1b31d9a2a40fb2c5869dec7b060f6d943582a8fee2f28caffdab851d8947"}
May 26 00:30:02.594909 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:02.594870    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" event={"ID":"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d","Type":"ContainerStarted","Data":"3c17eed8c48e717b52b0121f2fcdf82e71fd5505f5382eaa8036c1398b2b30c4"}
May 26 00:30:07.610917 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:07.610887    2576 generic.go:358] "Generic (PLEG): container finished" podID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerID="3c17eed8c48e717b52b0121f2fcdf82e71fd5505f5382eaa8036c1398b2b30c4" exitCode=0
May 26 00:30:07.611367 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:07.610963    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" event={"ID":"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d","Type":"ContainerDied","Data":"3c17eed8c48e717b52b0121f2fcdf82e71fd5505f5382eaa8036c1398b2b30c4"}
May 26 00:30:08.618171 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:08.618128    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" event={"ID":"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d","Type":"ContainerStarted","Data":"bc8955ec09ce52aeed41fe2781994d286231b24adf27063a7ed987ae0cb976a2"}
May 26 00:30:08.618558 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:08.618184    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" event={"ID":"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d","Type":"ContainerStarted","Data":"8e575e7318708bd623efff9da0a56411935b43110c9c32ca7ac1286986cc77bf"}
May 26 00:30:08.618558 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:08.618198    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" event={"ID":"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d","Type":"ContainerStarted","Data":"ca92d221b8513fac52d6e22a6452ecb727bc10db5b99dfb1ba3be2506ffe3780"}
May 26 00:30:08.640293 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:08.640228    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" podStartSLOduration=13.640210044 podStartE2EDuration="13.640210044s" podCreationTimestamp="2026-05-26 00:29:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:30:08.639284454 +0000 UTC m=+1349.703255342" watchObservedRunningTime="2026-05-26 00:30:08.640210044 +0000 UTC m=+1349.704180932"
May 26 00:30:11.118226 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:11.118187    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:30:11.118824 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:11.118239    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:30:11.118824 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:11.118252    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:30:11.120108 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:11.120076    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.31:8816: connect: connection refused"
May 26 00:30:11.120216 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:11.120097    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
May 26 00:30:11.120216 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:11.120112    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
May 26 00:30:14.118767 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:14.118736    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:30:14.119179 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:14.118849    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:30:14.119268 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:14.119250    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:30:14.119332 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:14.119278    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:30:14.119462 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:14.119447    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:30:14.119768 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:14.119751    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:30:14.122860 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:14.122841    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:30:14.638598 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:14.638565    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:30:14.641631 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:30:14.641611    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:31:17.112406 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:17.112366    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"]
May 26 00:31:17.112908 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:17.112814    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="online" containerID="cri-o://ca92d221b8513fac52d6e22a6452ecb727bc10db5b99dfb1ba3be2506ffe3780" gracePeriod=30
May 26 00:31:17.113025 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:17.112955    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="offline" containerID="cri-o://8e575e7318708bd623efff9da0a56411935b43110c9c32ca7ac1286986cc77bf" gracePeriod=30
May 26 00:31:17.113095 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:17.112955    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="ui" containerID="cri-o://bc8955ec09ce52aeed41fe2781994d286231b24adf27063a7ed987ae0cb976a2" gracePeriod=30
May 26 00:31:17.272555 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:17.272518    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"]
May 26 00:31:17.272997 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:17.272970    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="registry" containerID="cri-o://b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a" gracePeriod=30
May 26 00:31:17.273134 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:17.273099    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="offline" containerID="cri-o://dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0" gracePeriod=30
May 26 00:31:17.273202 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:17.273119    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="ui" containerID="cri-o://d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4" gracePeriod=30
May 26 00:31:17.273254 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:17.273151    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="online" containerID="cri-o://bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086" gracePeriod=30
May 26 00:31:17.828914 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:17.828880    2576 generic.go:358] "Generic (PLEG): container finished" podID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerID="d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4" exitCode=0
May 26 00:31:17.829047 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:17.828936    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerDied","Data":"d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4"}
May 26 00:31:17.831564 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:17.831543    2576 generic.go:358] "Generic (PLEG): container finished" podID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerID="bc8955ec09ce52aeed41fe2781994d286231b24adf27063a7ed987ae0cb976a2" exitCode=0
May 26 00:31:17.831714 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:17.831575    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" event={"ID":"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d","Type":"ContainerDied","Data":"bc8955ec09ce52aeed41fe2781994d286231b24adf27063a7ed987ae0cb976a2"}
May 26 00:31:18.837714 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:18.837671    2576 generic.go:358] "Generic (PLEG): container finished" podID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerID="bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086" exitCode=0
May 26 00:31:18.838150 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:18.837735    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerDied","Data":"bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086"}
May 26 00:31:18.840091 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:18.840064    2576 generic.go:358] "Generic (PLEG): container finished" podID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerID="ca92d221b8513fac52d6e22a6452ecb727bc10db5b99dfb1ba3be2506ffe3780" exitCode=0
May 26 00:31:18.840205 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:18.840123    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" event={"ID":"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d","Type":"ContainerDied","Data":"ca92d221b8513fac52d6e22a6452ecb727bc10db5b99dfb1ba3be2506ffe3780"}
May 26 00:31:23.106607 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:23.106556    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
May 26 00:31:23.379974 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:23.379874    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
May 26 00:31:24.120193 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:24.120151    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
May 26 00:31:24.639244 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:24.639202    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
May 26 00:31:33.106402 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:33.106346    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
May 26 00:31:33.379941 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:33.379851    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
May 26 00:31:34.119895 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:34.119844    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
May 26 00:31:34.639753 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:34.639716    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
May 26 00:31:43.106561 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:43.106511    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
May 26 00:31:43.107073 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:43.106756    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:31:43.380449 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:43.380362    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
May 26 00:31:43.380598 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:43.380488    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:31:44.119551 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:44.119507    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
May 26 00:31:44.119963 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:44.119636    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:31:44.638902 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:44.638866    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
May 26 00:31:44.639099 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:44.638971    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:31:47.774918 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.774892    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:31:47.856640 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.856605    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-ui-tls\") pod \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") "
May 26 00:31:47.856807 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.856646    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-online-tls\") pod \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") "
May 26 00:31:47.856807 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.856686    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-feast-data\") pod \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") "
May 26 00:31:47.856807 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.856714    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-registry-tls\") pod \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") "
May 26 00:31:47.856807 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.856741    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-offline-tls\") pod \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") "
May 26 00:31:47.857004 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.856850    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mt8qz\" (UniqueName: \"kubernetes.io/projected/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-kube-api-access-mt8qz\") pod \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\" (UID: \"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d\") "
May 26 00:31:47.857139 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.857108    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" (UID: "ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:31:47.857267 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.857242    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-feast-data" (OuterVolumeSpecName: "feast-data") pod "ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" (UID: "ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:31:47.859568 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.859523    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" (UID: "ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:31:47.859705 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.859573    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-kube-api-access-mt8qz" (OuterVolumeSpecName: "kube-api-access-mt8qz") pod "ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" (UID: "ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d"). InnerVolumeSpecName "kube-api-access-mt8qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:31:47.859705 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.859598    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-online-tls" (OuterVolumeSpecName: "online-tls") pod "ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" (UID: "ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:31:47.859705 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.859617    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" (UID: "ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:31:47.924603 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.924580    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:31:47.929539 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.929510    2576 generic.go:358] "Generic (PLEG): container finished" podID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerID="8e575e7318708bd623efff9da0a56411935b43110c9c32ca7ac1286986cc77bf" exitCode=137
May 26 00:31:47.929662 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.929589    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" event={"ID":"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d","Type":"ContainerDied","Data":"8e575e7318708bd623efff9da0a56411935b43110c9c32ca7ac1286986cc77bf"}
May 26 00:31:47.929662 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.929633    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd" event={"ID":"ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d","Type":"ContainerDied","Data":"96ba935a4597e42dc48b8df9fb5a900bab34ab90c49faeb186fa556da8edee9d"}
May 26 00:31:47.929662 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.929649    2576 scope.go:117] "RemoveContainer" containerID="bc8955ec09ce52aeed41fe2781994d286231b24adf27063a7ed987ae0cb976a2"
May 26 00:31:47.929662 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.929600    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"
May 26 00:31:47.932499 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.932473    2576 generic.go:358] "Generic (PLEG): container finished" podID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerID="dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0" exitCode=137
May 26 00:31:47.932499 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.932496    2576 generic.go:358] "Generic (PLEG): container finished" podID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerID="b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a" exitCode=137
May 26 00:31:47.932679 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.932537    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerDied","Data":"dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0"}
May 26 00:31:47.932679 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.932557    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"
May 26 00:31:47.932679 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.932566    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerDied","Data":"b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a"}
May 26 00:31:47.932679 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.932579    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p" event={"ID":"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf","Type":"ContainerDied","Data":"250427a085aa0885be3da01a9c8b7ff4573fa49cc6f38da7b9a3c763a5a41d5c"}
May 26 00:31:47.940621 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.940597    2576 scope.go:117] "RemoveContainer" containerID="8e575e7318708bd623efff9da0a56411935b43110c9c32ca7ac1286986cc77bf"
May 26 00:31:47.948851 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.948825    2576 scope.go:117] "RemoveContainer" containerID="ca92d221b8513fac52d6e22a6452ecb727bc10db5b99dfb1ba3be2506ffe3780"
May 26 00:31:47.957284 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.957253    2576 scope.go:117] "RemoveContainer" containerID="3c17eed8c48e717b52b0121f2fcdf82e71fd5505f5382eaa8036c1398b2b30c4"
May 26 00:31:47.957473 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.957447    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsqft\" (UniqueName: \"kubernetes.io/projected/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-kube-api-access-rsqft\") pod \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") "
May 26 00:31:47.957558 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.957497    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-feast-data\") pod \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") "
May 26 00:31:47.957558 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.957528    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-ui-tls\") pod \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") "
May 26 00:31:47.957657 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.957566    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-offline-tls\") pod \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") "
May 26 00:31:47.957657 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.957593    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-registry-tls\") pod \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") "
May 26 00:31:47.957757 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.957667    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-online-tls\") pod \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\" (UID: \"a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf\") "
May 26 00:31:47.958524 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.958490    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-feast-data" (OuterVolumeSpecName: "feast-data") pod "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" (UID: "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:31:47.958736 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.958675    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mt8qz\" (UniqueName: \"kubernetes.io/projected/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-kube-api-access-mt8qz\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:31:47.958736 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.958725    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-ui-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:31:47.958736 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.958742    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-online-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:31:47.958736 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.958758    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-feast-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:31:47.959092 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.958772    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-registry-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:31:47.959092 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.958803    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-feast-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:31:47.959092 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.958818    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d-offline-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:31:47.959959 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.959938    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" (UID: "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:31:47.960521 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.960434    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-kube-api-access-rsqft" (OuterVolumeSpecName: "kube-api-access-rsqft") pod "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" (UID: "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf"). InnerVolumeSpecName "kube-api-access-rsqft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:31:47.960675 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.960604    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-online-tls" (OuterVolumeSpecName: "online-tls") pod "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" (UID: "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:31:47.960963 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.960913    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" (UID: "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:31:47.960963 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.960887    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" (UID: "a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:31:47.964469 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.964442    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"]
May 26 00:31:47.966685 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.966661    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-wf8nd"]
May 26 00:31:47.967221 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.967206    2576 scope.go:117] "RemoveContainer" containerID="1fcf1b31d9a2a40fb2c5869dec7b060f6d943582a8fee2f28caffdab851d8947"
May 26 00:31:47.976109 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.976093    2576 scope.go:117] "RemoveContainer" containerID="bc8955ec09ce52aeed41fe2781994d286231b24adf27063a7ed987ae0cb976a2"
May 26 00:31:47.976398 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:31:47.976376    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc8955ec09ce52aeed41fe2781994d286231b24adf27063a7ed987ae0cb976a2\": container with ID starting with bc8955ec09ce52aeed41fe2781994d286231b24adf27063a7ed987ae0cb976a2 not found: ID does not exist" containerID="bc8955ec09ce52aeed41fe2781994d286231b24adf27063a7ed987ae0cb976a2"
May 26 00:31:47.976457 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.976401    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8955ec09ce52aeed41fe2781994d286231b24adf27063a7ed987ae0cb976a2"} err="failed to get container status \"bc8955ec09ce52aeed41fe2781994d286231b24adf27063a7ed987ae0cb976a2\": rpc error: code = NotFound desc = could not find container \"bc8955ec09ce52aeed41fe2781994d286231b24adf27063a7ed987ae0cb976a2\": container with ID starting with bc8955ec09ce52aeed41fe2781994d286231b24adf27063a7ed987ae0cb976a2 not found: ID does not exist"
May 26 00:31:47.976457 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.976420    2576 scope.go:117] "RemoveContainer" containerID="8e575e7318708bd623efff9da0a56411935b43110c9c32ca7ac1286986cc77bf"
May 26 00:31:47.976652 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:31:47.976638    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e575e7318708bd623efff9da0a56411935b43110c9c32ca7ac1286986cc77bf\": container with ID starting with 8e575e7318708bd623efff9da0a56411935b43110c9c32ca7ac1286986cc77bf not found: ID does not exist" containerID="8e575e7318708bd623efff9da0a56411935b43110c9c32ca7ac1286986cc77bf"
May 26 00:31:47.976697 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.976659    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e575e7318708bd623efff9da0a56411935b43110c9c32ca7ac1286986cc77bf"} err="failed to get container status \"8e575e7318708bd623efff9da0a56411935b43110c9c32ca7ac1286986cc77bf\": rpc error: code = NotFound desc = could not find container \"8e575e7318708bd623efff9da0a56411935b43110c9c32ca7ac1286986cc77bf\": container with ID starting with 8e575e7318708bd623efff9da0a56411935b43110c9c32ca7ac1286986cc77bf not found: ID does not exist"
May 26 00:31:47.976697 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.976673    2576 scope.go:117] "RemoveContainer" containerID="ca92d221b8513fac52d6e22a6452ecb727bc10db5b99dfb1ba3be2506ffe3780"
May 26 00:31:47.976888 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:31:47.976874    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca92d221b8513fac52d6e22a6452ecb727bc10db5b99dfb1ba3be2506ffe3780\": container with ID starting with ca92d221b8513fac52d6e22a6452ecb727bc10db5b99dfb1ba3be2506ffe3780 not found: ID does not exist" containerID="ca92d221b8513fac52d6e22a6452ecb727bc10db5b99dfb1ba3be2506ffe3780"
May 26 00:31:47.976928 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.976890    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca92d221b8513fac52d6e22a6452ecb727bc10db5b99dfb1ba3be2506ffe3780"} err="failed to get container status \"ca92d221b8513fac52d6e22a6452ecb727bc10db5b99dfb1ba3be2506ffe3780\": rpc error: code = NotFound desc = could not find container \"ca92d221b8513fac52d6e22a6452ecb727bc10db5b99dfb1ba3be2506ffe3780\": container with ID starting with ca92d221b8513fac52d6e22a6452ecb727bc10db5b99dfb1ba3be2506ffe3780 not found: ID does not exist"
May 26 00:31:47.976928 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.976902    2576 scope.go:117] "RemoveContainer" containerID="3c17eed8c48e717b52b0121f2fcdf82e71fd5505f5382eaa8036c1398b2b30c4"
May 26 00:31:47.977174 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:31:47.977156    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c17eed8c48e717b52b0121f2fcdf82e71fd5505f5382eaa8036c1398b2b30c4\": container with ID starting with 3c17eed8c48e717b52b0121f2fcdf82e71fd5505f5382eaa8036c1398b2b30c4 not found: ID does not exist" containerID="3c17eed8c48e717b52b0121f2fcdf82e71fd5505f5382eaa8036c1398b2b30c4"
May 26 00:31:47.977233 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.977179    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c17eed8c48e717b52b0121f2fcdf82e71fd5505f5382eaa8036c1398b2b30c4"} err="failed to get container status \"3c17eed8c48e717b52b0121f2fcdf82e71fd5505f5382eaa8036c1398b2b30c4\": rpc error: code = NotFound desc = could not find container \"3c17eed8c48e717b52b0121f2fcdf82e71fd5505f5382eaa8036c1398b2b30c4\": container with ID starting with 3c17eed8c48e717b52b0121f2fcdf82e71fd5505f5382eaa8036c1398b2b30c4 not found: ID does not exist"
May 26 00:31:47.977233 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.977193    2576 scope.go:117] "RemoveContainer" containerID="1fcf1b31d9a2a40fb2c5869dec7b060f6d943582a8fee2f28caffdab851d8947"
May 26 00:31:47.977470 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:31:47.977439    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fcf1b31d9a2a40fb2c5869dec7b060f6d943582a8fee2f28caffdab851d8947\": container with ID starting with 1fcf1b31d9a2a40fb2c5869dec7b060f6d943582a8fee2f28caffdab851d8947 not found: ID does not exist" containerID="1fcf1b31d9a2a40fb2c5869dec7b060f6d943582a8fee2f28caffdab851d8947"
May 26 00:31:47.977526 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.977478    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fcf1b31d9a2a40fb2c5869dec7b060f6d943582a8fee2f28caffdab851d8947"} err="failed to get container status \"1fcf1b31d9a2a40fb2c5869dec7b060f6d943582a8fee2f28caffdab851d8947\": rpc error: code = NotFound desc = could not find container \"1fcf1b31d9a2a40fb2c5869dec7b060f6d943582a8fee2f28caffdab851d8947\": container with ID starting with 1fcf1b31d9a2a40fb2c5869dec7b060f6d943582a8fee2f28caffdab851d8947 not found: ID does not exist"
May 26 00:31:47.977526 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.977493    2576 scope.go:117] "RemoveContainer" containerID="d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4"
May 26 00:31:47.985368 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.985348    2576 scope.go:117] "RemoveContainer" containerID="dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0"
May 26 00:31:47.992515 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.992492    2576 scope.go:117] "RemoveContainer" containerID="bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086"
May 26 00:31:47.999732 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:47.999661    2576 scope.go:117] "RemoveContainer" containerID="b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a"
May 26 00:31:48.007652 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.007630    2576 scope.go:117] "RemoveContainer" containerID="31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1"
May 26 00:31:48.015099 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.015071    2576 scope.go:117] "RemoveContainer" containerID="99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e"
May 26 00:31:48.022613 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.022591    2576 scope.go:117] "RemoveContainer" containerID="d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4"
May 26 00:31:48.022898 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:31:48.022877    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4\": container with ID starting with d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4 not found: ID does not exist" containerID="d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4"
May 26 00:31:48.022944 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.022907    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4"} err="failed to get container status \"d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4\": rpc error: code = NotFound desc = could not find container \"d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4\": container with ID starting with d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4 not found: ID does not exist"
May 26 00:31:48.022944 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.022933    2576 scope.go:117] "RemoveContainer" containerID="dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0"
May 26 00:31:48.023202 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:31:48.023184    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0\": container with ID starting with dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0 not found: ID does not exist" containerID="dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0"
May 26 00:31:48.023258 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.023206    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0"} err="failed to get container status \"dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0\": rpc error: code = NotFound desc = could not find container \"dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0\": container with ID starting with dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0 not found: ID does not exist"
May 26 00:31:48.023258 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.023220    2576 scope.go:117] "RemoveContainer" containerID="bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086"
May 26 00:31:48.023424 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:31:48.023410    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086\": container with ID starting with bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086 not found: ID does not exist" containerID="bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086"
May 26 00:31:48.023469 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.023426    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086"} err="failed to get container status \"bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086\": rpc error: code = NotFound desc = could not find container \"bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086\": container with ID starting with bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086 not found: ID does not exist"
May 26 00:31:48.023469 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.023441    2576 scope.go:117] "RemoveContainer" containerID="b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a"
May 26 00:31:48.023631 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:31:48.023618    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a\": container with ID starting with b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a not found: ID does not exist" containerID="b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a"
May 26 00:31:48.023677 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.023634    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a"} err="failed to get container status \"b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a\": rpc error: code = NotFound desc = could not find container \"b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a\": container with ID starting with b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a not found: ID does not exist"
May 26 00:31:48.023677 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.023645    2576 scope.go:117] "RemoveContainer" containerID="31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1"
May 26 00:31:48.023886 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:31:48.023871    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1\": container with ID starting with 31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1 not found: ID does not exist" containerID="31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1"
May 26 00:31:48.023927 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.023888    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1"} err="failed to get container status \"31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1\": rpc error: code = NotFound desc = could not find container \"31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1\": container with ID starting with 31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1 not found: ID does not exist"
May 26 00:31:48.023927 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.023900    2576 scope.go:117] "RemoveContainer" containerID="99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e"
May 26 00:31:48.024108 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:31:48.024092    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e\": container with ID starting with 99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e not found: ID does not exist" containerID="99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e"
May 26 00:31:48.024159 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.024112    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e"} err="failed to get container status \"99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e\": rpc error: code = NotFound desc = could not find container \"99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e\": container with ID starting with 99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e not found: ID does not exist"
May 26 00:31:48.024159 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.024126    2576 scope.go:117] "RemoveContainer" containerID="d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4"
May 26 00:31:48.024309 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.024293    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4"} err="failed to get container status \"d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4\": rpc error: code = NotFound desc = could not find container \"d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4\": container with ID starting with d9c9855944bbb3178dc7403cdc674e19d4e0ed92d62d0c342cdf9c7ad21448c4 not found: ID does not exist"
May 26 00:31:48.024356 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.024310    2576 scope.go:117] "RemoveContainer" containerID="dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0"
May 26 00:31:48.024488 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.024474    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0"} err="failed to get container status \"dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0\": rpc error: code = NotFound desc = could not find container \"dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0\": container with ID starting with dfefbd27d8bc0e779bd2df7c3c7fcaef1ca424e7714e01dcaa3104d43944b7a0 not found: ID does not exist"
May 26 00:31:48.024533 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.024488    2576 scope.go:117] "RemoveContainer" containerID="bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086"
May 26 00:31:48.024680 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.024661    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086"} err="failed to get container status \"bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086\": rpc error: code = NotFound desc = could not find container \"bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086\": container with ID starting with bc269e469629be1e91a0c814abc38aa3719cea0fd22ccf7f8852ea921dba5086 not found: ID does not exist"
May 26 00:31:48.024680 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.024679    2576 scope.go:117] "RemoveContainer" containerID="b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a"
May 26 00:31:48.024928 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.024903    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a"} err="failed to get container status \"b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a\": rpc error: code = NotFound desc = could not find container \"b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a\": container with ID starting with b79dfb94957d701372857be5fbeca007599876e215f2b61fa8a8a6b1c6d5ec4a not found: ID does not exist"
May 26 00:31:48.024982 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.024932    2576 scope.go:117] "RemoveContainer" containerID="31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1"
May 26 00:31:48.025164 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.025149    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1"} err="failed to get container status \"31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1\": rpc error: code = NotFound desc = could not find container \"31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1\": container with ID starting with 31b61bcfaaca4245f8e475b97071deca7acf535079e58f3a59c18ea66520acc1 not found: ID does not exist"
May 26 00:31:48.025215 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.025164    2576 scope.go:117] "RemoveContainer" containerID="99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e"
May 26 00:31:48.025363 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.025348    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e"} err="failed to get container status \"99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e\": rpc error: code = NotFound desc = could not find container \"99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e\": container with ID starting with 99825b6bff5e560584c15983d5360e9769b35b205925c045921cc9aa6b57ef4e not found: ID does not exist"
May 26 00:31:48.060003 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.059965    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-online-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:31:48.060003 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.060001    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsqft\" (UniqueName: \"kubernetes.io/projected/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-kube-api-access-rsqft\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:31:48.060003 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.060031    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-ui-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:31:48.060235 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.060051    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-offline-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:31:48.060235 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.060060    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf-registry-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:31:48.258450 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.258417    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"]
May 26 00:31:48.261621 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:48.261592    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-6t59p"]
May 26 00:31:49.492077 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:49.492045    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" path="/var/lib/kubelet/pods/a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf/volumes"
May 26 00:31:49.492639 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:31:49.492625    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" path="/var/lib/kubelet/pods/ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d/volumes"
May 26 00:32:06.028231 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:06.028185    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"]
May 26 00:32:06.028695 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:06.028438    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8" podUID="eebe44d6-46e2-4caf-a906-ac7345b44624" containerName="manager" containerID="cri-o://7beb6bd03ab1a3513d4aa007996862355eed1d66ddbde6488830f91a3963e909" gracePeriod=10
May 26 00:32:06.273132 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:06.273108    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"
May 26 00:32:06.308996 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:06.308916    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q597\" (UniqueName: \"kubernetes.io/projected/eebe44d6-46e2-4caf-a906-ac7345b44624-kube-api-access-2q597\") pod \"eebe44d6-46e2-4caf-a906-ac7345b44624\" (UID: \"eebe44d6-46e2-4caf-a906-ac7345b44624\") "
May 26 00:32:06.311188 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:06.311162    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eebe44d6-46e2-4caf-a906-ac7345b44624-kube-api-access-2q597" (OuterVolumeSpecName: "kube-api-access-2q597") pod "eebe44d6-46e2-4caf-a906-ac7345b44624" (UID: "eebe44d6-46e2-4caf-a906-ac7345b44624"). InnerVolumeSpecName "kube-api-access-2q597". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:32:06.410076 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:06.409998    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q597\" (UniqueName: \"kubernetes.io/projected/eebe44d6-46e2-4caf-a906-ac7345b44624-kube-api-access-2q597\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:32:06.992631 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:06.992591    2576 generic.go:358] "Generic (PLEG): container finished" podID="eebe44d6-46e2-4caf-a906-ac7345b44624" containerID="7beb6bd03ab1a3513d4aa007996862355eed1d66ddbde6488830f91a3963e909" exitCode=0
May 26 00:32:06.992808 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:06.992676    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"
May 26 00:32:06.992808 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:06.992679    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8" event={"ID":"eebe44d6-46e2-4caf-a906-ac7345b44624","Type":"ContainerDied","Data":"7beb6bd03ab1a3513d4aa007996862355eed1d66ddbde6488830f91a3963e909"}
May 26 00:32:06.992808 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:06.992716    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8" event={"ID":"eebe44d6-46e2-4caf-a906-ac7345b44624","Type":"ContainerDied","Data":"828ba120edec4b5b4af48cc26238ec575dd3a9e4fbfbc80c650c37c3db888322"}
May 26 00:32:06.992808 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:06.992731    2576 scope.go:117] "RemoveContainer" containerID="7beb6bd03ab1a3513d4aa007996862355eed1d66ddbde6488830f91a3963e909"
May 26 00:32:07.000636 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:07.000614    2576 scope.go:117] "RemoveContainer" containerID="7beb6bd03ab1a3513d4aa007996862355eed1d66ddbde6488830f91a3963e909"
May 26 00:32:07.000924 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:32:07.000903    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7beb6bd03ab1a3513d4aa007996862355eed1d66ddbde6488830f91a3963e909\": container with ID starting with 7beb6bd03ab1a3513d4aa007996862355eed1d66ddbde6488830f91a3963e909 not found: ID does not exist" containerID="7beb6bd03ab1a3513d4aa007996862355eed1d66ddbde6488830f91a3963e909"
May 26 00:32:07.000972 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:07.000933    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7beb6bd03ab1a3513d4aa007996862355eed1d66ddbde6488830f91a3963e909"} err="failed to get container status \"7beb6bd03ab1a3513d4aa007996862355eed1d66ddbde6488830f91a3963e909\": rpc error: code = NotFound desc = could not find container \"7beb6bd03ab1a3513d4aa007996862355eed1d66ddbde6488830f91a3963e909\": container with ID starting with 7beb6bd03ab1a3513d4aa007996862355eed1d66ddbde6488830f91a3963e909 not found: ID does not exist"
May 26 00:32:07.014918 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:07.014895    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"]
May 26 00:32:07.018386 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:07.018363    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-sptf8"]
May 26 00:32:07.491753 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:07.491715    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eebe44d6-46e2-4caf-a906-ac7345b44624" path="/var/lib/kubelet/pods/eebe44d6-46e2-4caf-a906-ac7345b44624/volumes"
May 26 00:32:10.607859 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.607827    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-2m4hw"]
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608138    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="feast-apply"
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608150    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="feast-apply"
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608157    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="feast-apply"
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608162    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="feast-apply"
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608171    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="offline"
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608178    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="offline"
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608187    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="registry"
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608193    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="registry"
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608201    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="feast-init"
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608207    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="feast-init"
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608212    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="online"
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608219    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="online"
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608223    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="offline"
May 26 00:32:10.608230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608229    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="offline"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608240    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="ui"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608246    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="ui"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608253    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eebe44d6-46e2-4caf-a906-ac7345b44624" containerName="manager"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608258    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eebe44d6-46e2-4caf-a906-ac7345b44624" containerName="manager"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608264    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="feast-init"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608268    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="feast-init"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608274    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="ui"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608279    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="ui"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608285    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="online"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608289    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="online"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608345    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="eebe44d6-46e2-4caf-a906-ac7345b44624" containerName="manager"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608352    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="online"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608361    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="offline"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608367    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="offline"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608373    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="ui"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608378    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="ae7c0cfb-2e7d-449f-8c0e-06a5e7654a5d" containerName="online"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608386    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="registry"
May 26 00:32:10.608620 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.608391    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="a8e0a159-ce8d-48ce-8cbf-aed1e9ecd6bf" containerName="ui"
May 26 00:32:10.612563 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.612545    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2m4hw"
May 26 00:32:10.616684 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.616663    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-wzklf\""
May 26 00:32:10.617762 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.617739    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 26 00:32:10.617886 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.617803    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 26 00:32:10.632417 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.632390    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-2m4hw"]
May 26 00:32:10.750231 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.750188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlj42\" (UniqueName: \"kubernetes.io/projected/341bebf6-4f12-4c75-bda0-0ebd1729f3fc-kube-api-access-zlj42\") pod \"feast-operator-controller-manager-cf99db75-2m4hw\" (UID: \"341bebf6-4f12-4c75-bda0-0ebd1729f3fc\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2m4hw"
May 26 00:32:10.850743 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.850704    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlj42\" (UniqueName: \"kubernetes.io/projected/341bebf6-4f12-4c75-bda0-0ebd1729f3fc-kube-api-access-zlj42\") pod \"feast-operator-controller-manager-cf99db75-2m4hw\" (UID: \"341bebf6-4f12-4c75-bda0-0ebd1729f3fc\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2m4hw"
May 26 00:32:10.861615 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.861548    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlj42\" (UniqueName: \"kubernetes.io/projected/341bebf6-4f12-4c75-bda0-0ebd1729f3fc-kube-api-access-zlj42\") pod \"feast-operator-controller-manager-cf99db75-2m4hw\" (UID: \"341bebf6-4f12-4c75-bda0-0ebd1729f3fc\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2m4hw"
May 26 00:32:10.922574 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:10.922536    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2m4hw"
May 26 00:32:11.083080 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:11.083047    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-2m4hw"]
May 26 00:32:11.086367 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:32:11.086339    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341bebf6_4f12_4c75_bda0_0ebd1729f3fc.slice/crio-de6ef84967f5ebf150ae82faac0cee759a7bf9a8a96bddce79188dae7a93bf44 WatchSource:0}: Error finding container de6ef84967f5ebf150ae82faac0cee759a7bf9a8a96bddce79188dae7a93bf44: Status 404 returned error can't find the container with id de6ef84967f5ebf150ae82faac0cee759a7bf9a8a96bddce79188dae7a93bf44
May 26 00:32:11.088387 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:11.088372    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 00:32:12.014763 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:12.014727    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2m4hw" event={"ID":"341bebf6-4f12-4c75-bda0-0ebd1729f3fc","Type":"ContainerStarted","Data":"dde8421e6828097111337c7549ee19e70ecf479760c7cf4f9a6366d06c6711cc"}
May 26 00:32:12.014763 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:12.014763    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2m4hw" event={"ID":"341bebf6-4f12-4c75-bda0-0ebd1729f3fc","Type":"ContainerStarted","Data":"de6ef84967f5ebf150ae82faac0cee759a7bf9a8a96bddce79188dae7a93bf44"}
May 26 00:32:12.015205 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:12.014852    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2m4hw"
May 26 00:32:12.035081 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:12.035035    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2m4hw" podStartSLOduration=2.035001116 podStartE2EDuration="2.035001116s" podCreationTimestamp="2026-05-26 00:32:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:32:12.034054073 +0000 UTC m=+1473.098024960" watchObservedRunningTime="2026-05-26 00:32:12.035001116 +0000 UTC m=+1473.098972003"
May 26 00:32:23.019400 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:23.019370    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-2m4hw"
May 26 00:32:27.458878 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.458841    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"]
May 26 00:32:27.463445 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.463424    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.466292 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.466268    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-g8pj5\""
May 26 00:32:27.466433 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.466329    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 26 00:32:27.466585 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.466566    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 26 00:32:27.466780 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.466760    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 26 00:32:27.466780 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.466779    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 26 00:32:27.466957 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.466943    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 26 00:32:27.467781 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.467754    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 26 00:32:27.473655 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.473504    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"]
May 26 00:32:27.590024 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.589959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8dqs\" (UniqueName: \"kubernetes.io/projected/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-kube-api-access-v8dqs\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.590210 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.590034    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.590210 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.590059    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.590210 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.590157    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.590210 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.590182    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.590210 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.590205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.690909 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.690872    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8dqs\" (UniqueName: \"kubernetes.io/projected/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-kube-api-access-v8dqs\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.690909 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.690911    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.691200 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.690929    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.691200 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.691002    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.691200 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.691053    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.691200 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.691077    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.691478 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.691451    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.693709 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.693674    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.693830 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.693738    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.693830 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.693744    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.693830 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.693779    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.700216 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.700193    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8dqs\" (UniqueName: \"kubernetes.io/projected/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-kube-api-access-v8dqs\") pod \"feast-simple-feast-setup-664fcfcc58-9dsvd\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.786181 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.786147    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:27.924799 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:27.924762    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"]
May 26 00:32:27.927876 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:32:27.927849    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde5c0ed4_6a6c_455e_a1d7_039d30870e1b.slice/crio-a4bc3730e8ab35512a2a479c82fc824252c827d0469b58850fa65ec5eed08bd5 WatchSource:0}: Error finding container a4bc3730e8ab35512a2a479c82fc824252c827d0469b58850fa65ec5eed08bd5: Status 404 returned error can't find the container with id a4bc3730e8ab35512a2a479c82fc824252c827d0469b58850fa65ec5eed08bd5
May 26 00:32:28.064851 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:28.064756    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerStarted","Data":"b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef"}
May 26 00:32:28.064851 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:28.064805    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerStarted","Data":"a4bc3730e8ab35512a2a479c82fc824252c827d0469b58850fa65ec5eed08bd5"}
May 26 00:32:33.084433 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:33.084398    2576 generic.go:358] "Generic (PLEG): container finished" podID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerID="b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef" exitCode=0
May 26 00:32:33.084808 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:33.084466    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerDied","Data":"b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef"}
May 26 00:32:34.089272 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:34.089230    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerStarted","Data":"0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d"}
May 26 00:32:39.107394 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:39.107355    2576 generic.go:358] "Generic (PLEG): container finished" podID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerID="0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d" exitCode=0
May 26 00:32:39.107864 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:39.107407    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerDied","Data":"0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d"}
May 26 00:32:39.533158 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:39.533126    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:32:39.551295 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:39.551271    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:32:40.115069 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:40.114989    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerStarted","Data":"615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424"}
May 26 00:32:40.115630 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:40.115591    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerStarted","Data":"b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49"}
May 26 00:32:40.115785 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:40.115765    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerStarted","Data":"8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a"}
May 26 00:32:40.115909 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:40.115895    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerStarted","Data":"af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67"}
May 26 00:32:40.141188 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:40.141129    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podStartSLOduration=13.141093047 podStartE2EDuration="13.141093047s" podCreationTimestamp="2026-05-26 00:32:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:32:40.138725241 +0000 UTC m=+1501.202696129" watchObservedRunningTime="2026-05-26 00:32:40.141093047 +0000 UTC m=+1501.205063935"
May 26 00:32:42.786750 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:42.786701    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:42.787278 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:42.786765    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:42.787278 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:42.786784    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:42.787278 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:42.786796    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:42.789075 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:42.789033    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.33:8816: connect: connection refused"
May 26 00:32:42.789075 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:42.789058    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
May 26 00:32:42.789298 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:42.789147    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
May 26 00:32:42.789401 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:42.789061    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
May 26 00:32:45.787636 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:45.787603    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:45.788156 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:45.788130    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:45.788241 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:45.788166    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:45.788319 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:45.788267    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:45.788425 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:45.788404    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:45.792401 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:45.792380    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:46.136822 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:46.136730    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:46.136822 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:46.136771    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:46.136822 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:46.136784    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:46.137205 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:46.137186    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:46.137280 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:46.137248    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:32:46.139672 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:32:46.139658    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:33:48.434103 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.434065    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"]
May 26 00:33:48.437673 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.434508    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="registry" containerID="cri-o://af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67" gracePeriod=30
May 26 00:33:48.437673 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.434594    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="offline" containerID="cri-o://b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49" gracePeriod=30
May 26 00:33:48.437673 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.434655    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="online" containerID="cri-o://8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a" gracePeriod=30
May 26 00:33:48.437673 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.434707    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="ui" containerID="cri-o://615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424" gracePeriod=30
May 26 00:33:48.825907 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.825870    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"]
May 26 00:33:48.829853 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.829826    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:48.832871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.832827    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-9wh2s\""
May 26 00:33:48.845376 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.845344    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"]
May 26 00:33:48.920766 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.920708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:48.920978 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.920837    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:48.920978 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.920934    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:48.920978 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.920969    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:48.921188 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.921073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:48.921188 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:48.921158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5hjc\" (UniqueName: \"kubernetes.io/projected/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-kube-api-access-w5hjc\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.022221 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.022174    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5hjc\" (UniqueName: \"kubernetes.io/projected/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-kube-api-access-w5hjc\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.022448 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.022234    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.022448 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.022298    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.022448 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.022348    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.022448 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.022374    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.022448 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.022436    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.022723 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:33:49.022569    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
May 26 00:33:49.022723 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:33:49.022636    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-registry-tls podName:6614878e-6f41-4f0c-95f3-dbd6b1405c2a nodeName:}" failed. No retries permitted until 2026-05-26 00:33:49.522614242 +0000 UTC m=+1570.586585128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-registry-tls") pod "feast-simple-feast-setup-664fcfcc58-nt74s" (UID: "6614878e-6f41-4f0c-95f3-dbd6b1405c2a") : secret "feast-simple-feast-setup-registry-tls" not found
May 26 00:33:49.022902 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:33:49.022874    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 26 00:33:49.023076 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:33:49.022932    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-online-tls podName:6614878e-6f41-4f0c-95f3-dbd6b1405c2a nodeName:}" failed. No retries permitted until 2026-05-26 00:33:49.522915283 +0000 UTC m=+1570.586886170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-online-tls") pod "feast-simple-feast-setup-664fcfcc58-nt74s" (UID: "6614878e-6f41-4f0c-95f3-dbd6b1405c2a") : secret "feast-simple-feast-setup-online-tls" not found
May 26 00:33:49.023076 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:33:49.022992    2576 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 26 00:33:49.023210 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:33:49.023080    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-ui-tls podName:6614878e-6f41-4f0c-95f3-dbd6b1405c2a nodeName:}" failed. No retries permitted until 2026-05-26 00:33:49.523062423 +0000 UTC m=+1570.587033291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-nt74s" (UID: "6614878e-6f41-4f0c-95f3-dbd6b1405c2a") : secret "feast-simple-feast-setup-ui-tls" not found
May 26 00:33:49.023307 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.023286    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.025339 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.025299    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.031943 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.031912    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5hjc\" (UniqueName: \"kubernetes.io/projected/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-kube-api-access-w5hjc\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.330855 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.330816    2576 generic.go:358] "Generic (PLEG): container finished" podID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerID="615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424" exitCode=0
May 26 00:33:49.330855 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.330853    2576 generic.go:358] "Generic (PLEG): container finished" podID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerID="8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a" exitCode=0
May 26 00:33:49.330855 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.330845    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerDied","Data":"615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424"}
May 26 00:33:49.331184 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.330888    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerDied","Data":"8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a"}
May 26 00:33:49.527900 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.527864    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.528409 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.527926    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.528409 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.527956    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.530536 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.530508    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.530705 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.530676    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.530808 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.530676    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-nt74s\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.746838 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.746793    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:33:49.888240 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:49.888212    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"]
May 26 00:33:49.889428 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:33:49.889398    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6614878e_6f41_4f0c_95f3_dbd6b1405c2a.slice/crio-f15aa8ed4d9ea30b7e32dd780a3d3760f1039443681e2453f63112a7bf8323a9 WatchSource:0}: Error finding container f15aa8ed4d9ea30b7e32dd780a3d3760f1039443681e2453f63112a7bf8323a9: Status 404 returned error can't find the container with id f15aa8ed4d9ea30b7e32dd780a3d3760f1039443681e2453f63112a7bf8323a9
May 26 00:33:50.334900 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:50.334860    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerStarted","Data":"af611695d9f7e3307545749719acc8e8de0c71185db12ffe263c128c87556810"}
May 26 00:33:50.334900 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:50.334903    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerStarted","Data":"f15aa8ed4d9ea30b7e32dd780a3d3760f1039443681e2453f63112a7bf8323a9"}
May 26 00:33:55.351076 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:55.351034    2576 generic.go:358] "Generic (PLEG): container finished" podID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerID="af611695d9f7e3307545749719acc8e8de0c71185db12ffe263c128c87556810" exitCode=0
May 26 00:33:55.351498 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:55.351104    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerDied","Data":"af611695d9f7e3307545749719acc8e8de0c71185db12ffe263c128c87556810"}
May 26 00:33:56.136880 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:56.136830    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
May 26 00:33:56.137102 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:56.136895    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
May 26 00:33:56.356096 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:33:56.356058    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerStarted","Data":"22620d6958bcb6347c8f180a15c64a943f27499261cedb4f19a6a3a0dba8a5f7"}
May 26 00:34:01.375730 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:01.375693    2576 generic.go:358] "Generic (PLEG): container finished" podID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerID="22620d6958bcb6347c8f180a15c64a943f27499261cedb4f19a6a3a0dba8a5f7" exitCode=0
May 26 00:34:01.376180 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:01.375751    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerDied","Data":"22620d6958bcb6347c8f180a15c64a943f27499261cedb4f19a6a3a0dba8a5f7"}
May 26 00:34:02.384093 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:02.384052    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerStarted","Data":"c2f16b9855846023537a8d849ee4ffc5957fcba57022c55c64183f9e9e99ac1f"}
May 26 00:34:02.384586 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:02.384108    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerStarted","Data":"28389d2b2d5b7fe5e63674be72c41c680a7f53ddd9f34401c1dc70eecaa11e31"}
May 26 00:34:02.384586 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:02.384127    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerStarted","Data":"082af24ff13a1a2e3370af1a6bd3f4e6e8209798bf2174966cc7585fe3bd7f67"}
May 26 00:34:02.384586 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:02.384140    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerStarted","Data":"7ca15c4f0501b8122333d03635a189bc633995680cbd83f170e9718549b30032"}
May 26 00:34:02.408367 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:02.408307    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podStartSLOduration=14.408288736 podStartE2EDuration="14.408288736s" podCreationTimestamp="2026-05-26 00:33:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:34:02.406143891 +0000 UTC m=+1583.470114776" watchObservedRunningTime="2026-05-26 00:34:02.408288736 +0000 UTC m=+1583.472259625"
May 26 00:34:04.747320 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:04.747266    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:04.747320 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:04.747324    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:04.747866 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:04.747340    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:04.747866 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:04.747352    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:04.749476 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:04.749431    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
May 26 00:34:04.749639 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:04.749465    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.34:8816: connect: connection refused"
May 26 00:34:04.749639 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:04.749482    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
May 26 00:34:04.749639 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:04.749550    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused"
May 26 00:34:06.137796 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:06.137743    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
May 26 00:34:06.138323 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:06.137763    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
May 26 00:34:07.748380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:07.748334    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:07.748777 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:07.748462    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:07.748777 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:07.748638    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:07.748979 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:07.748956    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:07.749152 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:07.748988    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:07.749152 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:07.749003    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:07.749352 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:07.749330    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:07.749459 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:07.749385    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:07.749562 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:07.749546    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:07.752947 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:07.752931    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:08.407027 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:08.406988    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:08.409922 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:08.409895    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:34:16.137633 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:16.137581    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
May 26 00:34:16.138091 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:16.137587    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
May 26 00:34:16.138091 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:16.137729    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:34:16.138091 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:16.137790    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:34:18.640370 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.640344    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:34:18.703397 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.703312    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-feast-data\") pod \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") "
May 26 00:34:18.703397 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.703354    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-online-tls\") pod \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") "
May 26 00:34:18.703397 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.703386    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8dqs\" (UniqueName: \"kubernetes.io/projected/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-kube-api-access-v8dqs\") pod \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") "
May 26 00:34:18.703672 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.703430    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-registry-tls\") pod \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") "
May 26 00:34:18.703672 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.703459    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-ui-tls\") pod \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") "
May 26 00:34:18.703672 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.703483    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-offline-tls\") pod \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\" (UID: \"de5c0ed4-6a6c-455e-a1d7-039d30870e1b\") "
May 26 00:34:18.703963 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.703921    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-feast-data" (OuterVolumeSpecName: "feast-data") pod "de5c0ed4-6a6c-455e-a1d7-039d30870e1b" (UID: "de5c0ed4-6a6c-455e-a1d7-039d30870e1b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:34:18.705938 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.705895    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "de5c0ed4-6a6c-455e-a1d7-039d30870e1b" (UID: "de5c0ed4-6a6c-455e-a1d7-039d30870e1b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:34:18.705938 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.705916    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-online-tls" (OuterVolumeSpecName: "online-tls") pod "de5c0ed4-6a6c-455e-a1d7-039d30870e1b" (UID: "de5c0ed4-6a6c-455e-a1d7-039d30870e1b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:34:18.705938 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.705926    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "de5c0ed4-6a6c-455e-a1d7-039d30870e1b" (UID: "de5c0ed4-6a6c-455e-a1d7-039d30870e1b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:34:18.706222 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.706204    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-kube-api-access-v8dqs" (OuterVolumeSpecName: "kube-api-access-v8dqs") pod "de5c0ed4-6a6c-455e-a1d7-039d30870e1b" (UID: "de5c0ed4-6a6c-455e-a1d7-039d30870e1b"). InnerVolumeSpecName "kube-api-access-v8dqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:34:18.706281 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.706262    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "de5c0ed4-6a6c-455e-a1d7-039d30870e1b" (UID: "de5c0ed4-6a6c-455e-a1d7-039d30870e1b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:34:18.804493 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.804450    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-feast-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:34:18.804493 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.804485    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-online-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:34:18.804493 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.804496    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8dqs\" (UniqueName: \"kubernetes.io/projected/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-kube-api-access-v8dqs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:34:18.804493 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.804506    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-registry-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:34:18.804759 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.804515    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-ui-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:34:18.804759 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:18.804522    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/de5c0ed4-6a6c-455e-a1d7-039d30870e1b-offline-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:34:19.444149 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.444109    2576 generic.go:358] "Generic (PLEG): container finished" podID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerID="b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49" exitCode=137
May 26 00:34:19.444149 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.444143    2576 generic.go:358] "Generic (PLEG): container finished" podID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerID="af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67" exitCode=137
May 26 00:34:19.444377 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.444176    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerDied","Data":"b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49"}
May 26 00:34:19.444377 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.444194    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"
May 26 00:34:19.444377 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.444218    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerDied","Data":"af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67"}
May 26 00:34:19.444377 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.444230    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd" event={"ID":"de5c0ed4-6a6c-455e-a1d7-039d30870e1b","Type":"ContainerDied","Data":"a4bc3730e8ab35512a2a479c82fc824252c827d0469b58850fa65ec5eed08bd5"}
May 26 00:34:19.444377 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.444230    2576 scope.go:117] "RemoveContainer" containerID="615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424"
May 26 00:34:19.453704 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.453682    2576 scope.go:117] "RemoveContainer" containerID="b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49"
May 26 00:34:19.463704 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.463683    2576 scope.go:117] "RemoveContainer" containerID="8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a"
May 26 00:34:19.466432 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.466407    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"]
May 26 00:34:19.470133 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.470110    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-9dsvd"]
May 26 00:34:19.472266 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.472254    2576 scope.go:117] "RemoveContainer" containerID="af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67"
May 26 00:34:19.479538 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.479515    2576 scope.go:117] "RemoveContainer" containerID="0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d"
May 26 00:34:19.486823 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.486791    2576 scope.go:117] "RemoveContainer" containerID="b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef"
May 26 00:34:19.491650 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.491626    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" path="/var/lib/kubelet/pods/de5c0ed4-6a6c-455e-a1d7-039d30870e1b/volumes"
May 26 00:34:19.494501 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.494484    2576 scope.go:117] "RemoveContainer" containerID="615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424"
May 26 00:34:19.494765 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:34:19.494745    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424\": container with ID starting with 615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424 not found: ID does not exist" containerID="615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424"
May 26 00:34:19.494828 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.494773    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424"} err="failed to get container status \"615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424\": rpc error: code = NotFound desc = could not find container \"615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424\": container with ID starting with 615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424 not found: ID does not exist"
May 26 00:34:19.494828 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.494791    2576 scope.go:117] "RemoveContainer" containerID="b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49"
May 26 00:34:19.495061 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:34:19.495039    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49\": container with ID starting with b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49 not found: ID does not exist" containerID="b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49"
May 26 00:34:19.495116 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.495072    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49"} err="failed to get container status \"b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49\": rpc error: code = NotFound desc = could not find container \"b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49\": container with ID starting with b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49 not found: ID does not exist"
May 26 00:34:19.495116 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.495088    2576 scope.go:117] "RemoveContainer" containerID="8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a"
May 26 00:34:19.495336 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:34:19.495319    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a\": container with ID starting with 8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a not found: ID does not exist" containerID="8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a"
May 26 00:34:19.495388 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.495341    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a"} err="failed to get container status \"8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a\": rpc error: code = NotFound desc = could not find container \"8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a\": container with ID starting with 8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a not found: ID does not exist"
May 26 00:34:19.495388 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.495355    2576 scope.go:117] "RemoveContainer" containerID="af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67"
May 26 00:34:19.495586 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:34:19.495566    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67\": container with ID starting with af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67 not found: ID does not exist" containerID="af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67"
May 26 00:34:19.495643 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.495590    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67"} err="failed to get container status \"af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67\": rpc error: code = NotFound desc = could not find container \"af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67\": container with ID starting with af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67 not found: ID does not exist"
May 26 00:34:19.495643 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.495602    2576 scope.go:117] "RemoveContainer" containerID="0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d"
May 26 00:34:19.495809 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:34:19.495777    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d\": container with ID starting with 0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d not found: ID does not exist" containerID="0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d"
May 26 00:34:19.495875 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.495818    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d"} err="failed to get container status \"0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d\": rpc error: code = NotFound desc = could not find container \"0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d\": container with ID starting with 0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d not found: ID does not exist"
May 26 00:34:19.495875 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.495842    2576 scope.go:117] "RemoveContainer" containerID="b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef"
May 26 00:34:19.496062 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:34:19.496042    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef\": container with ID starting with b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef not found: ID does not exist" containerID="b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef"
May 26 00:34:19.496145 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.496066    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef"} err="failed to get container status \"b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef\": rpc error: code = NotFound desc = could not find container \"b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef\": container with ID starting with b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef not found: ID does not exist"
May 26 00:34:19.496145 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.496080    2576 scope.go:117] "RemoveContainer" containerID="615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424"
May 26 00:34:19.496299 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.496281    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424"} err="failed to get container status \"615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424\": rpc error: code = NotFound desc = could not find container \"615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424\": container with ID starting with 615a983fee18ee33b113e3c72b5d14ba4a0f36d81d77d647422255fc345cd424 not found: ID does not exist"
May 26 00:34:19.496355 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.496301    2576 scope.go:117] "RemoveContainer" containerID="b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49"
May 26 00:34:19.496493 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.496477    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49"} err="failed to get container status \"b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49\": rpc error: code = NotFound desc = could not find container \"b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49\": container with ID starting with b89bf657af4906dbeb373bd40de61b0ac40cd6fa60aa9f8ba7e5c4a8f4f3ed49 not found: ID does not exist"
May 26 00:34:19.496551 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.496494    2576 scope.go:117] "RemoveContainer" containerID="8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a"
May 26 00:34:19.496674 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.496653    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a"} err="failed to get container status \"8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a\": rpc error: code = NotFound desc = could not find container \"8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a\": container with ID starting with 8b4d7318c0c1fb19c120e40b1bb15e0cb6d51daabd7f839e7dbbdc7642adeb4a not found: ID does not exist"
May 26 00:34:19.496719 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.496677    2576 scope.go:117] "RemoveContainer" containerID="af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67"
May 26 00:34:19.496880 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.496863    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67"} err="failed to get container status \"af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67\": rpc error: code = NotFound desc = could not find container \"af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67\": container with ID starting with af2dc00cbd973a5225c56e0a612333567eaa1e1be1d99f47e27ff054d0cf3f67 not found: ID does not exist"
May 26 00:34:19.496922 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.496881    2576 scope.go:117] "RemoveContainer" containerID="0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d"
May 26 00:34:19.497118 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.497095    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d"} err="failed to get container status \"0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d\": rpc error: code = NotFound desc = could not find container \"0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d\": container with ID starting with 0666cefb15c9a5c4ada54ba8deafd085ed28fa9c3465187969548b9fc5643d4d not found: ID does not exist"
May 26 00:34:19.497118 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.497117    2576 scope.go:117] "RemoveContainer" containerID="b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef"
May 26 00:34:19.497324 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:34:19.497308    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef"} err="failed to get container status \"b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef\": rpc error: code = NotFound desc = could not find container \"b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef\": container with ID starting with b3fd0ecda367a816b974d01c89699928164a51f0651e662c479a9249d64cb1ef not found: ID does not exist"
May 26 00:35:10.260906 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.260874    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"]
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261206    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="registry"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261218    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="registry"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261229    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="feast-init"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261235    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="feast-init"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261243    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="ui"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261247    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="ui"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261253    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="online"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261259    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="online"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261273    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="feast-apply"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261279    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="feast-apply"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261289    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="offline"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261295    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="offline"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261346    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="online"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261354    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="offline"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261361    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="ui"
May 26 00:35:10.261380 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.261368    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="de5c0ed4-6a6c-455e-a1d7-039d30870e1b" containerName="registry"
May 26 00:35:10.264698 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.264668    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.267230 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.267200    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 26 00:35:10.267378 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.267268    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 26 00:35:10.267378 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.267357    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-bdtfx\""
May 26 00:35:10.267489 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.267425    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 26 00:35:10.267545 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.267495    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 26 00:35:10.268392 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.268366    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 26 00:35:10.268509 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.268432    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 26 00:35:10.274863 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.274840    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"]
May 26 00:35:10.360288 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.360246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2wp4\" (UniqueName: \"kubernetes.io/projected/517d394d-4433-47c4-a2c7-7d99626fdfd2-kube-api-access-h2wp4\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.360288 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.360299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/517d394d-4433-47c4-a2c7-7d99626fdfd2-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.360519 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.360369    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.360519 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.360409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/517d394d-4433-47c4-a2c7-7d99626fdfd2-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.360519 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.360434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.360519 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.360452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.461357 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.461320    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.461357 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.461358    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.461586 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.461409    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wp4\" (UniqueName: \"kubernetes.io/projected/517d394d-4433-47c4-a2c7-7d99626fdfd2-kube-api-access-h2wp4\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.461586 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.461436    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/517d394d-4433-47c4-a2c7-7d99626fdfd2-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.461586 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.461490    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.461586 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:35:10.461551    2576 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
May 26 00:35:10.461788 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:35:10.461631    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-online-tls podName:517d394d-4433-47c4-a2c7-7d99626fdfd2 nodeName:}" failed. No retries permitted until 2026-05-26 00:35:10.961610307 +0000 UTC m=+1652.025581192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-online-tls") pod "feast-simple-feast-remote-setup-5cff94746b-5kqv9" (UID: "517d394d-4433-47c4-a2c7-7d99626fdfd2") : secret "feast-simple-feast-remote-setup-online-tls" not found
May 26 00:35:10.461788 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.461764    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/517d394d-4433-47c4-a2c7-7d99626fdfd2-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.462111 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.462086    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/517d394d-4433-47c4-a2c7-7d99626fdfd2-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.462588 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.462564    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/517d394d-4433-47c4-a2c7-7d99626fdfd2-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.464108 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.464081    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.464204 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.464178    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.469963 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.469939    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2wp4\" (UniqueName: \"kubernetes.io/projected/517d394d-4433-47c4-a2c7-7d99626fdfd2-kube-api-access-h2wp4\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.965240 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.965207    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:10.967792 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:10.967766    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-5kqv9\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:11.175708 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:11.175666    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:11.315832 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:11.315796    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"]
May 26 00:35:11.317430 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:35:11.317404    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod517d394d_4433_47c4_a2c7_7d99626fdfd2.slice/crio-f0ef1ee4d847eed9b90ac281428cbf0ec72beb312236ef6b6c986a9952f3ca79 WatchSource:0}: Error finding container f0ef1ee4d847eed9b90ac281428cbf0ec72beb312236ef6b6c986a9952f3ca79: Status 404 returned error can't find the container with id f0ef1ee4d847eed9b90ac281428cbf0ec72beb312236ef6b6c986a9952f3ca79
May 26 00:35:11.603181 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:11.603141    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" event={"ID":"517d394d-4433-47c4-a2c7-7d99626fdfd2","Type":"ContainerStarted","Data":"7fa59b1bda23619683f7dc56518ea8dd5525c2c8e3cb2c7b337c8be38ec9a48c"}
May 26 00:35:11.604185 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:11.603395    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" event={"ID":"517d394d-4433-47c4-a2c7-7d99626fdfd2","Type":"ContainerStarted","Data":"f0ef1ee4d847eed9b90ac281428cbf0ec72beb312236ef6b6c986a9952f3ca79"}
May 26 00:35:16.619734 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:16.619697    2576 generic.go:358] "Generic (PLEG): container finished" podID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerID="7fa59b1bda23619683f7dc56518ea8dd5525c2c8e3cb2c7b337c8be38ec9a48c" exitCode=0
May 26 00:35:16.620218 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:16.619773    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" event={"ID":"517d394d-4433-47c4-a2c7-7d99626fdfd2","Type":"ContainerDied","Data":"7fa59b1bda23619683f7dc56518ea8dd5525c2c8e3cb2c7b337c8be38ec9a48c"}
May 26 00:35:17.625229 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:17.625188    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" event={"ID":"517d394d-4433-47c4-a2c7-7d99626fdfd2","Type":"ContainerStarted","Data":"085b127490502b0ac0ec59791b29fc8602074ae0cb3165f9f369e27a19db8548"}
May 26 00:35:22.642087 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:22.641981    2576 generic.go:358] "Generic (PLEG): container finished" podID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerID="085b127490502b0ac0ec59791b29fc8602074ae0cb3165f9f369e27a19db8548" exitCode=0
May 26 00:35:22.642087 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:22.642057    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" event={"ID":"517d394d-4433-47c4-a2c7-7d99626fdfd2","Type":"ContainerDied","Data":"085b127490502b0ac0ec59791b29fc8602074ae0cb3165f9f369e27a19db8548"}
May 26 00:35:23.649065 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:23.649007    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" event={"ID":"517d394d-4433-47c4-a2c7-7d99626fdfd2","Type":"ContainerStarted","Data":"10b0e3f3af8c6079557f7573c613cae3365b38230c8728bf8bdf5b34ddd7f9c5"}
May 26 00:35:23.649537 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:23.649074    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" event={"ID":"517d394d-4433-47c4-a2c7-7d99626fdfd2","Type":"ContainerStarted","Data":"22a416e6c97f09454ae31a766e0c1fa0899a781c519b351374cddeebbd433517"}
May 26 00:35:23.649537 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:23.649108    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" event={"ID":"517d394d-4433-47c4-a2c7-7d99626fdfd2","Type":"ContainerStarted","Data":"c3e5997acadcaedc6f49b53503a6846034867ce2ed312a2439098fd419f4b240"}
May 26 00:35:23.673781 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:23.673720    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" podStartSLOduration=13.673702757000001 podStartE2EDuration="13.673702757s" podCreationTimestamp="2026-05-26 00:35:10 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:35:23.672229395 +0000 UTC m=+1664.736200282" watchObservedRunningTime="2026-05-26 00:35:23.673702757 +0000 UTC m=+1664.737673644"
May 26 00:35:26.176678 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:26.176632    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:26.177093 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:26.176695    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:26.177093 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:26.176709    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:26.178474 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:26.178433    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
May 26 00:35:26.178474 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:26.178451    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.35:8816: connect: connection refused"
May 26 00:35:26.178672 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:26.178498    2576 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
May 26 00:35:29.177314 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:29.177277    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:29.177773 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:29.177476    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:29.177874 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:29.177853    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:29.177939 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:29.177888    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:29.178137 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:29.178118    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:29.178189 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:29.178173    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:29.181765 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:29.181747    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:29.670509 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:29.670479    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:35:29.673439 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:35:29.673413    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:36:31.180240 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:31.180205    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"]
May 26 00:36:31.180928 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:31.180755    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="ui" containerID="cri-o://10b0e3f3af8c6079557f7573c613cae3365b38230c8728bf8bdf5b34ddd7f9c5" gracePeriod=30
May 26 00:36:31.180928 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:31.180628    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="online" containerID="cri-o://c3e5997acadcaedc6f49b53503a6846034867ce2ed312a2439098fd419f4b240" gracePeriod=30
May 26 00:36:31.180928 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:31.180860    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="offline" containerID="cri-o://22a416e6c97f09454ae31a766e0c1fa0899a781c519b351374cddeebbd433517" gracePeriod=30
May 26 00:36:31.373344 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:31.373305    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"]
May 26 00:36:31.373823 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:31.373766    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="registry" containerID="cri-o://7ca15c4f0501b8122333d03635a189bc633995680cbd83f170e9718549b30032" gracePeriod=30
May 26 00:36:31.374040 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:31.373810    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="ui" containerID="cri-o://c2f16b9855846023537a8d849ee4ffc5957fcba57022c55c64183f9e9e99ac1f" gracePeriod=30
May 26 00:36:31.374153 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:31.373810    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="offline" containerID="cri-o://28389d2b2d5b7fe5e63674be72c41c680a7f53ddd9f34401c1dc70eecaa11e31" gracePeriod=30
May 26 00:36:31.374316 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:31.373815    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="online" containerID="cri-o://082af24ff13a1a2e3370af1a6bd3f4e6e8209798bf2174966cc7585fe3bd7f67" gracePeriod=30
May 26 00:36:31.857767 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:31.857736    2576 generic.go:358] "Generic (PLEG): container finished" podID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerID="10b0e3f3af8c6079557f7573c613cae3365b38230c8728bf8bdf5b34ddd7f9c5" exitCode=0
May 26 00:36:31.857887 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:31.857821    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" event={"ID":"517d394d-4433-47c4-a2c7-7d99626fdfd2","Type":"ContainerDied","Data":"10b0e3f3af8c6079557f7573c613cae3365b38230c8728bf8bdf5b34ddd7f9c5"}
May 26 00:36:32.863090 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:32.863056    2576 generic.go:358] "Generic (PLEG): container finished" podID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerID="c2f16b9855846023537a8d849ee4ffc5957fcba57022c55c64183f9e9e99ac1f" exitCode=0
May 26 00:36:32.863090 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:32.863081    2576 generic.go:358] "Generic (PLEG): container finished" podID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerID="082af24ff13a1a2e3370af1a6bd3f4e6e8209798bf2174966cc7585fe3bd7f67" exitCode=0
May 26 00:36:32.863744 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:32.863129    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerDied","Data":"c2f16b9855846023537a8d849ee4ffc5957fcba57022c55c64183f9e9e99ac1f"}
May 26 00:36:32.863744 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:32.863166    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerDied","Data":"082af24ff13a1a2e3370af1a6bd3f4e6e8209798bf2174966cc7585fe3bd7f67"}
May 26 00:36:32.865426 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:32.865397    2576 generic.go:358] "Generic (PLEG): container finished" podID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerID="c3e5997acadcaedc6f49b53503a6846034867ce2ed312a2439098fd419f4b240" exitCode=0
May 26 00:36:32.865532 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:32.865436    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" event={"ID":"517d394d-4433-47c4-a2c7-7d99626fdfd2","Type":"ContainerDied","Data":"c3e5997acadcaedc6f49b53503a6846034867ce2ed312a2439098fd419f4b240"}
May 26 00:36:37.749923 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:37.749871    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
May 26 00:36:38.407930 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:38.407879    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
May 26 00:36:39.178273 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:39.178229    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
May 26 00:36:39.671653 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:39.671606    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
May 26 00:36:47.749270 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:47.749218    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
May 26 00:36:48.407566 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:48.407522    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
May 26 00:36:49.178556 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:49.178506    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
May 26 00:36:49.670761 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:49.670711    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
May 26 00:36:57.749734 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:57.749681    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
May 26 00:36:57.750200 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:57.749849    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:36:58.407681 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:58.407641    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
May 26 00:36:58.407871 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:58.407750    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:36:59.178827 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:59.178778    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
May 26 00:36:59.179299 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:59.178936    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:36:59.671437 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:59.671396    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
May 26 00:36:59.671644 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:36:59.671527    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:37:01.833630 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.833604    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:37:01.950679 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.950602    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/517d394d-4433-47c4-a2c7-7d99626fdfd2-registry-tls\") pod \"517d394d-4433-47c4-a2c7-7d99626fdfd2\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") "
May 26 00:37:01.950837 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.950688    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2wp4\" (UniqueName: \"kubernetes.io/projected/517d394d-4433-47c4-a2c7-7d99626fdfd2-kube-api-access-h2wp4\") pod \"517d394d-4433-47c4-a2c7-7d99626fdfd2\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") "
May 26 00:37:01.950837 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.950725    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-ui-tls\") pod \"517d394d-4433-47c4-a2c7-7d99626fdfd2\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") "
May 26 00:37:01.950837 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.950761    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-offline-tls\") pod \"517d394d-4433-47c4-a2c7-7d99626fdfd2\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") "
May 26 00:37:01.950837 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.950797    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-online-tls\") pod \"517d394d-4433-47c4-a2c7-7d99626fdfd2\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") "
May 26 00:37:01.951094 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.950847    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/517d394d-4433-47c4-a2c7-7d99626fdfd2-feast-data\") pod \"517d394d-4433-47c4-a2c7-7d99626fdfd2\" (UID: \"517d394d-4433-47c4-a2c7-7d99626fdfd2\") "
May 26 00:37:01.951094 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.951052    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/517d394d-4433-47c4-a2c7-7d99626fdfd2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "517d394d-4433-47c4-a2c7-7d99626fdfd2" (UID: "517d394d-4433-47c4-a2c7-7d99626fdfd2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 00:37:01.951205 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.951168    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/517d394d-4433-47c4-a2c7-7d99626fdfd2-registry-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:01.952460 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.952423    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/517d394d-4433-47c4-a2c7-7d99626fdfd2-feast-data" (OuterVolumeSpecName: "feast-data") pod "517d394d-4433-47c4-a2c7-7d99626fdfd2" (UID: "517d394d-4433-47c4-a2c7-7d99626fdfd2"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:37:01.954826 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.954772    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "517d394d-4433-47c4-a2c7-7d99626fdfd2" (UID: "517d394d-4433-47c4-a2c7-7d99626fdfd2"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:37:01.954826 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.954788    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/517d394d-4433-47c4-a2c7-7d99626fdfd2-kube-api-access-h2wp4" (OuterVolumeSpecName: "kube-api-access-h2wp4") pod "517d394d-4433-47c4-a2c7-7d99626fdfd2" (UID: "517d394d-4433-47c4-a2c7-7d99626fdfd2"). InnerVolumeSpecName "kube-api-access-h2wp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:37:01.956651 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.956626    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "517d394d-4433-47c4-a2c7-7d99626fdfd2" (UID: "517d394d-4433-47c4-a2c7-7d99626fdfd2"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:37:01.956765 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.956720    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-online-tls" (OuterVolumeSpecName: "online-tls") pod "517d394d-4433-47c4-a2c7-7d99626fdfd2" (UID: "517d394d-4433-47c4-a2c7-7d99626fdfd2"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:37:01.957963 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.957939    2576 generic.go:358] "Generic (PLEG): container finished" podID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerID="22a416e6c97f09454ae31a766e0c1fa0899a781c519b351374cddeebbd433517" exitCode=137
May 26 00:37:01.958077 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.958059    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" event={"ID":"517d394d-4433-47c4-a2c7-7d99626fdfd2","Type":"ContainerDied","Data":"22a416e6c97f09454ae31a766e0c1fa0899a781c519b351374cddeebbd433517"}
May 26 00:37:01.958134 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.958099    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9" event={"ID":"517d394d-4433-47c4-a2c7-7d99626fdfd2","Type":"ContainerDied","Data":"f0ef1ee4d847eed9b90ac281428cbf0ec72beb312236ef6b6c986a9952f3ca79"}
May 26 00:37:01.958134 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.958113    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"
May 26 00:37:01.958134 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.958121    2576 scope.go:117] "RemoveContainer" containerID="10b0e3f3af8c6079557f7573c613cae3365b38230c8728bf8bdf5b34ddd7f9c5"
May 26 00:37:01.961547 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.961519    2576 generic.go:358] "Generic (PLEG): container finished" podID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerID="28389d2b2d5b7fe5e63674be72c41c680a7f53ddd9f34401c1dc70eecaa11e31" exitCode=137
May 26 00:37:01.961661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.961549    2576 generic.go:358] "Generic (PLEG): container finished" podID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerID="7ca15c4f0501b8122333d03635a189bc633995680cbd83f170e9718549b30032" exitCode=137
May 26 00:37:01.961661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.961603    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerDied","Data":"28389d2b2d5b7fe5e63674be72c41c680a7f53ddd9f34401c1dc70eecaa11e31"}
May 26 00:37:01.961661 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.961642    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerDied","Data":"7ca15c4f0501b8122333d03635a189bc633995680cbd83f170e9718549b30032"}
May 26 00:37:01.972082 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.969652    2576 scope.go:117] "RemoveContainer" containerID="22a416e6c97f09454ae31a766e0c1fa0899a781c519b351374cddeebbd433517"
May 26 00:37:01.982844 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.982817    2576 scope.go:117] "RemoveContainer" containerID="c3e5997acadcaedc6f49b53503a6846034867ce2ed312a2439098fd419f4b240"
May 26 00:37:01.992080 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.992052    2576 scope.go:117] "RemoveContainer" containerID="085b127490502b0ac0ec59791b29fc8602074ae0cb3165f9f369e27a19db8548"
May 26 00:37:01.992573 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.992543    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"]
May 26 00:37:01.994595 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.994572    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-5kqv9"]
May 26 00:37:02.000049 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:01.999998    2576 scope.go:117] "RemoveContainer" containerID="7fa59b1bda23619683f7dc56518ea8dd5525c2c8e3cb2c7b337c8be38ec9a48c"
May 26 00:37:02.007574 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.007553    2576 scope.go:117] "RemoveContainer" containerID="10b0e3f3af8c6079557f7573c613cae3365b38230c8728bf8bdf5b34ddd7f9c5"
May 26 00:37:02.007875 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:37:02.007855    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b0e3f3af8c6079557f7573c613cae3365b38230c8728bf8bdf5b34ddd7f9c5\": container with ID starting with 10b0e3f3af8c6079557f7573c613cae3365b38230c8728bf8bdf5b34ddd7f9c5 not found: ID does not exist" containerID="10b0e3f3af8c6079557f7573c613cae3365b38230c8728bf8bdf5b34ddd7f9c5"
May 26 00:37:02.007948 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.007890    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b0e3f3af8c6079557f7573c613cae3365b38230c8728bf8bdf5b34ddd7f9c5"} err="failed to get container status \"10b0e3f3af8c6079557f7573c613cae3365b38230c8728bf8bdf5b34ddd7f9c5\": rpc error: code = NotFound desc = could not find container \"10b0e3f3af8c6079557f7573c613cae3365b38230c8728bf8bdf5b34ddd7f9c5\": container with ID starting with 10b0e3f3af8c6079557f7573c613cae3365b38230c8728bf8bdf5b34ddd7f9c5 not found: ID does not exist"
May 26 00:37:02.007948 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.007912    2576 scope.go:117] "RemoveContainer" containerID="22a416e6c97f09454ae31a766e0c1fa0899a781c519b351374cddeebbd433517"
May 26 00:37:02.008265 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:37:02.008248    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22a416e6c97f09454ae31a766e0c1fa0899a781c519b351374cddeebbd433517\": container with ID starting with 22a416e6c97f09454ae31a766e0c1fa0899a781c519b351374cddeebbd433517 not found: ID does not exist" containerID="22a416e6c97f09454ae31a766e0c1fa0899a781c519b351374cddeebbd433517"
May 26 00:37:02.008335 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.008273    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22a416e6c97f09454ae31a766e0c1fa0899a781c519b351374cddeebbd433517"} err="failed to get container status \"22a416e6c97f09454ae31a766e0c1fa0899a781c519b351374cddeebbd433517\": rpc error: code = NotFound desc = could not find container \"22a416e6c97f09454ae31a766e0c1fa0899a781c519b351374cddeebbd433517\": container with ID starting with 22a416e6c97f09454ae31a766e0c1fa0899a781c519b351374cddeebbd433517 not found: ID does not exist"
May 26 00:37:02.008335 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.008290    2576 scope.go:117] "RemoveContainer" containerID="c3e5997acadcaedc6f49b53503a6846034867ce2ed312a2439098fd419f4b240"
May 26 00:37:02.008559 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:37:02.008539    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3e5997acadcaedc6f49b53503a6846034867ce2ed312a2439098fd419f4b240\": container with ID starting with c3e5997acadcaedc6f49b53503a6846034867ce2ed312a2439098fd419f4b240 not found: ID does not exist" containerID="c3e5997acadcaedc6f49b53503a6846034867ce2ed312a2439098fd419f4b240"
May 26 00:37:02.008649 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.008564    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3e5997acadcaedc6f49b53503a6846034867ce2ed312a2439098fd419f4b240"} err="failed to get container status \"c3e5997acadcaedc6f49b53503a6846034867ce2ed312a2439098fd419f4b240\": rpc error: code = NotFound desc = could not find container \"c3e5997acadcaedc6f49b53503a6846034867ce2ed312a2439098fd419f4b240\": container with ID starting with c3e5997acadcaedc6f49b53503a6846034867ce2ed312a2439098fd419f4b240 not found: ID does not exist"
May 26 00:37:02.008649 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.008579    2576 scope.go:117] "RemoveContainer" containerID="085b127490502b0ac0ec59791b29fc8602074ae0cb3165f9f369e27a19db8548"
May 26 00:37:02.008844 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:37:02.008824    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"085b127490502b0ac0ec59791b29fc8602074ae0cb3165f9f369e27a19db8548\": container with ID starting with 085b127490502b0ac0ec59791b29fc8602074ae0cb3165f9f369e27a19db8548 not found: ID does not exist" containerID="085b127490502b0ac0ec59791b29fc8602074ae0cb3165f9f369e27a19db8548"
May 26 00:37:02.008909 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.008858    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"085b127490502b0ac0ec59791b29fc8602074ae0cb3165f9f369e27a19db8548"} err="failed to get container status \"085b127490502b0ac0ec59791b29fc8602074ae0cb3165f9f369e27a19db8548\": rpc error: code = NotFound desc = could not find container \"085b127490502b0ac0ec59791b29fc8602074ae0cb3165f9f369e27a19db8548\": container with ID starting with 085b127490502b0ac0ec59791b29fc8602074ae0cb3165f9f369e27a19db8548 not found: ID does not exist"
May 26 00:37:02.008909 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.008874    2576 scope.go:117] "RemoveContainer" containerID="7fa59b1bda23619683f7dc56518ea8dd5525c2c8e3cb2c7b337c8be38ec9a48c"
May 26 00:37:02.009160 ip-10-0-134-90 kubenswrapper[2576]: E0526 00:37:02.009141    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fa59b1bda23619683f7dc56518ea8dd5525c2c8e3cb2c7b337c8be38ec9a48c\": container with ID starting with 7fa59b1bda23619683f7dc56518ea8dd5525c2c8e3cb2c7b337c8be38ec9a48c not found: ID does not exist" containerID="7fa59b1bda23619683f7dc56518ea8dd5525c2c8e3cb2c7b337c8be38ec9a48c"
May 26 00:37:02.009235 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.009163    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fa59b1bda23619683f7dc56518ea8dd5525c2c8e3cb2c7b337c8be38ec9a48c"} err="failed to get container status \"7fa59b1bda23619683f7dc56518ea8dd5525c2c8e3cb2c7b337c8be38ec9a48c\": rpc error: code = NotFound desc = could not find container \"7fa59b1bda23619683f7dc56518ea8dd5525c2c8e3cb2c7b337c8be38ec9a48c\": container with ID starting with 7fa59b1bda23619683f7dc56518ea8dd5525c2c8e3cb2c7b337c8be38ec9a48c not found: ID does not exist"
May 26 00:37:02.019402 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.019384    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:37:02.052433 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.052396    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2wp4\" (UniqueName: \"kubernetes.io/projected/517d394d-4433-47c4-a2c7-7d99626fdfd2-kube-api-access-h2wp4\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:02.052593 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.052436    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-ui-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:02.052593 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.052454    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-offline-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:02.052593 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.052468    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/517d394d-4433-47c4-a2c7-7d99626fdfd2-online-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:02.052593 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.052479    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/517d394d-4433-47c4-a2c7-7d99626fdfd2-feast-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:02.153331 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.153301    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-offline-tls\") pod \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") "
May 26 00:37:02.153518 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.153342    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-ui-tls\") pod \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") "
May 26 00:37:02.153518 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.153367    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-online-tls\") pod \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") "
May 26 00:37:02.153518 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.153406    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5hjc\" (UniqueName: \"kubernetes.io/projected/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-kube-api-access-w5hjc\") pod \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") "
May 26 00:37:02.153518 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.153439    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-registry-tls\") pod \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") "
May 26 00:37:02.153518 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.153488    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-feast-data\") pod \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\" (UID: \"6614878e-6f41-4f0c-95f3-dbd6b1405c2a\") "
May 26 00:37:02.154465 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.154247    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-feast-data" (OuterVolumeSpecName: "feast-data") pod "6614878e-6f41-4f0c-95f3-dbd6b1405c2a" (UID: "6614878e-6f41-4f0c-95f3-dbd6b1405c2a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:37:02.155698 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.155668    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "6614878e-6f41-4f0c-95f3-dbd6b1405c2a" (UID: "6614878e-6f41-4f0c-95f3-dbd6b1405c2a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:37:02.155918 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.155895    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-kube-api-access-w5hjc" (OuterVolumeSpecName: "kube-api-access-w5hjc") pod "6614878e-6f41-4f0c-95f3-dbd6b1405c2a" (UID: "6614878e-6f41-4f0c-95f3-dbd6b1405c2a"). InnerVolumeSpecName "kube-api-access-w5hjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:37:02.156073 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.156046    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6614878e-6f41-4f0c-95f3-dbd6b1405c2a" (UID: "6614878e-6f41-4f0c-95f3-dbd6b1405c2a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:37:02.156247 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.156231    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "6614878e-6f41-4f0c-95f3-dbd6b1405c2a" (UID: "6614878e-6f41-4f0c-95f3-dbd6b1405c2a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:37:02.156301 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.156252    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-online-tls" (OuterVolumeSpecName: "online-tls") pod "6614878e-6f41-4f0c-95f3-dbd6b1405c2a" (UID: "6614878e-6f41-4f0c-95f3-dbd6b1405c2a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 00:37:02.254905 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.254793    2576 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-feast-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:02.254905 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.254844    2576 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-offline-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:02.254905 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.254854    2576 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-ui-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:02.254905 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.254863    2576 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-online-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:02.254905 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.254871    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5hjc\" (UniqueName: \"kubernetes.io/projected/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-kube-api-access-w5hjc\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:02.254905 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.254881    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/6614878e-6f41-4f0c-95f3-dbd6b1405c2a-registry-tls\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:02.969988 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.969955    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s" event={"ID":"6614878e-6f41-4f0c-95f3-dbd6b1405c2a","Type":"ContainerDied","Data":"f15aa8ed4d9ea30b7e32dd780a3d3760f1039443681e2453f63112a7bf8323a9"}
May 26 00:37:02.969988 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.969973    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"
May 26 00:37:02.970498 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.970001    2576 scope.go:117] "RemoveContainer" containerID="c2f16b9855846023537a8d849ee4ffc5957fcba57022c55c64183f9e9e99ac1f"
May 26 00:37:02.978905 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.978886    2576 scope.go:117] "RemoveContainer" containerID="28389d2b2d5b7fe5e63674be72c41c680a7f53ddd9f34401c1dc70eecaa11e31"
May 26 00:37:02.986097 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.986073    2576 scope.go:117] "RemoveContainer" containerID="082af24ff13a1a2e3370af1a6bd3f4e6e8209798bf2174966cc7585fe3bd7f67"
May 26 00:37:02.994068 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.994043    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"]
May 26 00:37:02.994364 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.994343    2576 scope.go:117] "RemoveContainer" containerID="7ca15c4f0501b8122333d03635a189bc633995680cbd83f170e9718549b30032"
May 26 00:37:02.997449 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:02.997425    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-nt74s"]
May 26 00:37:03.001903 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:03.001885    2576 scope.go:117] "RemoveContainer" containerID="22620d6958bcb6347c8f180a15c64a943f27499261cedb4f19a6a3a0dba8a5f7"
May 26 00:37:03.008827 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:03.008811    2576 scope.go:117] "RemoveContainer" containerID="af611695d9f7e3307545749719acc8e8de0c71185db12ffe263c128c87556810"
May 26 00:37:03.491364 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:03.491327    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" path="/var/lib/kubelet/pods/517d394d-4433-47c4-a2c7-7d99626fdfd2/volumes"
May 26 00:37:03.491867 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:03.491854    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" path="/var/lib/kubelet/pods/6614878e-6f41-4f0c-95f3-dbd6b1405c2a/volumes"
May 26 00:37:20.316878 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.316842    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-knnc7/must-gather-fb4kx"]
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317183    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="online"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317197    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="online"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317206    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="registry"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317213    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="registry"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317222    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="ui"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317227    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="ui"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317234    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="offline"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317239    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="offline"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317245    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="ui"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317249    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="ui"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317257    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="feast-apply"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317262    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="feast-apply"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317275    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="offline"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317280    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="offline"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317286    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="feast-init"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317290    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="feast-init"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317295    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="feast-apply"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317299    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="feast-apply"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317306    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="online"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317311    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="online"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317317    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="feast-init"
May 26 00:37:20.317345 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317321    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="feast-init"
May 26 00:37:20.318102 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317364    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="online"
May 26 00:37:20.318102 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317372    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="offline"
May 26 00:37:20.318102 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317380    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="517d394d-4433-47c4-a2c7-7d99626fdfd2" containerName="ui"
May 26 00:37:20.318102 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317386    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="offline"
May 26 00:37:20.318102 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317393    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="online"
May 26 00:37:20.318102 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317399    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="registry"
May 26 00:37:20.318102 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.317405    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6614878e-6f41-4f0c-95f3-dbd6b1405c2a" containerName="ui"
May 26 00:37:20.320421 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.320402    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knnc7/must-gather-fb4kx"
May 26 00:37:20.323689 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.323664    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-knnc7\"/\"openshift-service-ca.crt\""
May 26 00:37:20.324849 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.324830    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-knnc7\"/\"default-dockercfg-mjqqv\""
May 26 00:37:20.324898 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.324847    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-knnc7\"/\"kube-root-ca.crt\""
May 26 00:37:20.328419 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.328395    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knnc7/must-gather-fb4kx"]
May 26 00:37:20.510842 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.510800    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f80de681-8c77-47f8-88e6-729bc548914b-must-gather-output\") pod \"must-gather-fb4kx\" (UID: \"f80de681-8c77-47f8-88e6-729bc548914b\") " pod="openshift-must-gather-knnc7/must-gather-fb4kx"
May 26 00:37:20.511064 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.510922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6w5k\" (UniqueName: \"kubernetes.io/projected/f80de681-8c77-47f8-88e6-729bc548914b-kube-api-access-f6w5k\") pod \"must-gather-fb4kx\" (UID: \"f80de681-8c77-47f8-88e6-729bc548914b\") " pod="openshift-must-gather-knnc7/must-gather-fb4kx"
May 26 00:37:20.612361 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.612272    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f6w5k\" (UniqueName: \"kubernetes.io/projected/f80de681-8c77-47f8-88e6-729bc548914b-kube-api-access-f6w5k\") pod \"must-gather-fb4kx\" (UID: \"f80de681-8c77-47f8-88e6-729bc548914b\") " pod="openshift-must-gather-knnc7/must-gather-fb4kx"
May 26 00:37:20.612361 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.612339    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f80de681-8c77-47f8-88e6-729bc548914b-must-gather-output\") pod \"must-gather-fb4kx\" (UID: \"f80de681-8c77-47f8-88e6-729bc548914b\") " pod="openshift-must-gather-knnc7/must-gather-fb4kx"
May 26 00:37:20.612641 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.612624    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f80de681-8c77-47f8-88e6-729bc548914b-must-gather-output\") pod \"must-gather-fb4kx\" (UID: \"f80de681-8c77-47f8-88e6-729bc548914b\") " pod="openshift-must-gather-knnc7/must-gather-fb4kx"
May 26 00:37:20.620948 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.620922    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6w5k\" (UniqueName: \"kubernetes.io/projected/f80de681-8c77-47f8-88e6-729bc548914b-kube-api-access-f6w5k\") pod \"must-gather-fb4kx\" (UID: \"f80de681-8c77-47f8-88e6-729bc548914b\") " pod="openshift-must-gather-knnc7/must-gather-fb4kx"
May 26 00:37:20.638898 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.638869    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knnc7/must-gather-fb4kx"
May 26 00:37:20.772153 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.772125    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-knnc7/must-gather-fb4kx"]
May 26 00:37:20.774880 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:37:20.774841    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf80de681_8c77_47f8_88e6_729bc548914b.slice/crio-f0b9af61de9cd15425721f141015309e2d18f00fc1ab9058e22a81c65e723759 WatchSource:0}: Error finding container f0b9af61de9cd15425721f141015309e2d18f00fc1ab9058e22a81c65e723759: Status 404 returned error can't find the container with id f0b9af61de9cd15425721f141015309e2d18f00fc1ab9058e22a81c65e723759
May 26 00:37:20.776576 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:20.776559    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 00:37:21.032365 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:21.032324    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knnc7/must-gather-fb4kx" event={"ID":"f80de681-8c77-47f8-88e6-729bc548914b","Type":"ContainerStarted","Data":"f0b9af61de9cd15425721f141015309e2d18f00fc1ab9058e22a81c65e723759"}
May 26 00:37:27.057930 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:27.057894    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knnc7/must-gather-fb4kx" event={"ID":"f80de681-8c77-47f8-88e6-729bc548914b","Type":"ContainerStarted","Data":"74b289240bfee8006de57ce7719b5c2796c7211e28f64898885104c51e0ee792"}
May 26 00:37:28.068776 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:28.068731    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knnc7/must-gather-fb4kx" event={"ID":"f80de681-8c77-47f8-88e6-729bc548914b","Type":"ContainerStarted","Data":"e8acb7c9e594cef64c1dfe77705124c06e36d3a56611cf692052fdd792eeb8e9"}
May 26 00:37:28.085268 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:28.085212    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-knnc7/must-gather-fb4kx" podStartSLOduration=2.01990829 podStartE2EDuration="8.085197145s" podCreationTimestamp="2026-05-26 00:37:20 +0000 UTC" firstStartedPulling="2026-05-26 00:37:20.776711043 +0000 UTC m=+1781.840681908" lastFinishedPulling="2026-05-26 00:37:26.841999887 +0000 UTC m=+1787.905970763" observedRunningTime="2026-05-26 00:37:28.083290146 +0000 UTC m=+1789.147261032" watchObservedRunningTime="2026-05-26 00:37:28.085197145 +0000 UTC m=+1789.149168032"
May 26 00:37:37.097772 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:37.097734    2576 generic.go:358] "Generic (PLEG): container finished" podID="f80de681-8c77-47f8-88e6-729bc548914b" containerID="74b289240bfee8006de57ce7719b5c2796c7211e28f64898885104c51e0ee792" exitCode=0
May 26 00:37:37.098322 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:37.097817    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-knnc7/must-gather-fb4kx" event={"ID":"f80de681-8c77-47f8-88e6-729bc548914b","Type":"ContainerDied","Data":"74b289240bfee8006de57ce7719b5c2796c7211e28f64898885104c51e0ee792"}
May 26 00:37:37.098322 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:37.098274    2576 scope.go:117] "RemoveContainer" containerID="74b289240bfee8006de57ce7719b5c2796c7211e28f64898885104c51e0ee792"
May 26 00:37:37.585083 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:37.585059    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-knnc7_must-gather-fb4kx_f80de681-8c77-47f8-88e6-729bc548914b/gather/0.log"
May 26 00:37:39.593548 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:39.593519    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:37:39.597658 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:39.597636    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:37:40.622462 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:40.622418    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hpkbr_88963404-bad9-4411-8b30-b5f169b7ff47/global-pull-secret-syncer/0.log"
May 26 00:37:40.780891 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:40.780855    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vqbhq_0b5bec4e-eac6-4433-8127-c273c08bce50/konnectivity-agent/0.log"
May 26 00:37:40.820988 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:40.820957    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-90.ec2.internal_ce4a613030626295f96eac475acc9709/haproxy/0.log"
May 26 00:37:42.905106 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:42.905068    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-knnc7/must-gather-fb4kx"]
May 26 00:37:42.905769 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:42.905739    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-must-gather-knnc7/must-gather-fb4kx" podUID="f80de681-8c77-47f8-88e6-729bc548914b" containerName="copy" containerID="cri-o://e8acb7c9e594cef64c1dfe77705124c06e36d3a56611cf692052fdd792eeb8e9" gracePeriod=2
May 26 00:37:42.907276 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:42.907251    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-knnc7/must-gather-fb4kx"]
May 26 00:37:42.908286 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:42.908261    2576 status_manager.go:895] "Failed to get status for pod" podUID="f80de681-8c77-47f8-88e6-729bc548914b" pod="openshift-must-gather-knnc7/must-gather-fb4kx" err="pods \"must-gather-fb4kx\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-knnc7\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object"
May 26 00:37:43.119892 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:43.119869    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-knnc7_must-gather-fb4kx_f80de681-8c77-47f8-88e6-729bc548914b/copy/0.log"
May 26 00:37:43.120255 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:43.120231    2576 generic.go:358] "Generic (PLEG): container finished" podID="f80de681-8c77-47f8-88e6-729bc548914b" containerID="e8acb7c9e594cef64c1dfe77705124c06e36d3a56611cf692052fdd792eeb8e9" exitCode=143
May 26 00:37:43.138930 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:43.138909    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-knnc7_must-gather-fb4kx_f80de681-8c77-47f8-88e6-729bc548914b/copy/0.log"
May 26 00:37:43.139287 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:43.139271    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knnc7/must-gather-fb4kx"
May 26 00:37:43.141582 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:43.141557    2576 status_manager.go:895] "Failed to get status for pod" podUID="f80de681-8c77-47f8-88e6-729bc548914b" pod="openshift-must-gather-knnc7/must-gather-fb4kx" err="pods \"must-gather-fb4kx\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-knnc7\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object"
May 26 00:37:43.215213 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:43.215130    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6w5k\" (UniqueName: \"kubernetes.io/projected/f80de681-8c77-47f8-88e6-729bc548914b-kube-api-access-f6w5k\") pod \"f80de681-8c77-47f8-88e6-729bc548914b\" (UID: \"f80de681-8c77-47f8-88e6-729bc548914b\") "
May 26 00:37:43.215213 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:43.215202    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f80de681-8c77-47f8-88e6-729bc548914b-must-gather-output\") pod \"f80de681-8c77-47f8-88e6-729bc548914b\" (UID: \"f80de681-8c77-47f8-88e6-729bc548914b\") "
May 26 00:37:43.215621 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:43.215592    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f80de681-8c77-47f8-88e6-729bc548914b-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "f80de681-8c77-47f8-88e6-729bc548914b" (UID: "f80de681-8c77-47f8-88e6-729bc548914b"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 00:37:43.217599 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:43.217574    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f80de681-8c77-47f8-88e6-729bc548914b-kube-api-access-f6w5k" (OuterVolumeSpecName: "kube-api-access-f6w5k") pod "f80de681-8c77-47f8-88e6-729bc548914b" (UID: "f80de681-8c77-47f8-88e6-729bc548914b"). InnerVolumeSpecName "kube-api-access-f6w5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 00:37:43.316228 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:43.316179    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6w5k\" (UniqueName: \"kubernetes.io/projected/f80de681-8c77-47f8-88e6-729bc548914b-kube-api-access-f6w5k\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:43.316228 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:43.316224    2576 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f80de681-8c77-47f8-88e6-729bc548914b-must-gather-output\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
May 26 00:37:43.491214 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:43.491137    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f80de681-8c77-47f8-88e6-729bc548914b" path="/var/lib/kubelet/pods/f80de681-8c77-47f8-88e6-729bc548914b/volumes"
May 26 00:37:44.086546 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.086513    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9844eae-07db-493b-bf99-5501e98d00e3/alertmanager/0.log"
May 26 00:37:44.106688 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.106661    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9844eae-07db-493b-bf99-5501e98d00e3/config-reloader/0.log"
May 26 00:37:44.124451 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.124424    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-knnc7_must-gather-fb4kx_f80de681-8c77-47f8-88e6-729bc548914b/copy/0.log"
May 26 00:37:44.124632 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.124573    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9844eae-07db-493b-bf99-5501e98d00e3/kube-rbac-proxy-web/0.log"
May 26 00:37:44.124833 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.124819    2576 scope.go:117] "RemoveContainer" containerID="e8acb7c9e594cef64c1dfe77705124c06e36d3a56611cf692052fdd792eeb8e9"
May 26 00:37:44.124895 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.124822    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-knnc7/must-gather-fb4kx"
May 26 00:37:44.132423 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.132388    2576 scope.go:117] "RemoveContainer" containerID="74b289240bfee8006de57ce7719b5c2796c7211e28f64898885104c51e0ee792"
May 26 00:37:44.146279 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.146259    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9844eae-07db-493b-bf99-5501e98d00e3/kube-rbac-proxy/0.log"
May 26 00:37:44.166538 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.166513    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9844eae-07db-493b-bf99-5501e98d00e3/kube-rbac-proxy-metric/0.log"
May 26 00:37:44.186467 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.186440    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9844eae-07db-493b-bf99-5501e98d00e3/prom-label-proxy/0.log"
May 26 00:37:44.207244 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.207222    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9844eae-07db-493b-bf99-5501e98d00e3/init-config-reloader/0.log"
May 26 00:37:44.392593 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.392516    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8gspp_3c856369-c954-42a2-a717-09a592caca0e/node-exporter/0.log"
May 26 00:37:44.416660 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.416633    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8gspp_3c856369-c954-42a2-a717-09a592caca0e/kube-rbac-proxy/0.log"
May 26 00:37:44.434789 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.434768    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8gspp_3c856369-c954-42a2-a717-09a592caca0e/init-textfile/0.log"
May 26 00:37:44.881908 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.881880    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f89745d5-pvclv_61fa891c-e05b-45c5-b657-cc7a931bf435/telemeter-client/0.log"
May 26 00:37:44.910300 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.910272    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f89745d5-pvclv_61fa891c-e05b-45c5-b657-cc7a931bf435/reload/0.log"
May 26 00:37:44.931763 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.931700    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-f89745d5-pvclv_61fa891c-e05b-45c5-b657-cc7a931bf435/kube-rbac-proxy/0.log"
May 26 00:37:44.962254 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.962222    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-789bbb7b74-2c7vb_db937438-6699-4e04-a119-f0550284118d/thanos-query/0.log"
May 26 00:37:44.988203 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:44.988175    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-789bbb7b74-2c7vb_db937438-6699-4e04-a119-f0550284118d/kube-rbac-proxy-web/0.log"
May 26 00:37:45.014283 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:45.014253    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-789bbb7b74-2c7vb_db937438-6699-4e04-a119-f0550284118d/kube-rbac-proxy/0.log"
May 26 00:37:45.039654 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:45.039626    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-789bbb7b74-2c7vb_db937438-6699-4e04-a119-f0550284118d/prom-label-proxy/0.log"
May 26 00:37:45.068247 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:45.068226    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-789bbb7b74-2c7vb_db937438-6699-4e04-a119-f0550284118d/kube-rbac-proxy-rules/0.log"
May 26 00:37:45.087273 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:45.087248    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-789bbb7b74-2c7vb_db937438-6699-4e04-a119-f0550284118d/kube-rbac-proxy-metrics/0.log"
May 26 00:37:46.106133 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:46.106102    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-wkkkl_fbfc458a-55ce-41f9-a2e9-64046ca53997/networking-console-plugin/0.log"
May 26 00:37:46.473225 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:46.473121    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/2.log"
May 26 00:37:46.477286 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:46.477250    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-rhr6z_489e63ab-8393-4061-9e58-b90fdf908129/console-operator/3.log"
May 26 00:37:46.780170 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:46.780128    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-798f444dc6-82j2m_20c6fcc2-fa43-408c-a369-9e9a8225f19a/console/0.log"
May 26 00:37:46.805835 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:46.805808    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-z4vkc_9e060e16-2a7e-4edf-9837-a6d7690476df/download-server/0.log"
May 26 00:37:47.043423 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.043331    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"]
May 26 00:37:47.043751 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.043733    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f80de681-8c77-47f8-88e6-729bc548914b" containerName="copy"
May 26 00:37:47.043827 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.043755    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f80de681-8c77-47f8-88e6-729bc548914b" containerName="copy"
May 26 00:37:47.043827 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.043789    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f80de681-8c77-47f8-88e6-729bc548914b" containerName="gather"
May 26 00:37:47.043827 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.043798    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f80de681-8c77-47f8-88e6-729bc548914b" containerName="gather"
May 26 00:37:47.043983 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.043878    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="f80de681-8c77-47f8-88e6-729bc548914b" containerName="copy"
May 26 00:37:47.043983 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.043891    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="f80de681-8c77-47f8-88e6-729bc548914b" containerName="gather"
May 26 00:37:47.047157 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.047134    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.049930 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.049908    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-55vjt\"/\"openshift-service-ca.crt\""
May 26 00:37:47.051076 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.051056    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-55vjt\"/\"kube-root-ca.crt\""
May 26 00:37:47.051173 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.051063    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-55vjt\"/\"default-dockercfg-4868d\""
May 26 00:37:47.056064 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.056042    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"]
May 26 00:37:47.148397 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.148365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f385b7d-f9e1-4ffd-a120-618568a8cc94-sys\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.148397 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.148402    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f385b7d-f9e1-4ffd-a120-618568a8cc94-lib-modules\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.148813 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.148431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn6b9\" (UniqueName: \"kubernetes.io/projected/7f385b7d-f9e1-4ffd-a120-618568a8cc94-kube-api-access-dn6b9\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.148813 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.148464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7f385b7d-f9e1-4ffd-a120-618568a8cc94-podres\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.148813 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.148513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7f385b7d-f9e1-4ffd-a120-618568a8cc94-proc\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.249489 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.249454    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f385b7d-f9e1-4ffd-a120-618568a8cc94-sys\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.249489 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.249485    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f385b7d-f9e1-4ffd-a120-618568a8cc94-lib-modules\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.249721 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.249513    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dn6b9\" (UniqueName: \"kubernetes.io/projected/7f385b7d-f9e1-4ffd-a120-618568a8cc94-kube-api-access-dn6b9\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.249721 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.249553    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7f385b7d-f9e1-4ffd-a120-618568a8cc94-podres\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.249721 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.249580    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7f385b7d-f9e1-4ffd-a120-618568a8cc94-proc\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.249721 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.249585    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7f385b7d-f9e1-4ffd-a120-618568a8cc94-sys\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.249721 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.249643    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7f385b7d-f9e1-4ffd-a120-618568a8cc94-lib-modules\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.249721 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.249655    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7f385b7d-f9e1-4ffd-a120-618568a8cc94-proc\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.249721 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.249677    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7f385b7d-f9e1-4ffd-a120-618568a8cc94-podres\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.257590 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.257565    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn6b9\" (UniqueName: \"kubernetes.io/projected/7f385b7d-f9e1-4ffd-a120-618568a8cc94-kube-api-access-dn6b9\") pod \"perf-node-gather-daemonset-tszxt\" (UID: \"7f385b7d-f9e1-4ffd-a120-618568a8cc94\") " pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.357737 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.357637    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:47.485034 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.484995    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"]
May 26 00:37:47.487653 ip-10-0-134-90 kubenswrapper[2576]: W0526 00:37:47.487619    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7f385b7d_f9e1_4ffd_a120_618568a8cc94.slice/crio-f762e20af0123a446c04d62077228f1a3b65bdd52d6c397dc29caaae9f0e432d WatchSource:0}: Error finding container f762e20af0123a446c04d62077228f1a3b65bdd52d6c397dc29caaae9f0e432d: Status 404 returned error can't find the container with id f762e20af0123a446c04d62077228f1a3b65bdd52d6c397dc29caaae9f0e432d
May 26 00:37:47.827027 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.826989    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qswhg_b88f291f-1680-43a6-8740-229cf439c90d/dns/0.log"
May 26 00:37:47.844167 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.844141    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qswhg_b88f291f-1680-43a6-8740-229cf439c90d/kube-rbac-proxy/0.log"
May 26 00:37:47.901283 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:47.901249    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4gsm7_ae9fbcfc-8941-4ba7-9f93-894158483ffe/dns-node-resolver/0.log"
May 26 00:37:48.138748 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:48.138656    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt" event={"ID":"7f385b7d-f9e1-4ffd-a120-618568a8cc94","Type":"ContainerStarted","Data":"d101e4b376c18e25014205bab0b8de99b038dd059e4e069ad77d71d58c5b5519"}
May 26 00:37:48.138748 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:48.138696    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt" event={"ID":"7f385b7d-f9e1-4ffd-a120-618568a8cc94","Type":"ContainerStarted","Data":"f762e20af0123a446c04d62077228f1a3b65bdd52d6c397dc29caaae9f0e432d"}
May 26 00:37:48.138974 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:48.138784    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:48.155385 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:48.155337    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt" podStartSLOduration=1.155323482 podStartE2EDuration="1.155323482s" podCreationTimestamp="2026-05-26 00:37:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 00:37:48.153314891 +0000 UTC m=+1809.217285778" watchObservedRunningTime="2026-05-26 00:37:48.155323482 +0000 UTC m=+1809.219294368"
May 26 00:37:48.310575 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:48.310545    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-868bc5c65b-blwhp_7d3b611b-3ea0-46db-a265-5d3d46b9f222/registry/0.log"
May 26 00:37:48.347407 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:48.347379    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b65d9_8baf0394-fbc4-46b5-b59f-99e4b3eb5221/node-ca/0.log"
May 26 00:37:49.015977 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:49.015949    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-d6445459d-246wn_7072f138-1367-4c4b-b1d7-77c96cfb5fdb/router/0.log"
May 26 00:37:49.361963 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:49.361879    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zj7t4_b19d258d-73bb-4e9b-aafa-b59379cbbe09/serve-healthcheck-canary/0.log"
May 26 00:37:49.684476 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:49.684381    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-627zg_c93fbefe-89d4-4b5a-9403-192340b41e89/insights-operator/0.log"
May 26 00:37:49.684476 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:49.684386    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-627zg_c93fbefe-89d4-4b5a-9403-192340b41e89/insights-operator/1.log"
May 26 00:37:49.820526 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:49.820495    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wcqc6_e24198f1-dc69-4514-b6c6-8bc63a9713a8/kube-rbac-proxy/0.log"
May 26 00:37:49.842729 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:49.842699    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wcqc6_e24198f1-dc69-4514-b6c6-8bc63a9713a8/exporter/0.log"
May 26 00:37:49.860504 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:49.860478    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wcqc6_e24198f1-dc69-4514-b6c6-8bc63a9713a8/extractor/0.log"
May 26 00:37:53.917210 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:53.917175    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-sbzt8_935c5842-1124-421f-9642-8984f62c9e00/kube-storage-version-migrator-operator/1.log"
May 26 00:37:53.918073 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:53.918054    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-sbzt8_935c5842-1124-421f-9642-8984f62c9e00/kube-storage-version-migrator-operator/0.log"
May 26 00:37:54.152212 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:54.152180    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-55vjt/perf-node-gather-daemonset-tszxt"
May 26 00:37:55.046491 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:55.046456    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v99mr_70ca1622-3e99-47c4-a3a3-336fdcc4fb44/kube-multus-additional-cni-plugins/0.log"
May 26 00:37:55.066225 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:55.066197    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v99mr_70ca1622-3e99-47c4-a3a3-336fdcc4fb44/egress-router-binary-copy/0.log"
May 26 00:37:55.084542 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:55.084511    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v99mr_70ca1622-3e99-47c4-a3a3-336fdcc4fb44/cni-plugins/0.log"
May 26 00:37:55.102674 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:55.102646    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v99mr_70ca1622-3e99-47c4-a3a3-336fdcc4fb44/bond-cni-plugin/0.log"
May 26 00:37:55.122293 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:55.122267    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v99mr_70ca1622-3e99-47c4-a3a3-336fdcc4fb44/routeoverride-cni/0.log"
May 26 00:37:55.140050 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:55.139999    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v99mr_70ca1622-3e99-47c4-a3a3-336fdcc4fb44/whereabouts-cni-bincopy/0.log"
May 26 00:37:55.156855 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:55.156830    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v99mr_70ca1622-3e99-47c4-a3a3-336fdcc4fb44/whereabouts-cni/0.log"
May 26 00:37:55.210904 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:55.210868    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xc77d_d7ed538b-bd88-43f3-bd08-34ff2b41a9e0/kube-multus/0.log"
May 26 00:37:55.252922 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:55.252890    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dflxx_df89838f-af5c-4ca8-af8e-9dcfe5f6c321/network-metrics-daemon/0.log"
May 26 00:37:55.268761 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:55.268719    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dflxx_df89838f-af5c-4ca8-af8e-9dcfe5f6c321/kube-rbac-proxy/0.log"
May 26 00:37:55.992595 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:55.992562    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcsmb_b1b775b7-78b6-4102-b790-0042cef57e40/ovn-controller/0.log"
May 26 00:37:56.015678 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:56.015648    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcsmb_b1b775b7-78b6-4102-b790-0042cef57e40/ovn-acl-logging/0.log"
May 26 00:37:56.031589 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:56.031566    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcsmb_b1b775b7-78b6-4102-b790-0042cef57e40/kube-rbac-proxy-node/0.log"
May 26 00:37:56.050597 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:56.050574    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcsmb_b1b775b7-78b6-4102-b790-0042cef57e40/kube-rbac-proxy-ovn-metrics/0.log"
May 26 00:37:56.066227 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:56.066209    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcsmb_b1b775b7-78b6-4102-b790-0042cef57e40/northd/0.log"
May 26 00:37:56.084268 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:56.084241    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcsmb_b1b775b7-78b6-4102-b790-0042cef57e40/nbdb/0.log"
May 26 00:37:56.101333 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:56.101310    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcsmb_b1b775b7-78b6-4102-b790-0042cef57e40/sbdb/0.log"
May 26 00:37:56.185949 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:56.185919    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcsmb_b1b775b7-78b6-4102-b790-0042cef57e40/ovnkube-controller/0.log"
May 26 00:37:57.865760 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:57.865679    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-5kth8_4f1376ca-33ab-4866-9065-c5fae5729ae5/network-check-target-container/0.log"
May 26 00:37:58.749684 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:58.749657    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-nmzkz_5a9ad5dd-740f-4630-867f-a7b36f95f973/iptables-alerter/0.log"
May 26 00:37:59.369800 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:37:59.369774    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-2m2xf_12db9477-2602-4003-b9bd-74c5c3d9c563/tuned/0.log"
May 26 00:38:02.129080 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:38:02.129052    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-67d667c7d-hwkgm_fc922f3e-bf50-4971-9c52-7800dcecb800/service-ca-controller/0.log"
May 26 00:38:02.588904 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:38:02.588874    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-xd8mt_95a4ba2c-6a84-4c47-8fb6-2e6268896081/csi-driver/0.log"
May 26 00:38:02.607583 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:38:02.607555    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-xd8mt_95a4ba2c-6a84-4c47-8fb6-2e6268896081/csi-node-driver-registrar/0.log"
May 26 00:38:02.627355 ip-10-0-134-90 kubenswrapper[2576]: I0526 00:38:02.627325    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-xd8mt_95a4ba2c-6a84-4c47-8fb6-2e6268896081/csi-liveness-probe/0.log"