May 28 16:04:53.697696 ip-10-0-134-100 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 16:04:53.697709 ip-10-0-134-100 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 16:04:53.697718 ip-10-0-134-100 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 16:04:53.698060 ip-10-0-134-100 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 16:05:03.718775 ip-10-0-134-100 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 16:05:03.718794 ip-10-0-134-100 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3bb5e6477840478d975958fe5ead0ba2 --
May 28 16:07:33.877940 ip-10-0-134-100 systemd[1]: Starting Kubernetes Kubelet...
May 28 16:07:34.304041 ip-10-0-134-100 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 16:07:34.304041 ip-10-0-134-100 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 16:07:34.304041 ip-10-0-134-100 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 16:07:34.304041 ip-10-0-134-100 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 16:07:34.304041 ip-10-0-134-100 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 16:07:34.305524 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.305432    2556 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 16:07:34.308181 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308166    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:07:34.308181 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308180    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308184    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308189    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308191    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308194    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308198    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308200    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308203    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308206    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308209    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308212    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308214    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308217    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308224    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308227    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308230    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308233    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308235    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308238    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308241    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:07:34.308240 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308244    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308247    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308250    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308253    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308256    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308259    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308261    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308264    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308267    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308269    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308272    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308274    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308277    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308280    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308283    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308285    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308288    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308290    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308293    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308295    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:07:34.308727 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308297    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308300    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308302    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308305    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308307    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308309    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308312    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308314    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308319    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308323    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308326    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308329    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308332    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308335    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308339    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308342    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308345    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308348    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308351    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:07:34.309262 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308354    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308357    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308360    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308363    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308365    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308368    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308373    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308376    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308379    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308381    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308385    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308389    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308391    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308394    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308396    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308399    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308401    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308404    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308406    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308409    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:07:34.309747 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308411    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308414    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308417    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308419    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308422    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308424    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308821    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308827    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308831    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308834    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308837    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308840    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308844    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308847    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308851    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308854    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308857    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308859    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308869    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:07:34.310223 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308871    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308874    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308877    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308880    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308882    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308885    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308887    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308890    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308892    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308895    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308897    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308900    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308902    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308905    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308907    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308910    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308912    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308915    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308917    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308920    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:07:34.310776 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308923    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308926    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308929    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308931    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308934    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308936    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308939    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308941    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308944    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308946    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308949    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308951    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308959    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308962    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308967    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308970    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308973    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308975    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308978    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308980    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:07:34.311275 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308982    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308985    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308988    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308990    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308995    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.308998    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309001    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309004    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309007    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309009    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309012    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309014    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309018    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309021    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309023    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309026    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309029    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309031    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309034    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309036    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:07:34.311799 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309039    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309041    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309043    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309046    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309048    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309060    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309063    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309065    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309068    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309070    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309073    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309076    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.309078    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309860    2556 flags.go:64] FLAG: --address="0.0.0.0"
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309869    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309875    2556 flags.go:64] FLAG: --anonymous-auth="true"
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309880    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309884    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309888    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309892    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309897    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 16:07:34.312282 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309900    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309903    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309907    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309911    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309914    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309917    2556 flags.go:64] FLAG: --cgroup-root=""
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309920    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309923    2556 flags.go:64] FLAG: --client-ca-file=""
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309927    2556 flags.go:64] FLAG: --cloud-config=""
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309930    2556 flags.go:64] FLAG: --cloud-provider="external"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309933    2556 flags.go:64] FLAG: --cluster-dns="[]"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309937    2556 flags.go:64] FLAG: --cluster-domain=""
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309940    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309943    2556 flags.go:64] FLAG: --config-dir=""
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309946    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309949    2556 flags.go:64] FLAG: --container-log-max-files="5"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309953    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309963    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309967    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309970    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309973    2556 flags.go:64] FLAG: --contention-profiling="false"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309976    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309979    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309982    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309985    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 16:07:34.312825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309994    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.309997    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310000    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310003    2556 flags.go:64] FLAG: --enable-load-reader="false"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310006    2556 flags.go:64] FLAG: --enable-server="true"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310009    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310013    2556 flags.go:64] FLAG: --event-burst="100"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310016    2556 flags.go:64] FLAG: --event-qps="50"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310019    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310023    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310026    2556 flags.go:64] FLAG: --eviction-hard=""
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310030    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310033    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310036    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310039    2556 flags.go:64] FLAG: --eviction-soft=""
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310042    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310044    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310047    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310050    2556 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310053    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310056    2556 flags.go:64] FLAG: --fail-swap-on="true"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310059    2556 flags.go:64] FLAG: --feature-gates=""
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310064    2556 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310067    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310070    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 16:07:34.313438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310074    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310077    2556 flags.go:64] FLAG: --healthz-port="10248"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310080    2556 flags.go:64] FLAG: --help="false"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310083    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-134-100.ec2.internal"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310086    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310089    2556 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310092    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310095    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310099    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310102    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310105    2556 flags.go:64] FLAG: --image-service-endpoint=""
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310109    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310112    2556 flags.go:64] FLAG: --kube-api-burst="100"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310115    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310119    2556 flags.go:64] FLAG: --kube-api-qps="50"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310121    2556 flags.go:64] FLAG: --kube-reserved=""
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310124    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310127    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310130    2556 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310133    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310136    2556 flags.go:64] FLAG: --lock-file=""
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310139    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310141    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310145    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 16:07:34.314063 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310150    2556 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310153    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310156    2556 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310159    2556 flags.go:64] FLAG: --logging-format="text"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310162    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310165    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310168    2556 flags.go:64] FLAG: --manifest-url=""
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310171    2556 flags.go:64] FLAG: --manifest-url-header=""
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310178    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310184    2556 flags.go:64] FLAG: --max-open-files="1000000"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310188    2556 flags.go:64] FLAG: --max-pods="110"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310191    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310194    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310197    2556 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310200    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310203    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310205    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310208    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310216    2556 flags.go:64] FLAG: --node-status-max-images="50"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310220    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310223    2556 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310226    2556 flags.go:64] FLAG: --pod-cidr=""
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310229    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 16:07:34.314632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310235    2556 flags.go:64] FLAG: --pod-manifest-path=""
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310239    2556 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310242    2556 flags.go:64] FLAG: --pods-per-core="0"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310245    2556 flags.go:64] FLAG: --port="10250"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310248    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310251    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07b5a18088964f313"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310254    2556 flags.go:64] FLAG: --qos-reserved=""
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310257    2556 flags.go:64] FLAG: --read-only-port="10255"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310260    2556 flags.go:64] FLAG: --register-node="true"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310263    2556 flags.go:64] FLAG: --register-schedulable="true"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310266    2556 flags.go:64] FLAG: --register-with-taints=""
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310270    2556 flags.go:64] FLAG: --registry-burst="10"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310272    2556 flags.go:64] FLAG: --registry-qps="5"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310275    2556 flags.go:64] FLAG: --reserved-cpus=""
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310278    2556 flags.go:64] FLAG: --reserved-memory=""
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310282    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310285    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310288    2556 flags.go:64] FLAG: --rotate-certificates="false"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310291    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310300    2556 flags.go:64] FLAG: --runonce="false"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310303    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310306    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310309    2556 flags.go:64] FLAG: --seccomp-default="false"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310312    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310315    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310318    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 16:07:34.315200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310321    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310324    2556 flags.go:64] FLAG: --storage-driver-password="root"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310327    2556 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310331    2556 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310334    2556 flags.go:64] FLAG: --storage-driver-user="root"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310336    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310339    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310342    2556 flags.go:64] FLAG: --system-cgroups=""
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310345    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310350    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310353    2556 flags.go:64] FLAG: --tls-cert-file=""
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310358    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310364    2556 flags.go:64] FLAG: --tls-min-version=""
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310367    2556 flags.go:64] FLAG: --tls-private-key-file=""
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310370    2556 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310373    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310376    2556 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310379    2556 flags.go:64] FLAG: --v="2"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310383    2556 flags.go:64] FLAG: --version="false"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310387    2556 flags.go:64] FLAG: --vmodule=""
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310392    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310395    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310484    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310488    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:07:34.315832 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310492    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310494    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310498    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310501    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310504    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310506    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310509    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310512    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310515    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310518    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310520    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310525    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310528    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310530    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310533    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310535    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310538    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310541    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310543    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310547    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:07:34.316420 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310550    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310552    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310555    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310558    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310561    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310563    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310567    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310569    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310572    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310574    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310577    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310579    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310582    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310585    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310587    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310590    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310593    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310595    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310598    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310601    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:07:34.316982 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310603    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310606    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310608    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310612    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310615    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310617    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310620    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310622    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310625    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310628    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310631    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310636    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310639    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310642    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310645    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310647    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310650    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310652    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310655    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:07:34.317464 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310657    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310660    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310662    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310665    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310668    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310687    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310692    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310696    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310699    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310703    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310706    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310708    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310711    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310714    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310716    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310719    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310723    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310726    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310728    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310731    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:07:34.317945 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310734    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310738    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310741    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310745    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.310748    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.310754    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.318068    2556 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.318084    2556 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318133    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318139    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318143    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318147    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318152    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318155    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:07:34.318447 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318158    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318161    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318164    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318167    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318169    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318172    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318175    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318178    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318180    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318183    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318186    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318189    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318191    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318194    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318196    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318199    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318201    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318203    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318206    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318209    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:07:34.318859 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318211    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318214    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318217    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318219    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318222    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318227    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318231    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318234    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318237    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318240    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318242    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318245    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318247    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318250    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318252    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318255    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318257    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318260    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318262    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318264    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:07:34.319352 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318267    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318270    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318272    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318275    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318278    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318280    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318283    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318285    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318288    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318290    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318293    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318295    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318298    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318300    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318303    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318306    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318308    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318312    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318315    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318318    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:07:34.319867 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318320    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318323    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318325    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318328    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318331    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318333    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318336    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318338    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318341    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318343    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318346    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318348    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318351    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318353    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318356    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318358    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318361    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318364    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318366    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:07:34.320361 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318369    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.318374    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318462    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318466    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318470    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318472    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318475    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318479    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318482    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318484    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318487    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318490    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318494    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318497    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318499    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318502    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:07:34.320857 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318504    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318507    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318510    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318512    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318515    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318518    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318520    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318523    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318525    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318528    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318530    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318534    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318538    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318541    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318544    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318548    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318551    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318554    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318556    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:07:34.321265 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318559    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318562    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318564    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318567    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318569    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318572    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318574    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318577    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318580    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318582    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318585    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318588    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318590    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318593    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318595    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318598    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318600    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318603    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318605    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:07:34.321737 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318607    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318610    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318612    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318615    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318617    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318620    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318622    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318625    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318628    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318631    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318634    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318636    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318639    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318641    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318644    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318646    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318648    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318651    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318654    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318656    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:07:34.322212 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318659    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318661    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318664    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318666    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318684    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318688    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318691    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318693    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318696    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318698    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318701    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318703    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318706    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:34.318708    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.318713    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 16:07:34.322789 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.319379    2556 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 16:07:34.325855 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.325842    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 16:07:34.326718 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.326691    2556 server.go:1019] "Starting client certificate rotation"
May 28 16:07:34.326810 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.326794    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 16:07:34.326843 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.326831    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 16:07:34.348904 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.348884    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 16:07:34.354116 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.354094    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 16:07:34.367027 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.367007    2556 log.go:25] "Validated CRI v1 runtime API"
May 28 16:07:34.372007 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.371993    2556 log.go:25] "Validated CRI v1 image API"
May 28 16:07:34.373918 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.373904    2556 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 16:07:34.377592 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.377566    2556 fs.go:135] Filesystem UUIDs: map[6f31fc18-3f0e-42ce-bb95-3f2cd1075730:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ffe84ad4-d621-4c24-9a98-8678115eeb67:/dev/nvme0n1p4]
May 28 16:07:34.377684 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.377591    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 16:07:34.380522 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.380503    2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 16:07:34.382291 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.382183    2556 manager.go:217] Machine: {Timestamp:2026-05-28 16:07:34.381690673 +0000 UTC m=+0.391071289 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100138 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec263e5feffcff3f998a6858a3392cf8 SystemUUID:ec263e5f-effc-ff3f-998a-6858a3392cf8 BootID:3bb5e647-7840-478d-9759-58fe5ead0ba2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:db:64:55:06:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:db:64:55:06:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:05:41:0a:a8:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 16:07:34.382834 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.382824    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 16:07:34.382908 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.382897    2556 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 16:07:34.384812 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.384781    2556 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 16:07:34.384988 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.384815    2556 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-100.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 16:07:34.385071 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.385005    2556 topology_manager.go:138] "Creating topology manager with none policy"
May 28 16:07:34.385071 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.385018    2556 container_manager_linux.go:306] "Creating device plugin manager"
May 28 16:07:34.385071 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.385029    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 16:07:34.385846 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.385834    2556 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 16:07:34.386929 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.386916    2556 state_mem.go:36] "Initialized new in-memory state store"
May 28 16:07:34.387065 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.387055    2556 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 16:07:34.389199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.389188    2556 kubelet.go:491] "Attempting to sync node with API server"
May 28 16:07:34.389267 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.389206    2556 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 16:07:34.389267 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.389220    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 16:07:34.389267 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.389233    2556 kubelet.go:397] "Adding apiserver pod source"
May 28 16:07:34.389267 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.389244    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 16:07:34.390391 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.390378    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 16:07:34.390468 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.390400    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 16:07:34.394690 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.394650    2556 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 16:07:34.396695 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.396665    2556 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 16:07:34.398661 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.398646    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 16:07:34.398661 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.398664    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 16:07:34.398760 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.398685    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 16:07:34.398760 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.398693    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 16:07:34.398760 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.398706    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 16:07:34.398760 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.398715    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 16:07:34.398760 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.398720    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 16:07:34.398760 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.398726    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 16:07:34.398760 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.398733    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 16:07:34.398760 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.398739    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 16:07:34.398760 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.398747    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 16:07:34.398760 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.398753    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 16:07:34.399495 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.399482    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 16:07:34.399495 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.399495    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 16:07:34.401978 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.401957    2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 16:07:34.401978 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.401960    2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 16:07:34.402076 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.402004    2556 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-100.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 16:07:34.402561 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.402548    2556 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 16:07:34.402605 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.402583    2556 server.go:1295] "Started kubelet"
May 28 16:07:34.402692 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.402656    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 16:07:34.402826 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.402720    2556 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 16:07:34.402857 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.402851    2556 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 16:07:34.403331 ip-10-0-134-100 systemd[1]: Started Kubernetes Kubelet.
May 28 16:07:34.403901 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.403810    2556 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 16:07:34.405376 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.405360    2556 server.go:317] "Adding debug handlers to kubelet server"
May 28 16:07:34.406967 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.406154    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-100.ec2.internal.18b3c66e3661d533  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-100.ec2.internal,UID:ip-10-0-134-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-100.ec2.internal,},FirstTimestamp:2026-05-28 16:07:34.402561331 +0000 UTC m=+0.411941925,LastTimestamp:2026-05-28 16:07:34.402561331 +0000 UTC m=+0.411941925,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-100.ec2.internal,}"
May 28 16:07:34.409535 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.409520    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 16:07:34.410006 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.409992    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 16:07:34.410322 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.410110    2556 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 16:07:34.410322 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.410125    2556 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 16:07:34.410322 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.410191    2556 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 16:07:34.410322 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.410255    2556 reconstruct.go:97] "Volume reconstruction finished"
May 28 16:07:34.410322 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.410263    2556 reconciler.go:26] "Reconciler: start to sync state"
May 28 16:07:34.411181 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.410664    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 16:07:34.411181 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.410696    2556 factory.go:55] Registering systemd factory
May 28 16:07:34.411181 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.410705    2556 factory.go:223] Registration of the systemd container factory successfully
May 28 16:07:34.411181 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.410877    2556 factory.go:153] Registering CRI-O factory
May 28 16:07:34.411181 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.410892    2556 factory.go:223] Registration of the crio container factory successfully
May 28 16:07:34.411181 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.410908    2556 factory.go:103] Registering Raw factory
May 28 16:07:34.411181 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.410972    2556 manager.go:1196] Started watching for new ooms in manager
May 28 16:07:34.411181 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.411146    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:34.412228 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.412207    2556 manager.go:319] Starting recovery of all containers
May 28 16:07:34.412566 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.412545    2556 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 16:07:34.420706 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.420667    2556 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 28 16:07:34.420815 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.420773    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-100.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 28 16:07:34.424461 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.424448    2556 manager.go:324] Recovery completed
May 28 16:07:34.427973 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.427955    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hndnm"
May 28 16:07:34.428512 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.428501    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:07:34.430088 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.430072    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:07:34.430163 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.430097    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:07:34.430163 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.430108    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
May 28 16:07:34.430535 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.430520    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 16:07:34.430535 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.430532    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 16:07:34.430685 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.430549    2556 state_mem.go:36] "Initialized new in-memory state store"
May 28 16:07:34.431877 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.431818    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-100.ec2.internal.18b3c66e3805d02c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-100.ec2.internal,UID:ip-10-0-134-100.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-100.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-100.ec2.internal,},FirstTimestamp:2026-05-28 16:07:34.430085164 +0000 UTC m=+0.439465758,LastTimestamp:2026-05-28 16:07:34.430085164 +0000 UTC m=+0.439465758,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-100.ec2.internal,}"
May 28 16:07:34.432938 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.432923    2556 policy_none.go:49] "None policy: Start"
May 28 16:07:34.433016 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.432943    2556 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 16:07:34.433016 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.432956    2556 state_mem.go:35] "Initializing new in-memory state store"
May 28 16:07:34.433543 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.433528    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hndnm"
May 28 16:07:34.482249 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.482233    2556 manager.go:341] "Starting Device Plugin manager"
May 28 16:07:34.494534 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.482284    2556 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 16:07:34.494534 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.482296    2556 server.go:85] "Starting device plugin registration server"
May 28 16:07:34.494534 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.482518    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 16:07:34.494534 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.482528    2556 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 16:07:34.494534 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.482623    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 16:07:34.494534 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.482717    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 16:07:34.494534 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.482726    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 16:07:34.494534 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.483215    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 16:07:34.494534 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.483250    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:34.553475 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.553443    2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 16:07:34.554646 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.554596    2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 16:07:34.554646 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.554614    2556 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 16:07:34.554646 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.554629    2556 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 16:07:34.554646 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.554635    2556 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 16:07:34.554883 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.554688    2556 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 16:07:34.556890 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.556872    2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:07:34.582607 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.582582    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:07:34.583363 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.583348    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:07:34.583427 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.583376    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:07:34.583427 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.583387    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
May 28 16:07:34.583427 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.583410    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-100.ec2.internal"
May 28 16:07:34.592474 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.592459    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-100.ec2.internal"
May 28 16:07:34.592522 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.592480    2556 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-100.ec2.internal\": node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:34.604089 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.604070    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:34.655714 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.655664    2556 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"]
May 28 16:07:34.655878 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.655773    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:07:34.656831 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.656813    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:07:34.656935 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.656852    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:07:34.656935 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.656867    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
May 28 16:07:34.657969 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.657953    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:07:34.658126 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.658112    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
May 28 16:07:34.658178 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.658166    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:07:34.658653 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.658636    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:07:34.658733 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.658687    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:07:34.658733 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.658703    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
May 28 16:07:34.658802 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.658732    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:07:34.658802 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.658755    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:07:34.658802 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.658768    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
May 28 16:07:34.659970 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.659954    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"
May 28 16:07:34.660013 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.659987    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:07:34.660583 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.660566    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:07:34.660711 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.660592    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:07:34.660711 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.660601    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeHasSufficientPID"
May 28 16:07:34.688208 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.688189    2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-100.ec2.internal\" not found" node="ip-10-0-134-100.ec2.internal"
May 28 16:07:34.692459 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.692445    2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-100.ec2.internal\" not found" node="ip-10-0-134-100.ec2.internal"
May 28 16:07:34.705147 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.705130    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:34.711456 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.711437    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23c87c6c9b0210e026ed6bfd0bb7b431-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"23c87c6c9b0210e026ed6bfd0bb7b431\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
May 28 16:07:34.711505 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.711462    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23c87c6c9b0210e026ed6bfd0bb7b431-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"23c87c6c9b0210e026ed6bfd0bb7b431\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
May 28 16:07:34.711505 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.711478    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/beb36003581f08eee5b4252c35cbfa45-config\") pod \"kube-apiserver-proxy-ip-10-0-134-100.ec2.internal\" (UID: \"beb36003581f08eee5b4252c35cbfa45\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"
May 28 16:07:34.806241 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.806167    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:34.812520 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.812499    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23c87c6c9b0210e026ed6bfd0bb7b431-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"23c87c6c9b0210e026ed6bfd0bb7b431\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
May 28 16:07:34.812590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.812536    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23c87c6c9b0210e026ed6bfd0bb7b431-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"23c87c6c9b0210e026ed6bfd0bb7b431\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
May 28 16:07:34.812590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.812561    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/beb36003581f08eee5b4252c35cbfa45-config\") pod \"kube-apiserver-proxy-ip-10-0-134-100.ec2.internal\" (UID: \"beb36003581f08eee5b4252c35cbfa45\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"
May 28 16:07:34.812590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.812580    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23c87c6c9b0210e026ed6bfd0bb7b431-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"23c87c6c9b0210e026ed6bfd0bb7b431\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
May 28 16:07:34.812590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.812587    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/beb36003581f08eee5b4252c35cbfa45-config\") pod \"kube-apiserver-proxy-ip-10-0-134-100.ec2.internal\" (UID: \"beb36003581f08eee5b4252c35cbfa45\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"
May 28 16:07:34.812750 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.812600    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23c87c6c9b0210e026ed6bfd0bb7b431-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal\" (UID: \"23c87c6c9b0210e026ed6bfd0bb7b431\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
May 28 16:07:34.906906 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:34.906860    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:34.991374 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.991334    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
May 28 16:07:34.995266 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:34.995247    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"
May 28 16:07:35.008095 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:35.007958    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:35.108627 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:35.108533    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:35.209027 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:35.208996    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:35.309616 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:35.309594    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:35.327997 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.327976    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 16:07:35.328128 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.328112    2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 16:07:35.410305 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.410277    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 16:07:35.410439 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:35.410304    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:35.421225 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.421206    2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 16:07:35.435039 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.435008    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 16:02:34 +0000 UTC" deadline="2028-01-21 01:36:18.816372249 +0000 UTC"
May 28 16:07:35.435039 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.435037    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14457h28m43.381338043s"
May 28 16:07:35.445276 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.445258    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzh9s"
May 28 16:07:35.452699 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.452665    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzh9s"
May 28 16:07:35.485181 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:35.485152    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb36003581f08eee5b4252c35cbfa45.slice/crio-b150a898168fac9b1beb2a89ab1d7f4f270df30a2143c86655be179ef781dea1 WatchSource:0}: Error finding container b150a898168fac9b1beb2a89ab1d7f4f270df30a2143c86655be179ef781dea1: Status 404 returned error can't find the container with id b150a898168fac9b1beb2a89ab1d7f4f270df30a2143c86655be179ef781dea1
May 28 16:07:35.485406 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:35.485388    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c87c6c9b0210e026ed6bfd0bb7b431.slice/crio-0742b5d2539f1345210beb283a94a5e601b1af68a6cefb374439a98fa29ec5fd WatchSource:0}: Error finding container 0742b5d2539f1345210beb283a94a5e601b1af68a6cefb374439a98fa29ec5fd: Status 404 returned error can't find the container with id 0742b5d2539f1345210beb283a94a5e601b1af68a6cefb374439a98fa29ec5fd
May 28 16:07:35.487686 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.487659    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 16:07:35.493126 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.493109    2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:07:35.511104 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:35.511079    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:35.557164 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.557124    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" event={"ID":"23c87c6c9b0210e026ed6bfd0bb7b431","Type":"ContainerStarted","Data":"0742b5d2539f1345210beb283a94a5e601b1af68a6cefb374439a98fa29ec5fd"}
May 28 16:07:35.557999 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.557979    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" event={"ID":"beb36003581f08eee5b4252c35cbfa45","Type":"ContainerStarted","Data":"b150a898168fac9b1beb2a89ab1d7f4f270df30a2143c86655be179ef781dea1"}
May 28 16:07:35.611192 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:35.611172    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-100.ec2.internal\" not found"
May 28 16:07:35.680939 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.680873    2556 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:07:35.686663 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.686637    2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:07:35.710361 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.710339    2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal"
May 28 16:07:35.723225 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.723203    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 16:07:35.724137 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.724126    2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal"
May 28 16:07:35.731718 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:35.731704    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 16:07:36.321175 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.321135    2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:07:36.391276 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.391245    2556 apiserver.go:52] "Watching apiserver"
May 28 16:07:36.399864 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.399802    2556 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 16:07:36.400245 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.400213    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal","openshift-multus/network-metrics-daemon-hkxh8","openshift-network-diagnostics/network-check-target-4dnsf","kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd","openshift-dns/node-resolver-rp6qf","openshift-image-registry/node-ca-zk27v","openshift-multus/multus-additional-cni-plugins-rbtzl","openshift-multus/multus-s2wrk","openshift-network-operator/iptables-alerter-94flb","openshift-ovn-kubernetes/ovnkube-node-28pqt","kube-system/konnectivity-agent-glx8v","openshift-cluster-node-tuning-operator/tuned-vjq9z"]
May 28 16:07:36.403174 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.403155    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-94flb"
May 28 16:07:36.405644 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.405623    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 16:07:36.405776 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.405689    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qr5xr\""
May 28 16:07:36.405776 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.405690    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 16:07:36.405776 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.405623    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 16:07:36.407214 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.407190    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:36.407339 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:36.407264    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:07:36.409585 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.409566    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:36.409667 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:36.409638    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:07:36.412511 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.412489    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.414580 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.414537    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 16:07:36.414928 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.414907    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 16:07:36.415109 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.415089    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 16:07:36.415181 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.415124    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cwgrq\""
May 28 16:07:36.415234 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.415128    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zk27v"
May 28 16:07:36.417040 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.417017    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 16:07:36.417140 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.417063    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 16:07:36.417207 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.417161    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 16:07:36.417413 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.417397    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.417413 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.417407    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wz8ms\""
May 28 16:07:36.419881 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.419652    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.420124 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420104    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-registration-dir\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.420202 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420139    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7a61c0f7-38c8-4403-a285-28885c28bf6e-serviceca\") pod \"node-ca-zk27v\" (UID: \"7a61c0f7-38c8-4403-a285-28885c28bf6e\") " pod="openshift-image-registry/node-ca-zk27v"
May 28 16:07:36.420202 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420168    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/efe2114e-38bd-411d-9ef7-7f4b484c4caf-iptables-alerter-script\") pod \"iptables-alerter-94flb\" (UID: \"efe2114e-38bd-411d-9ef7-7f4b484c4caf\") " pod="openshift-network-operator/iptables-alerter-94flb"
May 28 16:07:36.420202 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420194    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/efe2114e-38bd-411d-9ef7-7f4b484c4caf-host-slash\") pod \"iptables-alerter-94flb\" (UID: \"efe2114e-38bd-411d-9ef7-7f4b484c4caf\") " pod="openshift-network-operator/iptables-alerter-94flb"
May 28 16:07:36.420360 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420221    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvjcq\" (UniqueName: \"kubernetes.io/projected/efe2114e-38bd-411d-9ef7-7f4b484c4caf-kube-api-access-jvjcq\") pod \"iptables-alerter-94flb\" (UID: \"efe2114e-38bd-411d-9ef7-7f4b484c4caf\") " pod="openshift-network-operator/iptables-alerter-94flb"
May 28 16:07:36.420360 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420265    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvrcs\" (UniqueName: \"kubernetes.io/projected/37b01b62-805e-4475-bdeb-48b56af1211b-kube-api-access-fvrcs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:36.420360 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420297    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-etc-selinux\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.420360 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420305    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 16:07:36.420360 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420322    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a61c0f7-38c8-4403-a285-28885c28bf6e-host\") pod \"node-ca-zk27v\" (UID: \"7a61c0f7-38c8-4403-a285-28885c28bf6e\") " pod="openshift-image-registry/node-ca-zk27v"
May 28 16:07:36.420360 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420348    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:36.420651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420367    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 16:07:36.420651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420373    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbf5g\" (UniqueName: \"kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g\") pod \"network-check-target-4dnsf\" (UID: \"ddd3a1ae-ac71-4312-8e01-cdd65f3cf383\") " pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:36.420651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420398    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 16:07:36.420651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420400    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-device-dir\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.420651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420427    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx9wz\" (UniqueName: \"kubernetes.io/projected/6aa7fab9-0c77-4523-83a5-5c7789711488-kube-api-access-zx9wz\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.420651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420451    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.420651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420484    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 16:07:36.420651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420473    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-socket-dir\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.420651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420520    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-sys-fs\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.420651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420546    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsfjz\" (UniqueName: \"kubernetes.io/projected/7a61c0f7-38c8-4403-a285-28885c28bf6e-kube-api-access-jsfjz\") pod \"node-ca-zk27v\" (UID: \"7a61c0f7-38c8-4403-a285-28885c28bf6e\") " pod="openshift-image-registry/node-ca-zk27v"
May 28 16:07:36.420651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420608    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zjpsj\""
May 28 16:07:36.421183 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.420692    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 16:07:36.421569 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.421550    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 16:07:36.422107 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.421930    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kfl7p\""
May 28 16:07:36.422107 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.422033    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.424287 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.424267    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 16:07:36.424379 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.424309    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 16:07:36.424441 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.424385    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 16:07:36.424497 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.424458    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-glx8v"
May 28 16:07:36.425770 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.425638    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 16:07:36.425868 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.425779    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dk4bg\""
May 28 16:07:36.427233 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.426968    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 16:07:36.427233 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.427169    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 16:07:36.428527 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.427914    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 16:07:36.428768 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.428748    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rp6qf"
May 28 16:07:36.428842 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.428756    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.430198 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.430089    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 16:07:36.430198 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.430178    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hsqpg\""
May 28 16:07:36.431648 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.430805    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 16:07:36.431648 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.430823    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 16:07:36.431648 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.430838    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9tnsc\""
May 28 16:07:36.431898 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.431795    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 16:07:36.431898 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.431876    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m6dcz\""
May 28 16:07:36.432130 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.432113    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 16:07:36.453317 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.453210    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 16:02:35 +0000 UTC" deadline="2027-12-22 05:44:46.896479458 +0000 UTC"
May 28 16:07:36.453317 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.453233    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13741h37m10.443249684s"
May 28 16:07:36.511246 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.511218    2556 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 16:07:36.521064 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521037    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-modprobe-d\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.521199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521067    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-sysconfig\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.521199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521101    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-hostroot\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.521199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521127    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4639d4a1-39b6-4f80-8fef-f00a2e76635e-system-cni-dir\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.521199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521153    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4639d4a1-39b6-4f80-8fef-f00a2e76635e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.521406 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521200    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-system-cni-dir\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.521406 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521234    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-ovnkube-config\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.521406 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521263    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-env-overrides\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.521406 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521290    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-tuned\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.521406 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521322    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-sys-fs\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.521406 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521349    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jsfjz\" (UniqueName: \"kubernetes.io/projected/7a61c0f7-38c8-4403-a285-28885c28bf6e-kube-api-access-jsfjz\") pod \"node-ca-zk27v\" (UID: \"7a61c0f7-38c8-4403-a285-28885c28bf6e\") " pod="openshift-image-registry/node-ca-zk27v"
May 28 16:07:36.521406 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521376    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-run-netns\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.521406 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521402    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-etc-openvswitch\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.521735 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521430    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-sys-fs\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.521735 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521427    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmb8p\" (UniqueName: \"kubernetes.io/projected/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-kube-api-access-hmb8p\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.521735 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521464    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c21ee6f5-9572-4b26-98ab-a847ba2eb743-tmp\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.521735 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521496    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-registration-dir\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.521735 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521548    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/efe2114e-38bd-411d-9ef7-7f4b484c4caf-iptables-alerter-script\") pod \"iptables-alerter-94flb\" (UID: \"efe2114e-38bd-411d-9ef7-7f4b484c4caf\") " pod="openshift-network-operator/iptables-alerter-94flb"
May 28 16:07:36.521735 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521594    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-registration-dir\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.521735 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521642    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/efe2114e-38bd-411d-9ef7-7f4b484c4caf-host-slash\") pod \"iptables-alerter-94flb\" (UID: \"efe2114e-38bd-411d-9ef7-7f4b484c4caf\") " pod="openshift-network-operator/iptables-alerter-94flb"
May 28 16:07:36.521735 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521688    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbf5g\" (UniqueName: \"kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g\") pod \"network-check-target-4dnsf\" (UID: \"ddd3a1ae-ac71-4312-8e01-cdd65f3cf383\") " pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:36.521735 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521719    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4639d4a1-39b6-4f80-8fef-f00a2e76635e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.522126 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521780    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/efe2114e-38bd-411d-9ef7-7f4b484c4caf-host-slash\") pod \"iptables-alerter-94flb\" (UID: \"efe2114e-38bd-411d-9ef7-7f4b484c4caf\") " pod="openshift-network-operator/iptables-alerter-94flb"
May 28 16:07:36.522126 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521788    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-ovn-node-metrics-cert\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.522126 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521884    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fce69c7-892d-4de8-88d5-b45473ca35d6-cni-binary-copy\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.522126 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521914    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.522126 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521949    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-cni-netd\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.522126 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521965    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-sysctl-conf\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.522126 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.521979    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-var-lib-kubelet\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.522126 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522007    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zx9wz\" (UniqueName: \"kubernetes.io/projected/6aa7fab9-0c77-4523-83a5-5c7789711488-kube-api-access-zx9wz\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.522126 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522044    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-sysctl-d\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522161    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/efe2114e-38bd-411d-9ef7-7f4b484c4caf-iptables-alerter-script\") pod \"iptables-alerter-94flb\" (UID: \"efe2114e-38bd-411d-9ef7-7f4b484c4caf\") " pod="openshift-network-operator/iptables-alerter-94flb"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522174    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-host\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522203    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-run-netns\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522230    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522255    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-socket-dir\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522280    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-os-release\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522299    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522306    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-var-lib-cni-bin\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522337    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-var-lib-kubelet\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522411    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-multus-conf-dir\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522435    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-kubelet\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522439    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-socket-dir\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522462    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7a61c0f7-38c8-4403-a285-28885c28bf6e-serviceca\") pod \"node-ca-zk27v\" (UID: \"7a61c0f7-38c8-4403-a285-28885c28bf6e\") " pod="openshift-image-registry/node-ca-zk27v"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522489    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jvjcq\" (UniqueName: \"kubernetes.io/projected/efe2114e-38bd-411d-9ef7-7f4b484c4caf-kube-api-access-jvjcq\") pod \"iptables-alerter-94flb\" (UID: \"efe2114e-38bd-411d-9ef7-7f4b484c4caf\") " pod="openshift-network-operator/iptables-alerter-94flb"
May 28 16:07:36.522501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522508    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fvrcs\" (UniqueName: \"kubernetes.io/projected/37b01b62-805e-4475-bdeb-48b56af1211b-kube-api-access-fvrcs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522524    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fce69c7-892d-4de8-88d5-b45473ca35d6-multus-daemon-config\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522541    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m76fc\" (UniqueName: \"kubernetes.io/projected/6fce69c7-892d-4de8-88d5-b45473ca35d6-kube-api-access-m76fc\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522592    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-ovnkube-script-lib\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522621    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522646    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4639d4a1-39b6-4f80-8fef-f00a2e76635e-cnibin\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:36.522732    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522764    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-slash\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:36.522792    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs podName:37b01b62-805e-4475-bdeb-48b56af1211b nodeName:}" failed. No retries permitted until 2026-05-28 16:07:37.022772191 +0000 UTC m=+3.032152785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs") pod "network-metrics-daemon-hkxh8" (UID: "37b01b62-805e-4475-bdeb-48b56af1211b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522877    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-run-openvswitch\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522887    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7a61c0f7-38c8-4403-a285-28885c28bf6e-serviceca\") pod \"node-ca-zk27v\" (UID: \"7a61c0f7-38c8-4403-a285-28885c28bf6e\") " pod="openshift-image-registry/node-ca-zk27v"
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522912    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-cni-bin\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522941    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwmgd\" (UniqueName: \"kubernetes.io/projected/c21ee6f5-9572-4b26-98ab-a847ba2eb743-kube-api-access-cwmgd\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.522969    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4639d4a1-39b6-4f80-8fef-f00a2e76635e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523038    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbwbj\" (UniqueName: \"kubernetes.io/projected/4639d4a1-39b6-4f80-8fef-f00a2e76635e-kube-api-access-sbwbj\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.523085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523089    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-run-multus-certs\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523114    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-systemd-units\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523141    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-run-ovn\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523166    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-lib-modules\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523191    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-multus-cni-dir\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523215    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-var-lib-openvswitch\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523259    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523302    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-kubernetes\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523327    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-log-socket\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523345    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-etc-selinux\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523369    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a61c0f7-38c8-4403-a285-28885c28bf6e-host\") pod \"node-ca-zk27v\" (UID: \"7a61c0f7-38c8-4403-a285-28885c28bf6e\") " pod="openshift-image-registry/node-ca-zk27v"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523414    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4639d4a1-39b6-4f80-8fef-f00a2e76635e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523433    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7a61c0f7-38c8-4403-a285-28885c28bf6e-host\") pod \"node-ca-zk27v\" (UID: \"7a61c0f7-38c8-4403-a285-28885c28bf6e\") " pod="openshift-image-registry/node-ca-zk27v"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523439    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-var-lib-cni-multus\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523465    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-etc-selinux\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523487    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b03f6d14-4e8f-48cd-95ae-92ad1fda1692-hosts-file\") pod \"node-resolver-rp6qf\" (UID: \"b03f6d14-4e8f-48cd-95ae-92ad1fda1692\") " pod="openshift-dns/node-resolver-rp6qf"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523517    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b03f6d14-4e8f-48cd-95ae-92ad1fda1692-tmp-dir\") pod \"node-resolver-rp6qf\" (UID: \"b03f6d14-4e8f-48cd-95ae-92ad1fda1692\") " pod="openshift-dns/node-resolver-rp6qf"
May 28 16:07:36.523721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523541    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-sys\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523567    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-device-dir\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523596    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-multus-socket-dir-parent\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523622    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-etc-kubernetes\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523656    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-run-systemd\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523664    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6aa7fab9-0c77-4523-83a5-5c7789711488-device-dir\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523708    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d327d37e-c1bb-49ce-bbed-0f16c6888fa0-agent-certs\") pod \"konnectivity-agent-glx8v\" (UID: \"d327d37e-c1bb-49ce-bbed-0f16c6888fa0\") " pod="kube-system/konnectivity-agent-glx8v"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523736    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-systemd\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523758    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-node-log\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523783    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4639d4a1-39b6-4f80-8fef-f00a2e76635e-os-release\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523821    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-run-k8s-cni-cncf-io\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523848    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8m59\" (UniqueName: \"kubernetes.io/projected/b03f6d14-4e8f-48cd-95ae-92ad1fda1692-kube-api-access-j8m59\") pod \"node-resolver-rp6qf\" (UID: \"b03f6d14-4e8f-48cd-95ae-92ad1fda1692\") " pod="openshift-dns/node-resolver-rp6qf"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523865    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-run\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523880    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-cnibin\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.524420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.523904    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d327d37e-c1bb-49ce-bbed-0f16c6888fa0-konnectivity-ca\") pod \"konnectivity-agent-glx8v\" (UID: \"d327d37e-c1bb-49ce-bbed-0f16c6888fa0\") " pod="kube-system/konnectivity-agent-glx8v"
May 28 16:07:36.528448 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:36.528426    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:07:36.528448 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:36.528451    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:07:36.528611 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:36.528464    2556 projected.go:194] Error preparing data for projected volume kube-api-access-zbf5g for pod openshift-network-diagnostics/network-check-target-4dnsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:07:36.528611 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:36.528523    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g podName:ddd3a1ae-ac71-4312-8e01-cdd65f3cf383 nodeName:}" failed. No retries permitted until 2026-05-28 16:07:37.028504929 +0000 UTC m=+3.037885533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zbf5g" (UniqueName: "kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g") pod "network-check-target-4dnsf" (UID: "ddd3a1ae-ac71-4312-8e01-cdd65f3cf383") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:07:36.528751 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.528700    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 16:07:36.532590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.532533    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx9wz\" (UniqueName: \"kubernetes.io/projected/6aa7fab9-0c77-4523-83a5-5c7789711488-kube-api-access-zx9wz\") pod \"aws-ebs-csi-driver-node-t4dmd\" (UID: \"6aa7fab9-0c77-4523-83a5-5c7789711488\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.532590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.532549    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvjcq\" (UniqueName: \"kubernetes.io/projected/efe2114e-38bd-411d-9ef7-7f4b484c4caf-kube-api-access-jvjcq\") pod \"iptables-alerter-94flb\" (UID: \"efe2114e-38bd-411d-9ef7-7f4b484c4caf\") " pod="openshift-network-operator/iptables-alerter-94flb"
May 28 16:07:36.532782 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.532586    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsfjz\" (UniqueName: \"kubernetes.io/projected/7a61c0f7-38c8-4403-a285-28885c28bf6e-kube-api-access-jsfjz\") pod \"node-ca-zk27v\" (UID: \"7a61c0f7-38c8-4403-a285-28885c28bf6e\") " pod="openshift-image-registry/node-ca-zk27v"
May 28 16:07:36.532782 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.532612    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvrcs\" (UniqueName: \"kubernetes.io/projected/37b01b62-805e-4475-bdeb-48b56af1211b-kube-api-access-fvrcs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:36.624970 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.624937    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-log-socket\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.625145 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.624978    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4639d4a1-39b6-4f80-8fef-f00a2e76635e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.625145 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625003    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-var-lib-cni-multus\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.625145 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625033    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b03f6d14-4e8f-48cd-95ae-92ad1fda1692-hosts-file\") pod \"node-resolver-rp6qf\" (UID: \"b03f6d14-4e8f-48cd-95ae-92ad1fda1692\") " pod="openshift-dns/node-resolver-rp6qf"
May 28 16:07:36.625145 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625045    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-log-socket\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.625145 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625057    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b03f6d14-4e8f-48cd-95ae-92ad1fda1692-tmp-dir\") pod \"node-resolver-rp6qf\" (UID: \"b03f6d14-4e8f-48cd-95ae-92ad1fda1692\") " pod="openshift-dns/node-resolver-rp6qf"
May 28 16:07:36.625145 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625093    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-sys\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.625145 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625107    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-var-lib-cni-multus\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.625145 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625149    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-sys\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.625525 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625177    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b03f6d14-4e8f-48cd-95ae-92ad1fda1692-hosts-file\") pod \"node-resolver-rp6qf\" (UID: \"b03f6d14-4e8f-48cd-95ae-92ad1fda1692\") " pod="openshift-dns/node-resolver-rp6qf"
May 28 16:07:36.625525 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625230    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-multus-socket-dir-parent\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.625525 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625258    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-etc-kubernetes\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.625525 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625282    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-run-systemd\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.625525 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625327    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-run-systemd\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.625525 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625370    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-etc-kubernetes\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.625525 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625426    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b03f6d14-4e8f-48cd-95ae-92ad1fda1692-tmp-dir\") pod \"node-resolver-rp6qf\" (UID: \"b03f6d14-4e8f-48cd-95ae-92ad1fda1692\") " pod="openshift-dns/node-resolver-rp6qf"
May 28 16:07:36.625525 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625437    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-multus-socket-dir-parent\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.625525 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625481    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d327d37e-c1bb-49ce-bbed-0f16c6888fa0-agent-certs\") pod \"konnectivity-agent-glx8v\" (UID: \"d327d37e-c1bb-49ce-bbed-0f16c6888fa0\") " pod="kube-system/konnectivity-agent-glx8v"
May 28 16:07:36.625525 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625525    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-systemd\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625553    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-node-log\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625578    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4639d4a1-39b6-4f80-8fef-f00a2e76635e-os-release\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625607    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-run-k8s-cni-cncf-io\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625613    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-systemd\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625632    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j8m59\" (UniqueName: \"kubernetes.io/projected/b03f6d14-4e8f-48cd-95ae-92ad1fda1692-kube-api-access-j8m59\") pod \"node-resolver-rp6qf\" (UID: \"b03f6d14-4e8f-48cd-95ae-92ad1fda1692\") " pod="openshift-dns/node-resolver-rp6qf"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625656    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-run\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625687    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-node-log\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625697    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-cnibin\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625735    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d327d37e-c1bb-49ce-bbed-0f16c6888fa0-konnectivity-ca\") pod \"konnectivity-agent-glx8v\" (UID: \"d327d37e-c1bb-49ce-bbed-0f16c6888fa0\") " pod="kube-system/konnectivity-agent-glx8v"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625749    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-cnibin\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625756    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-modprobe-d\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625786    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-sysconfig\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625811    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-hostroot\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625832    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-modprobe-d\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625837    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4639d4a1-39b6-4f80-8fef-f00a2e76635e-system-cni-dir\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625862    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4639d4a1-39b6-4f80-8fef-f00a2e76635e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625884    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-system-cni-dir\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.625965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625907    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-ovnkube-config\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625915    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4639d4a1-39b6-4f80-8fef-f00a2e76635e-os-release\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625631    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4639d4a1-39b6-4f80-8fef-f00a2e76635e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625931    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-env-overrides\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625972    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-tuned\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.625999    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-run-netns\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626024    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-etc-openvswitch\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626049    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hmb8p\" (UniqueName: \"kubernetes.io/projected/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-kube-api-access-hmb8p\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626073    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c21ee6f5-9572-4b26-98ab-a847ba2eb743-tmp\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626116    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4639d4a1-39b6-4f80-8fef-f00a2e76635e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626139    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-ovn-node-metrics-cert\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626162    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fce69c7-892d-4de8-88d5-b45473ca35d6-cni-binary-copy\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626166    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-run-k8s-cni-cncf-io\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626186    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626212    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-cni-netd\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626255    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-cni-netd\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626323    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d327d37e-c1bb-49ce-bbed-0f16c6888fa0-konnectivity-ca\") pod \"konnectivity-agent-glx8v\" (UID: \"d327d37e-c1bb-49ce-bbed-0f16c6888fa0\") " pod="kube-system/konnectivity-agent-glx8v"
May 28 16:07:36.626715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626386    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626415    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-env-overrides\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626434    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4639d4a1-39b6-4f80-8fef-f00a2e76635e-system-cni-dir\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626441    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-etc-openvswitch\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626492    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-hostroot\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626542    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-sysconfig\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626863    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-sysctl-conf\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626883    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fce69c7-892d-4de8-88d5-b45473ca35d6-cni-binary-copy\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626898    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-var-lib-kubelet\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626926    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-sysctl-d\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626943    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-run\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626952    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-host\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.626977    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-run-netns\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627004    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-os-release\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627017    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-ovnkube-config\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627029    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-var-lib-cni-bin\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627120    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-var-lib-kubelet\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627134    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4639d4a1-39b6-4f80-8fef-f00a2e76635e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.627500 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627149    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-multus-conf-dir\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627175    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-kubelet\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627208    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fce69c7-892d-4de8-88d5-b45473ca35d6-multus-daemon-config\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627215    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-run-netns\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627234    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m76fc\" (UniqueName: \"kubernetes.io/projected/6fce69c7-892d-4de8-88d5-b45473ca35d6-kube-api-access-m76fc\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627262    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-ovnkube-script-lib\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627305    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4639d4a1-39b6-4f80-8fef-f00a2e76635e-cnibin\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627345    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-sysctl-conf\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627354    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-slash\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627356    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4639d4a1-39b6-4f80-8fef-f00a2e76635e-cni-binary-copy\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627415    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-kubelet\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627418    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-var-lib-kubelet\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627175    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-run-netns\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627462    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-sysctl-d\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627471    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-var-lib-kubelet\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627479    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-os-release\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627505    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-slash\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627514    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-multus-conf-dir\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.628324 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627551    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-var-lib-cni-bin\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627558    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-host\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627866    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4639d4a1-39b6-4f80-8fef-f00a2e76635e-cnibin\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627954    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-run-openvswitch\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627981    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6fce69c7-892d-4de8-88d5-b45473ca35d6-multus-daemon-config\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.627990    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-cni-bin\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628022    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwmgd\" (UniqueName: \"kubernetes.io/projected/c21ee6f5-9572-4b26-98ab-a847ba2eb743-kube-api-access-cwmgd\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628050    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4639d4a1-39b6-4f80-8fef-f00a2e76635e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628059    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-run-openvswitch\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628078    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbwbj\" (UniqueName: \"kubernetes.io/projected/4639d4a1-39b6-4f80-8fef-f00a2e76635e-kube-api-access-sbwbj\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628105    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-run-multus-certs\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628131    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-systemd-units\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628155    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-run-ovn\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628180    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-lib-modules\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628205    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-multus-cni-dir\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628234    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-var-lib-openvswitch\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628260    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.629169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628286    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-kubernetes\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628291    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d327d37e-c1bb-49ce-bbed-0f16c6888fa0-agent-certs\") pod \"konnectivity-agent-glx8v\" (UID: \"d327d37e-c1bb-49ce-bbed-0f16c6888fa0\") " pod="kube-system/konnectivity-agent-glx8v"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628307    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-cni-bin\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628373    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-kubernetes\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628474    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-host-run-multus-certs\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628481    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-run-ovn\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628639    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-systemd-units\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628712    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-var-lib-openvswitch\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628751    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628793    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-system-cni-dir\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628804    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fce69c7-892d-4de8-88d5-b45473ca35d6-multus-cni-dir\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628856    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4639d4a1-39b6-4f80-8fef-f00a2e76635e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.628895    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c21ee6f5-9572-4b26-98ab-a847ba2eb743-lib-modules\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.629213    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-ovnkube-script-lib\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.629966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.629422    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c21ee6f5-9572-4b26-98ab-a847ba2eb743-etc-tuned\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.630495 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.630116    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c21ee6f5-9572-4b26-98ab-a847ba2eb743-tmp\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.630495 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.630217    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-ovn-node-metrics-cert\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.634090 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.634064    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8m59\" (UniqueName: \"kubernetes.io/projected/b03f6d14-4e8f-48cd-95ae-92ad1fda1692-kube-api-access-j8m59\") pod \"node-resolver-rp6qf\" (UID: \"b03f6d14-4e8f-48cd-95ae-92ad1fda1692\") " pod="openshift-dns/node-resolver-rp6qf"
May 28 16:07:36.635033 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.635010    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmb8p\" (UniqueName: \"kubernetes.io/projected/694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7-kube-api-access-hmb8p\") pod \"ovnkube-node-28pqt\" (UID: \"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.635776 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.635734    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m76fc\" (UniqueName: \"kubernetes.io/projected/6fce69c7-892d-4de8-88d5-b45473ca35d6-kube-api-access-m76fc\") pod \"multus-s2wrk\" (UID: \"6fce69c7-892d-4de8-88d5-b45473ca35d6\") " pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.636641 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.636613    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbwbj\" (UniqueName: \"kubernetes.io/projected/4639d4a1-39b6-4f80-8fef-f00a2e76635e-kube-api-access-sbwbj\") pod \"multus-additional-cni-plugins-rbtzl\" (UID: \"4639d4a1-39b6-4f80-8fef-f00a2e76635e\") " pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.636839 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.636823    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwmgd\" (UniqueName: \"kubernetes.io/projected/c21ee6f5-9572-4b26-98ab-a847ba2eb743-kube-api-access-cwmgd\") pod \"tuned-vjq9z\" (UID: \"c21ee6f5-9572-4b26-98ab-a847ba2eb743\") " pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:36.714977 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.714891    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-94flb"
May 28 16:07:36.724743 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.724722    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd"
May 28 16:07:36.737248 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.737228    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rbtzl"
May 28 16:07:36.742810 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.742790    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zk27v"
May 28 16:07:36.749345 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.749325    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s2wrk"
May 28 16:07:36.757874 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.757852    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:07:36.764291 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.764271    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-glx8v"
May 28 16:07:36.772819 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.772800    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rp6qf"
May 28 16:07:36.777417 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:36.777403    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vjq9z"
May 28 16:07:37.031450 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.031271    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbf5g\" (UniqueName: \"kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g\") pod \"network-check-target-4dnsf\" (UID: \"ddd3a1ae-ac71-4312-8e01-cdd65f3cf383\") " pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:37.031450 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.031351    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:37.031979 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:37.031474    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:07:37.031979 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:37.031498    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:07:37.031979 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:37.031521    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:07:37.031979 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:37.031534    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs podName:37b01b62-805e-4475-bdeb-48b56af1211b nodeName:}" failed. No retries permitted until 2026-05-28 16:07:38.031516887 +0000 UTC m=+4.040897472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs") pod "network-metrics-daemon-hkxh8" (UID: "37b01b62-805e-4475-bdeb-48b56af1211b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:07:37.031979 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:37.031537    2556 projected.go:194] Error preparing data for projected volume kube-api-access-zbf5g for pod openshift-network-diagnostics/network-check-target-4dnsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:07:37.031979 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:37.031594    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g podName:ddd3a1ae-ac71-4312-8e01-cdd65f3cf383 nodeName:}" failed. No retries permitted until 2026-05-28 16:07:38.031575675 +0000 UTC m=+4.040956271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbf5g" (UniqueName: "kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g") pod "network-check-target-4dnsf" (UID: "ddd3a1ae-ac71-4312-8e01-cdd65f3cf383") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:07:37.150720 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:37.150652    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd327d37e_c1bb_49ce_bbed_0f16c6888fa0.slice/crio-16a0b8e6992ac1598117e93d9955b6ae54643327fde65d4f5cae2cb156b9a75f WatchSource:0}: Error finding container 16a0b8e6992ac1598117e93d9955b6ae54643327fde65d4f5cae2cb156b9a75f: Status 404 returned error can't find the container with id 16a0b8e6992ac1598117e93d9955b6ae54643327fde65d4f5cae2cb156b9a75f
May 28 16:07:37.151381 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:37.151353    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe2114e_38bd_411d_9ef7_7f4b484c4caf.slice/crio-fb76dacc4ba409ac34c677aecd8a608c41d201c39f90970f355caf435e75a5d6 WatchSource:0}: Error finding container fb76dacc4ba409ac34c677aecd8a608c41d201c39f90970f355caf435e75a5d6: Status 404 returned error can't find the container with id fb76dacc4ba409ac34c677aecd8a608c41d201c39f90970f355caf435e75a5d6
May 28 16:07:37.152376 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:37.152337    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc21ee6f5_9572_4b26_98ab_a847ba2eb743.slice/crio-6b98ed3c993d3e7b9cac766d700bf9f24f972fef56260bd08406d6f17f4a9c6c WatchSource:0}: Error finding container 6b98ed3c993d3e7b9cac766d700bf9f24f972fef56260bd08406d6f17f4a9c6c: Status 404 returned error can't find the container with id 6b98ed3c993d3e7b9cac766d700bf9f24f972fef56260bd08406d6f17f4a9c6c
May 28 16:07:37.155588 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:37.155562    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4639d4a1_39b6_4f80_8fef_f00a2e76635e.slice/crio-6126e75d465ace37cb311db4cb20ab3f3dd8ba123e1c2206ace9b591cbc5e11b WatchSource:0}: Error finding container 6126e75d465ace37cb311db4cb20ab3f3dd8ba123e1c2206ace9b591cbc5e11b: Status 404 returned error can't find the container with id 6126e75d465ace37cb311db4cb20ab3f3dd8ba123e1c2206ace9b591cbc5e11b
May 28 16:07:37.156311 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:37.156289    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb03f6d14_4e8f_48cd_95ae_92ad1fda1692.slice/crio-f09a933de8f9d488c710aa6ab7cd6cbd78b52f938799f93482cde871bc05927b WatchSource:0}: Error finding container f09a933de8f9d488c710aa6ab7cd6cbd78b52f938799f93482cde871bc05927b: Status 404 returned error can't find the container with id f09a933de8f9d488c710aa6ab7cd6cbd78b52f938799f93482cde871bc05927b
May 28 16:07:37.158249 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:07:37.158223    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aa7fab9_0c77_4523_83a5_5c7789711488.slice/crio-f53ec4834e83082ceada7cd770474ecdd66e0c70d4d42f16bbb52e6f930d5d49 WatchSource:0}: Error finding container f53ec4834e83082ceada7cd770474ecdd66e0c70d4d42f16bbb52e6f930d5d49: Status 404 returned error can't find the container with id f53ec4834e83082ceada7cd770474ecdd66e0c70d4d42f16bbb52e6f930d5d49
May 28 16:07:37.453370 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.453339    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 16:02:35 +0000 UTC" deadline="2028-01-04 12:47:28.577930356 +0000 UTC"
May 28 16:07:37.453370 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.453366    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14060h39m51.124567789s"
May 28 16:07:37.555043 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.555010    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:37.555213 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:37.555127    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:07:37.561988 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.561958    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-94flb" event={"ID":"efe2114e-38bd-411d-9ef7-7f4b484c4caf","Type":"ContainerStarted","Data":"fb76dacc4ba409ac34c677aecd8a608c41d201c39f90970f355caf435e75a5d6"}
May 28 16:07:37.563052 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.563028    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-glx8v" event={"ID":"d327d37e-c1bb-49ce-bbed-0f16c6888fa0","Type":"ContainerStarted","Data":"16a0b8e6992ac1598117e93d9955b6ae54643327fde65d4f5cae2cb156b9a75f"}
May 28 16:07:37.564856 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.564822    2556 generic.go:358] "Generic (PLEG): container finished" podID="23c87c6c9b0210e026ed6bfd0bb7b431" containerID="af43b26ea6c0b14ecbf908c38eff154059df95aa43d9ef902531f43f8266128d" exitCode=0
May 28 16:07:37.564940 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.564892    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" event={"ID":"23c87c6c9b0210e026ed6bfd0bb7b431","Type":"ContainerDied","Data":"af43b26ea6c0b14ecbf908c38eff154059df95aa43d9ef902531f43f8266128d"}
May 28 16:07:37.566857 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.566827    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" event={"ID":"beb36003581f08eee5b4252c35cbfa45","Type":"ContainerStarted","Data":"ee521f474f69cc2796670024c1b357580bed72b8ba8851ebf2cbf78fd411deab"}
May 28 16:07:37.570853 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.569097    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s2wrk" event={"ID":"6fce69c7-892d-4de8-88d5-b45473ca35d6","Type":"ContainerStarted","Data":"2cf1f0c53b4a308a58378e47d99ecc014b78cb3c98d42bb8db0ab1469c9893c9"}
May 28 16:07:37.571390 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.571364    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zk27v" event={"ID":"7a61c0f7-38c8-4403-a285-28885c28bf6e","Type":"ContainerStarted","Data":"5f34a24b3cbd964dbeb2b7446f8137d87da5d035c526dfc4cacde3e344027fdd"}
May 28 16:07:37.572579 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.572546    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt" event={"ID":"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7","Type":"ContainerStarted","Data":"a0fc5ce760ab1fd3e61f8c68c543a9f8b4b8d408376753627b5420d9752026d8"}
May 28 16:07:37.573570 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.573548    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rp6qf" event={"ID":"b03f6d14-4e8f-48cd-95ae-92ad1fda1692","Type":"ContainerStarted","Data":"f09a933de8f9d488c710aa6ab7cd6cbd78b52f938799f93482cde871bc05927b"}
May 28 16:07:37.574783 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.574757    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd" event={"ID":"6aa7fab9-0c77-4523-83a5-5c7789711488","Type":"ContainerStarted","Data":"f53ec4834e83082ceada7cd770474ecdd66e0c70d4d42f16bbb52e6f930d5d49"}
May 28 16:07:37.576761 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.576738    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbtzl" event={"ID":"4639d4a1-39b6-4f80-8fef-f00a2e76635e","Type":"ContainerStarted","Data":"6126e75d465ace37cb311db4cb20ab3f3dd8ba123e1c2206ace9b591cbc5e11b"}
May 28 16:07:37.578433 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.578409    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vjq9z" event={"ID":"c21ee6f5-9572-4b26-98ab-a847ba2eb743","Type":"ContainerStarted","Data":"6b98ed3c993d3e7b9cac766d700bf9f24f972fef56260bd08406d6f17f4a9c6c"}
May 28 16:07:37.597302 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:37.597237    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-100.ec2.internal" podStartSLOduration=2.597221599 podStartE2EDuration="2.597221599s" podCreationTimestamp="2026-05-28 16:07:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:07:37.596966719 +0000 UTC m=+3.606347323" watchObservedRunningTime="2026-05-28 16:07:37.597221599 +0000 UTC m=+3.606602203"
May 28 16:07:38.039834 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:38.039011    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:38.039834 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:38.039091    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbf5g\" (UniqueName: \"kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g\") pod \"network-check-target-4dnsf\" (UID: \"ddd3a1ae-ac71-4312-8e01-cdd65f3cf383\") " pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:38.039834 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:38.039236    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:07:38.039834 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:38.039256    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:07:38.039834 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:38.039269    2556 projected.go:194] Error preparing data for projected volume kube-api-access-zbf5g for pod openshift-network-diagnostics/network-check-target-4dnsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:07:38.039834 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:38.039328    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g podName:ddd3a1ae-ac71-4312-8e01-cdd65f3cf383 nodeName:}" failed. No retries permitted until 2026-05-28 16:07:40.039309317 +0000 UTC m=+6.048689918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbf5g" (UniqueName: "kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g") pod "network-check-target-4dnsf" (UID: "ddd3a1ae-ac71-4312-8e01-cdd65f3cf383") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:07:38.039834 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:38.039408    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:07:38.039834 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:38.039449    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs podName:37b01b62-805e-4475-bdeb-48b56af1211b nodeName:}" failed. No retries permitted until 2026-05-28 16:07:40.039436672 +0000 UTC m=+6.048817255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs") pod "network-metrics-daemon-hkxh8" (UID: "37b01b62-805e-4475-bdeb-48b56af1211b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:07:38.558200 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:38.557704    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:38.558200 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:38.557838    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:07:38.601004 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:38.600944    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" event={"ID":"23c87c6c9b0210e026ed6bfd0bb7b431","Type":"ContainerStarted","Data":"400efb21100c1749aef079094a4a255c4ab4f576051cd7323408fcb762e7c4df"}
May 28 16:07:38.619030 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:38.618970    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-100.ec2.internal" podStartSLOduration=3.618949815 podStartE2EDuration="3.618949815s" podCreationTimestamp="2026-05-28 16:07:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:07:38.618201859 +0000 UTC m=+4.627582464" watchObservedRunningTime="2026-05-28 16:07:38.618949815 +0000 UTC m=+4.628330418"
May 28 16:07:39.555024 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:39.554990    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:39.555225 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:39.555117    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:07:40.058999 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:40.058642    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbf5g\" (UniqueName: \"kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g\") pod \"network-check-target-4dnsf\" (UID: \"ddd3a1ae-ac71-4312-8e01-cdd65f3cf383\") " pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:40.058999 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:40.058718    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:40.058999 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:40.058842    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:07:40.058999 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:40.058867    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:07:40.058999 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:40.058891    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:07:40.058999 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:40.058903    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs podName:37b01b62-805e-4475-bdeb-48b56af1211b nodeName:}" failed. No retries permitted until 2026-05-28 16:07:44.058885046 +0000 UTC m=+10.068265637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs") pod "network-metrics-daemon-hkxh8" (UID: "37b01b62-805e-4475-bdeb-48b56af1211b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:07:40.058999 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:40.058904    2556 projected.go:194] Error preparing data for projected volume kube-api-access-zbf5g for pod openshift-network-diagnostics/network-check-target-4dnsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:07:40.058999 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:40.058962    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g podName:ddd3a1ae-ac71-4312-8e01-cdd65f3cf383 nodeName:}" failed. No retries permitted until 2026-05-28 16:07:44.058945988 +0000 UTC m=+10.068326592 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbf5g" (UniqueName: "kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g") pod "network-check-target-4dnsf" (UID: "ddd3a1ae-ac71-4312-8e01-cdd65f3cf383") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:07:40.556062 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:40.555735    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:40.556062 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:40.555870    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:07:41.553647 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:41.553611    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-cgwbl"]
May 28 16:07:41.557453 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:41.556752    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:41.557453 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:41.556863    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:07:41.557453 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:41.557249    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:41.557453 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:41.557302    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:07:41.675471 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:41.675424    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c44d78c-1adc-4837-8b08-187acc745ae7-kubelet-config\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:41.675651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:41.675479    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c44d78c-1adc-4837-8b08-187acc745ae7-dbus\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:41.675651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:41.675507    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:41.777040 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:41.776539    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c44d78c-1adc-4837-8b08-187acc745ae7-kubelet-config\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:41.777040 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:41.776587    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c44d78c-1adc-4837-8b08-187acc745ae7-dbus\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:41.777040 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:41.776611    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:41.777040 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:41.776716    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c44d78c-1adc-4837-8b08-187acc745ae7-kubelet-config\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:41.777040 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:41.776762    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 16:07:41.777040 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:41.776829    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret podName:7c44d78c-1adc-4837-8b08-187acc745ae7 nodeName:}" failed. No retries permitted until 2026-05-28 16:07:42.276809664 +0000 UTC m=+8.286190246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret") pod "global-pull-secret-syncer-cgwbl" (UID: "7c44d78c-1adc-4837-8b08-187acc745ae7") : object "kube-system"/"original-pull-secret" not registered
May 28 16:07:41.777040 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:41.776841    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c44d78c-1adc-4837-8b08-187acc745ae7-dbus\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:42.280883 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:42.280844    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:42.281050 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:42.281007    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 16:07:42.281109 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:42.281067    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret podName:7c44d78c-1adc-4837-8b08-187acc745ae7 nodeName:}" failed. No retries permitted until 2026-05-28 16:07:43.281049558 +0000 UTC m=+9.290430143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret") pod "global-pull-secret-syncer-cgwbl" (UID: "7c44d78c-1adc-4837-8b08-187acc745ae7") : object "kube-system"/"original-pull-secret" not registered
May 28 16:07:42.556205 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:42.555986    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:42.556205 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:42.556122    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:07:43.287883 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:43.287542    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:43.287883 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:43.287770    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 16:07:43.287883 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:43.287838    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret podName:7c44d78c-1adc-4837-8b08-187acc745ae7 nodeName:}" failed. No retries permitted until 2026-05-28 16:07:45.287819955 +0000 UTC m=+11.297200538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret") pod "global-pull-secret-syncer-cgwbl" (UID: "7c44d78c-1adc-4837-8b08-187acc745ae7") : object "kube-system"/"original-pull-secret" not registered
May 28 16:07:43.555547 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:43.555456    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:43.555724 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:43.555582    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:07:43.555724 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:43.555594    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:43.555724 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:43.555712    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:07:44.093518 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:44.093376    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbf5g\" (UniqueName: \"kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g\") pod \"network-check-target-4dnsf\" (UID: \"ddd3a1ae-ac71-4312-8e01-cdd65f3cf383\") " pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:44.093518 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:44.093436    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:44.094071 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:44.093543    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:07:44.094071 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:44.093558    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:07:44.094071 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:44.093582    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:07:44.094071 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:44.093596    2556 projected.go:194] Error preparing data for projected volume kube-api-access-zbf5g for pod openshift-network-diagnostics/network-check-target-4dnsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:07:44.094071 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:44.093599    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs podName:37b01b62-805e-4475-bdeb-48b56af1211b nodeName:}" failed. No retries permitted until 2026-05-28 16:07:52.09358227 +0000 UTC m=+18.102962865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs") pod "network-metrics-daemon-hkxh8" (UID: "37b01b62-805e-4475-bdeb-48b56af1211b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:07:44.094071 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:44.093645    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g podName:ddd3a1ae-ac71-4312-8e01-cdd65f3cf383 nodeName:}" failed. No retries permitted until 2026-05-28 16:07:52.093629645 +0000 UTC m=+18.103010232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbf5g" (UniqueName: "kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g") pod "network-check-target-4dnsf" (UID: "ddd3a1ae-ac71-4312-8e01-cdd65f3cf383") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:07:44.556847 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:44.556814    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:44.557016 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:44.556936    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:07:45.303342 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:45.303282    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:45.303809 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:45.303444    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 16:07:45.303809 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:45.303526    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret podName:7c44d78c-1adc-4837-8b08-187acc745ae7 nodeName:}" failed. No retries permitted until 2026-05-28 16:07:49.303504866 +0000 UTC m=+15.312885451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret") pod "global-pull-secret-syncer-cgwbl" (UID: "7c44d78c-1adc-4837-8b08-187acc745ae7") : object "kube-system"/"original-pull-secret" not registered
May 28 16:07:45.555025 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:45.554853    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:45.555025 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:45.554853    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:45.555025 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:45.554999    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:07:45.555293 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:45.555062    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:07:46.554980 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:46.554945    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:46.555436 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:46.555087    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:07:47.555832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:47.555789    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:47.556298 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:47.555789    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:47.556298 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:47.555937    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:07:47.556298 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:47.556028    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:07:48.555108 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:48.555072    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:48.555272 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:48.555205    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:07:49.331373 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:49.331328    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:49.331840 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:49.331494    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 16:07:49.331840 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:49.331579    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret podName:7c44d78c-1adc-4837-8b08-187acc745ae7 nodeName:}" failed. No retries permitted until 2026-05-28 16:07:57.331560181 +0000 UTC m=+23.340940769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret") pod "global-pull-secret-syncer-cgwbl" (UID: "7c44d78c-1adc-4837-8b08-187acc745ae7") : object "kube-system"/"original-pull-secret" not registered
May 28 16:07:49.555553 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:49.555522    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:49.555752 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:49.555521    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:49.555752 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:49.555642    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:07:49.555752 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:49.555737    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:07:50.555638 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:50.555591    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:50.556070 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:50.555738    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:07:51.554890 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:51.554847    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:51.555054 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:51.554866    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:51.555054 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:51.554995    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:07:51.555174 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:51.555082    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:07:52.152099 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:52.152067    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbf5g\" (UniqueName: \"kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g\") pod \"network-check-target-4dnsf\" (UID: \"ddd3a1ae-ac71-4312-8e01-cdd65f3cf383\") " pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:52.152539 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:52.152116    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:52.152539 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:52.152227    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:07:52.152539 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:52.152250    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:07:52.152539 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:52.152274    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:07:52.152539 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:52.152287    2556 projected.go:194] Error preparing data for projected volume kube-api-access-zbf5g for pod openshift-network-diagnostics/network-check-target-4dnsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:07:52.152539 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:52.152296    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs podName:37b01b62-805e-4475-bdeb-48b56af1211b nodeName:}" failed. No retries permitted until 2026-05-28 16:08:08.152276213 +0000 UTC m=+34.161656793 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs") pod "network-metrics-daemon-hkxh8" (UID: "37b01b62-805e-4475-bdeb-48b56af1211b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:07:52.152539 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:52.152335    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g podName:ddd3a1ae-ac71-4312-8e01-cdd65f3cf383 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:08.152319704 +0000 UTC m=+34.161700309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbf5g" (UniqueName: "kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g") pod "network-check-target-4dnsf" (UID: "ddd3a1ae-ac71-4312-8e01-cdd65f3cf383") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:07:52.555710 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:52.555613    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:52.555871 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:52.555776    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:07:53.555280 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:53.555247    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:53.555668 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:53.555246    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:53.555668 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:53.555372    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:07:53.555668 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:53.555440    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:07:54.556234 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:54.556203    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:54.556575 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:54.556288    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:07:55.555252 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.555094    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:55.555343 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.555174    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:55.555416 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:55.555340    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:07:55.555463 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:55.555407    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:07:55.632002 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.631963    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd" event={"ID":"6aa7fab9-0c77-4523-83a5-5c7789711488","Type":"ContainerStarted","Data":"2e3febc38d01273a47f041debcbe5a1f199f0923bd53fe75d90eba9aff929b97"}
May 28 16:07:55.634283 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.634253    2556 generic.go:358] "Generic (PLEG): container finished" podID="4639d4a1-39b6-4f80-8fef-f00a2e76635e" containerID="477b45edfe53783c99c4b2b1362b6790cdb745712689e731e9807972e481ec26" exitCode=0
May 28 16:07:55.634423 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.634336    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbtzl" event={"ID":"4639d4a1-39b6-4f80-8fef-f00a2e76635e","Type":"ContainerDied","Data":"477b45edfe53783c99c4b2b1362b6790cdb745712689e731e9807972e481ec26"}
May 28 16:07:55.636482 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.636442    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vjq9z" event={"ID":"c21ee6f5-9572-4b26-98ab-a847ba2eb743","Type":"ContainerStarted","Data":"0d733779f9e34fcd225245b50312e0f1314c506e5bd2969d63fe041fb07c6e77"}
May 28 16:07:55.637999 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.637968    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-glx8v" event={"ID":"d327d37e-c1bb-49ce-bbed-0f16c6888fa0","Type":"ContainerStarted","Data":"98592734ad6299ae4e6cd63d8803210aa2e6bfd1a5efc04772774e74aa0de5d1"}
May 28 16:07:55.639528 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.639504    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s2wrk" event={"ID":"6fce69c7-892d-4de8-88d5-b45473ca35d6","Type":"ContainerStarted","Data":"bd4a1f165dd1cae16aedfc544fd395585bfcdd2a813fe3c1bceaec8dbcc140f0"}
May 28 16:07:55.641939 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.641916    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zk27v" event={"ID":"7a61c0f7-38c8-4403-a285-28885c28bf6e","Type":"ContainerStarted","Data":"046be7a97e14bf18bc46966718cd472043bbc560648d1a316721ef331f15dfc4"}
May 28 16:07:55.646778 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.646657    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:07:55.647006 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.646985    2556 generic.go:358] "Generic (PLEG): container finished" podID="694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7" containerID="55bf9e5ab2db9851bbde5a29ff232252316693dfa93eb9789c4a8e32fb12b5da" exitCode=1
May 28 16:07:55.647113 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.647049    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt" event={"ID":"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7","Type":"ContainerStarted","Data":"0f72a2554899bec3b7c86647add6be2f7300bb528783106d3b75dbbdcae46344"}
May 28 16:07:55.647113 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.647071    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt" event={"ID":"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7","Type":"ContainerStarted","Data":"6ec916ce6d676b45d4dce74a35e530a7656c0f959e800d4b040184fad66ffe7d"}
May 28 16:07:55.647113 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.647085    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt" event={"ID":"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7","Type":"ContainerStarted","Data":"4d130d00e89e093a8ac02f0a0a719e54c88a2c8b294cfef7e228515da7135960"}
May 28 16:07:55.647113 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.647099    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt" event={"ID":"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7","Type":"ContainerStarted","Data":"78cb418a4a061da6cf8118a4cc0218005d32b2a75a93a1303d0de24caadb77de"}
May 28 16:07:55.647113 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.647111    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt" event={"ID":"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7","Type":"ContainerDied","Data":"55bf9e5ab2db9851bbde5a29ff232252316693dfa93eb9789c4a8e32fb12b5da"}
May 28 16:07:55.647358 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.647127    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt" event={"ID":"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7","Type":"ContainerStarted","Data":"9dc59853a5204c5cac150fcdb103366e724a280d24cb1be9d80dad5172d9f104"}
May 28 16:07:55.648711 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.648659    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rp6qf" event={"ID":"b03f6d14-4e8f-48cd-95ae-92ad1fda1692","Type":"ContainerStarted","Data":"36077a582f1f5c93110e439574f00bfd318c44125a22c56ece19be6858e6e853"}
May 28 16:07:55.666053 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.666018    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-rp6qf" podStartSLOduration=2.957044861 podStartE2EDuration="20.666006583s" podCreationTimestamp="2026-05-28 16:07:35 +0000 UTC" firstStartedPulling="2026-05-28 16:07:37.159293115 +0000 UTC m=+3.168673711" lastFinishedPulling="2026-05-28 16:07:54.868254836 +0000 UTC m=+20.877635433" observedRunningTime="2026-05-28 16:07:55.665885045 +0000 UTC m=+21.675265647" watchObservedRunningTime="2026-05-28 16:07:55.666006583 +0000 UTC m=+21.675387186"
May 28 16:07:55.693116 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.693071    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vjq9z" podStartSLOduration=3.979443798 podStartE2EDuration="21.693057911s" podCreationTimestamp="2026-05-28 16:07:34 +0000 UTC" firstStartedPulling="2026-05-28 16:07:37.154653216 +0000 UTC m=+3.164033811" lastFinishedPulling="2026-05-28 16:07:54.868267334 +0000 UTC m=+20.877647924" observedRunningTime="2026-05-28 16:07:55.681178362 +0000 UTC m=+21.690558966" watchObservedRunningTime="2026-05-28 16:07:55.693057911 +0000 UTC m=+21.702438514"
May 28 16:07:55.717883 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.717829    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zk27v" podStartSLOduration=11.95008466 podStartE2EDuration="21.717813677s" podCreationTimestamp="2026-05-28 16:07:34 +0000 UTC" firstStartedPulling="2026-05-28 16:07:37.163491911 +0000 UTC m=+3.172872508" lastFinishedPulling="2026-05-28 16:07:46.93122093 +0000 UTC m=+12.940601525" observedRunningTime="2026-05-28 16:07:55.692822106 +0000 UTC m=+21.702202709" watchObservedRunningTime="2026-05-28 16:07:55.717813677 +0000 UTC m=+21.727194280"
May 28 16:07:55.740080 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.740034    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-glx8v" podStartSLOduration=11.956199892 podStartE2EDuration="21.740020631s" podCreationTimestamp="2026-05-28 16:07:34 +0000 UTC" firstStartedPulling="2026-05-28 16:07:37.152995757 +0000 UTC m=+3.162376352" lastFinishedPulling="2026-05-28 16:07:46.936816508 +0000 UTC m=+12.946197091" observedRunningTime="2026-05-28 16:07:55.739906814 +0000 UTC m=+21.749287416" watchObservedRunningTime="2026-05-28 16:07:55.740020631 +0000 UTC m=+21.749401247"
May 28 16:07:55.740503 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.740470    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-s2wrk" podStartSLOduration=3.9486073729999998 podStartE2EDuration="21.740462478s" podCreationTimestamp="2026-05-28 16:07:34 +0000 UTC" firstStartedPulling="2026-05-28 16:07:37.164305276 +0000 UTC m=+3.173685858" lastFinishedPulling="2026-05-28 16:07:54.956160378 +0000 UTC m=+20.965540963" observedRunningTime="2026-05-28 16:07:55.718232481 +0000 UTC m=+21.727613085" watchObservedRunningTime="2026-05-28 16:07:55.740462478 +0000 UTC m=+21.749843080"
May 28 16:07:55.880361 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.880317    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-glx8v"
May 28 16:07:55.880983 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:55.880945    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-glx8v"
May 28 16:07:56.335600 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:56.335577    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 16:07:56.497465 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:56.497316    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T16:07:56.335594717Z","UUID":"db379024-5ff3-4bca-9d72-8598785ab0bd","Handler":null,"Name":"","Endpoint":""}
May 28 16:07:56.500534 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:56.500511    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 16:07:56.500534 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:56.500540    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 16:07:56.555068 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:56.555039    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:56.555200 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:56.555141    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:07:56.652321 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:56.652284    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd" event={"ID":"6aa7fab9-0c77-4523-83a5-5c7789711488","Type":"ContainerStarted","Data":"e61e6680cd525b834bdd5328dfc04b56a47e8bd6b50487718174320c1589fca0"}
May 28 16:07:56.653757 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:56.653696    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-94flb" event={"ID":"efe2114e-38bd-411d-9ef7-7f4b484c4caf","Type":"ContainerStarted","Data":"fd73e43c3b6298ff88c85d2d905835032e99f063fe354b6b1dc80e4a8db90593"}
May 28 16:07:56.686408 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:56.686362    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-94flb" podStartSLOduration=12.902566367 podStartE2EDuration="22.686346673s" podCreationTimestamp="2026-05-28 16:07:34 +0000 UTC" firstStartedPulling="2026-05-28 16:07:37.15382639 +0000 UTC m=+3.163206972" lastFinishedPulling="2026-05-28 16:07:46.937606683 +0000 UTC m=+12.946987278" observedRunningTime="2026-05-28 16:07:56.686049022 +0000 UTC m=+22.695429624" watchObservedRunningTime="2026-05-28 16:07:56.686346673 +0000 UTC m=+22.695727276"
May 28 16:07:57.392750 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:57.392716    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:57.392929 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:57.392840    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 16:07:57.392929 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:57.392904    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret podName:7c44d78c-1adc-4837-8b08-187acc745ae7 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:13.392887785 +0000 UTC m=+39.402268379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret") pod "global-pull-secret-syncer-cgwbl" (UID: "7c44d78c-1adc-4837-8b08-187acc745ae7") : object "kube-system"/"original-pull-secret" not registered
May 28 16:07:57.555614 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:57.555573    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:57.555789 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:57.555573    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:57.555789 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:57.555727    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:07:57.555879 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:57.555779    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:07:57.655610 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:57.655591    2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 28 16:07:58.555123 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:58.555080    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:07:58.555309 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:58.555235    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:07:58.658772 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:58.658727    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd" event={"ID":"6aa7fab9-0c77-4523-83a5-5c7789711488","Type":"ContainerStarted","Data":"121fc5383edafb0771523cc930c6b3aa5646dd15730ae04d63a8f27c2c164689"}
May 28 16:07:58.661617 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:58.661594    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:07:58.661970 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:58.661944    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt" event={"ID":"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7","Type":"ContainerStarted","Data":"1c5403b017518093a5668e10ce83ba0c16f683bed78a74f4b5871e8fd17c9a33"}
May 28 16:07:58.678182 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:58.678130    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dmd" podStartSLOduration=4.276173716 podStartE2EDuration="24.678115567s" podCreationTimestamp="2026-05-28 16:07:34 +0000 UTC" firstStartedPulling="2026-05-28 16:07:37.163291383 +0000 UTC m=+3.172671969" lastFinishedPulling="2026-05-28 16:07:57.565233236 +0000 UTC m=+23.574613820" observedRunningTime="2026-05-28 16:07:58.677533328 +0000 UTC m=+24.686913933" watchObservedRunningTime="2026-05-28 16:07:58.678115567 +0000 UTC m=+24.687496171"
May 28 16:07:59.555825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:59.555794    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:07:59.555960 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:07:59.555835    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:07:59.555960 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:59.555928    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:07:59.556070 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:07:59.556031    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:08:00.555274 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:00.555246    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:08:00.555830 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:00.555348    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:08:00.668753 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:00.668723    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:08:00.669130 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:00.669101    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt" event={"ID":"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7","Type":"ContainerStarted","Data":"828f763e3e9eb5292bb2ddd361f6a1da1815f7accab8c8295f15a483b50b3dfc"}
May 28 16:08:00.669971 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:00.669401    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:08:00.669971 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:00.669426    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:08:00.669971 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:00.669608    2556 scope.go:117] "RemoveContainer" containerID="55bf9e5ab2db9851bbde5a29ff232252316693dfa93eb9789c4a8e32fb12b5da"
May 28 16:08:00.688315 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:00.688294    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:08:00.692454 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:00.692419    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:08:01.555753 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:01.555649    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:08:01.556314 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:01.555657    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:08:01.556314 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:01.555794    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:08:01.556314 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:01.555855    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:08:01.674650 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:01.674614    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:08:01.675027 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:01.674995    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt" event={"ID":"694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7","Type":"ContainerStarted","Data":"1306cab18ffca3aa4113cba3ed37cc8b51a8b4710bcf0c63490ad851ebc8dbca"}
May 28 16:08:01.675151 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:01.675104    2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 28 16:08:01.707639 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:01.707590    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt" podStartSLOduration=9.945324572 podStartE2EDuration="27.707572495s" podCreationTimestamp="2026-05-28 16:07:34 +0000 UTC" firstStartedPulling="2026-05-28 16:07:37.163573965 +0000 UTC m=+3.172954548" lastFinishedPulling="2026-05-28 16:07:54.925821875 +0000 UTC m=+20.935202471" observedRunningTime="2026-05-28 16:08:01.706902517 +0000 UTC m=+27.716283154" watchObservedRunningTime="2026-05-28 16:08:01.707572495 +0000 UTC m=+27.716953101"
May 28 16:08:01.812384 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:01.812299    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4dnsf"]
May 28 16:08:01.812530 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:01.812425    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:08:01.812587 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:01.812526    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:08:01.813246 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:01.813074    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hkxh8"]
May 28 16:08:01.813246 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:01.813188    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:08:01.813424 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:01.813288    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:08:01.813761 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:01.813740    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cgwbl"]
May 28 16:08:01.813855 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:01.813812    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:08:01.813921 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:01.813899    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:08:02.678897 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:02.678560    2556 generic.go:358] "Generic (PLEG): container finished" podID="4639d4a1-39b6-4f80-8fef-f00a2e76635e" containerID="f7139efd2da8a80aedcff8872ea0d96c31d7e94654090ac5e5385da2803b281d" exitCode=0
May 28 16:08:02.678897 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:02.678650    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbtzl" event={"ID":"4639d4a1-39b6-4f80-8fef-f00a2e76635e","Type":"ContainerDied","Data":"f7139efd2da8a80aedcff8872ea0d96c31d7e94654090ac5e5385da2803b281d"}
May 28 16:08:02.679282 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:02.679020    2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 28 16:08:02.843649 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:02.843620    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:08:03.554837 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:03.554810    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:08:03.554966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:03.554851    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:08:03.554966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:03.554820    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:08:03.554966 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:03.554907    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:08:03.555064 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:03.554997    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:08:03.555064 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:03.555054    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:08:03.682454 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:03.682365    2556 generic.go:358] "Generic (PLEG): container finished" podID="4639d4a1-39b6-4f80-8fef-f00a2e76635e" containerID="16c1b894d9e4fe50b2aa85f280d25c8c80008f7aaaf2f885ea15a637fe53adcf" exitCode=0
May 28 16:08:03.682454 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:03.682429    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbtzl" event={"ID":"4639d4a1-39b6-4f80-8fef-f00a2e76635e","Type":"ContainerDied","Data":"16c1b894d9e4fe50b2aa85f280d25c8c80008f7aaaf2f885ea15a637fe53adcf"}
May 28 16:08:04.686345 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:04.686311    2556 generic.go:358] "Generic (PLEG): container finished" podID="4639d4a1-39b6-4f80-8fef-f00a2e76635e" containerID="5a9dfe1bb22f373ddc20258ed5a035e8d4794b5c71776f98f50854596d75f963" exitCode=0
May 28 16:08:04.686345 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:04.686349    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbtzl" event={"ID":"4639d4a1-39b6-4f80-8fef-f00a2e76635e","Type":"ContainerDied","Data":"5a9dfe1bb22f373ddc20258ed5a035e8d4794b5c71776f98f50854596d75f963"}
May 28 16:08:04.799816 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:04.799786    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-glx8v"
May 28 16:08:04.799952 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:04.799913    2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 28 16:08:04.800341 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:04.800320    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-glx8v"
May 28 16:08:05.555050 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:05.555022    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:08:05.555190 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:05.555022    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:08:05.555190 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:05.555132    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:08:05.555268 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:05.555023    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:08:05.555298 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:05.555193    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:08:05.555298 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:05.555279    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:08:07.555720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.555695    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:08:07.556051 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.555723    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:08:07.556051 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.555695    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:08:07.556051 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:07.555791    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4dnsf" podUID="ddd3a1ae-ac71-4312-8e01-cdd65f3cf383"
May 28 16:08:07.556051 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:07.555876    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgwbl" podUID="7c44d78c-1adc-4837-8b08-187acc745ae7"
May 28 16:08:07.556051 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:07.555951    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hkxh8" podUID="37b01b62-805e-4475-bdeb-48b56af1211b"
May 28 16:08:07.820565 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.820485    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-100.ec2.internal" event="NodeReady"
May 28 16:08:07.820764 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.820643    2556 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 16:08:07.853686 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.853651    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cf89b6c69-v7drk"]
May 28 16:08:07.855720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.855566    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:07.858081 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.858056    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 16:08:07.858245 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.858225    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 16:08:07.858327 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.858312    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gp2cl\""
May 28 16:08:07.858377 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.858333    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 16:08:07.863432 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.863413    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8vnhr"]
May 28 16:08:07.864182 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.863984    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 16:08:07.865389 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.865371    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:07.865708 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.865613    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c7b4h"]
May 28 16:08:07.867577 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.867559    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:08:07.869091 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.869069    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 16:08:07.869197 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.869122    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rfj6w\""
May 28 16:08:07.869516 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.869488    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 16:08:07.869516 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.869502    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cf89b6c69-v7drk"]
May 28 16:08:07.870931 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.870908    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 16:08:07.871031 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.870952    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 16:08:07.871091 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.870954    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 16:08:07.871091 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.870921    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ckq8r\""
May 28 16:08:07.874165 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.874141    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8vnhr"]
May 28 16:08:07.877299 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.877209    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c7b4h"]
May 28 16:08:07.977763 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.977731    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77b5a949-28ac-4915-866c-95fb3745514b-registry-certificates\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:07.977763 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.977764    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77b5a949-28ac-4915-866c-95fb3745514b-image-registry-private-configuration\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:07.977976 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.977787    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:07.977976 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.977811    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77b5a949-28ac-4915-866c-95fb3745514b-trusted-ca\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:07.977976 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.977834    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0016d8a-4dbe-4f30-82c2-30508031581f-config-volume\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:07.977976 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.977859    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg77s\" (UniqueName: \"kubernetes.io/projected/f0016d8a-4dbe-4f30-82c2-30508031581f-kube-api-access-hg77s\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:07.977976 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.977879    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhdrd\" (UniqueName: \"kubernetes.io/projected/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-kube-api-access-dhdrd\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:08:07.977976 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.977904    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:07.977976 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.977948    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77b5a949-28ac-4915-866c-95fb3745514b-ca-trust-extracted\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:07.978195 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.978034    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0016d8a-4dbe-4f30-82c2-30508031581f-tmp-dir\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:07.978195 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.978075    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb9gh\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-kube-api-access-gb9gh\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:07.978195 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.978093    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:08:07.978195 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.978112    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77b5a949-28ac-4915-866c-95fb3745514b-installation-pull-secrets\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:07.978195 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:07.978136    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-bound-sa-token\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.079053 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.078964    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77b5a949-28ac-4915-866c-95fb3745514b-trusted-ca\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.079053 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079008    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0016d8a-4dbe-4f30-82c2-30508031581f-config-volume\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:08.079053 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079048    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hg77s\" (UniqueName: \"kubernetes.io/projected/f0016d8a-4dbe-4f30-82c2-30508031581f-kube-api-access-hg77s\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:08.079313 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079076    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhdrd\" (UniqueName: \"kubernetes.io/projected/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-kube-api-access-dhdrd\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:08:08.079313 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079102    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.079313 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079126    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77b5a949-28ac-4915-866c-95fb3745514b-ca-trust-extracted\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.079442 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079401    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0016d8a-4dbe-4f30-82c2-30508031581f-tmp-dir\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:08.079505 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079474    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gb9gh\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-kube-api-access-gb9gh\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.079549 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079525    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:08:08.079593 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079551    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77b5a949-28ac-4915-866c-95fb3745514b-installation-pull-secrets\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.079593 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.079563    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 16:08:08.079593 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.079579    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf89b6c69-v7drk: secret "image-registry-tls" not found
May 28 16:08:08.079593 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079577    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-bound-sa-token\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.079811 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.079634    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls podName:77b5a949-28ac-4915-866c-95fb3745514b nodeName:}" failed. No retries permitted until 2026-05-28 16:08:08.579615095 +0000 UTC m=+34.588995697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls") pod "image-registry-cf89b6c69-v7drk" (UID: "77b5a949-28ac-4915-866c-95fb3745514b") : secret "image-registry-tls" not found
May 28 16:08:08.079811 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.079645    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:08:08.079811 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079666    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77b5a949-28ac-4915-866c-95fb3745514b-registry-certificates\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.079968 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.079825    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert podName:a854eb33-ccd9-437b-beec-3a4a3bdbf9c1 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:08.579810901 +0000 UTC m=+34.589191499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert") pod "ingress-canary-c7b4h" (UID: "a854eb33-ccd9-437b-beec-3a4a3bdbf9c1") : secret "canary-serving-cert" not found
May 28 16:08:08.079968 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079849    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77b5a949-28ac-4915-866c-95fb3745514b-image-registry-private-configuration\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.079968 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079852    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77b5a949-28ac-4915-866c-95fb3745514b-ca-trust-extracted\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.079968 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079839    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f0016d8a-4dbe-4f30-82c2-30508031581f-tmp-dir\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:08.079968 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.079882    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:08.079968 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.079951    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:08:08.080234 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.079996    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls podName:f0016d8a-4dbe-4f30-82c2-30508031581f nodeName:}" failed. No retries permitted until 2026-05-28 16:08:08.579983622 +0000 UTC m=+34.589364204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls") pod "dns-default-8vnhr" (UID: "f0016d8a-4dbe-4f30-82c2-30508031581f") : secret "dns-default-metrics-tls" not found
May 28 16:08:08.080234 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.080040    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f0016d8a-4dbe-4f30-82c2-30508031581f-config-volume\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:08.080337 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.080229    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77b5a949-28ac-4915-866c-95fb3745514b-registry-certificates\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.080920 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.080886    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77b5a949-28ac-4915-866c-95fb3745514b-trusted-ca\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.084469 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.084442    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77b5a949-28ac-4915-866c-95fb3745514b-installation-pull-secrets\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.084578 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.084450    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77b5a949-28ac-4915-866c-95fb3745514b-image-registry-private-configuration\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.091091 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.091046    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg77s\" (UniqueName: \"kubernetes.io/projected/f0016d8a-4dbe-4f30-82c2-30508031581f-kube-api-access-hg77s\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:08.091315 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.091297    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-bound-sa-token\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.091451 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.091433    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhdrd\" (UniqueName: \"kubernetes.io/projected/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-kube-api-access-dhdrd\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:08:08.091520 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.091505    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb9gh\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-kube-api-access-gb9gh\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.180395 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.180360    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbf5g\" (UniqueName: \"kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g\") pod \"network-check-target-4dnsf\" (UID: \"ddd3a1ae-ac71-4312-8e01-cdd65f3cf383\") " pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:08:08.180564 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.180419    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:08:08.180564 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.180514    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:08.180655 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.180591    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs podName:37b01b62-805e-4475-bdeb-48b56af1211b nodeName:}" failed. No retries permitted until 2026-05-28 16:08:40.180573475 +0000 UTC m=+66.189954059 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs") pod "network-metrics-daemon-hkxh8" (UID: "37b01b62-805e-4475-bdeb-48b56af1211b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:08.180655 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.180524    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:08:08.180655 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.180616    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:08:08.180655 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.180634    2556 projected.go:194] Error preparing data for projected volume kube-api-access-zbf5g for pod openshift-network-diagnostics/network-check-target-4dnsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:08.180822 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.180693    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g podName:ddd3a1ae-ac71-4312-8e01-cdd65f3cf383 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:40.180663189 +0000 UTC m=+66.190043785 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zbf5g" (UniqueName: "kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g") pod "network-check-target-4dnsf" (UID: "ddd3a1ae-ac71-4312-8e01-cdd65f3cf383") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:08.583405 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.583371    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:08.583821 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.583422    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:08:08.583821 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:08.583459    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:08.583821 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.583526    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 16:08:08.583821 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.583541    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:08:08.583821 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.583544    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf89b6c69-v7drk: secret "image-registry-tls" not found
May 28 16:08:08.583821 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.583574    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:08:08.583821 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.583592    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls podName:f0016d8a-4dbe-4f30-82c2-30508031581f nodeName:}" failed. No retries permitted until 2026-05-28 16:08:09.583579389 +0000 UTC m=+35.592959969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls") pod "dns-default-8vnhr" (UID: "f0016d8a-4dbe-4f30-82c2-30508031581f") : secret "dns-default-metrics-tls" not found
May 28 16:08:08.583821 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.583605    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls podName:77b5a949-28ac-4915-866c-95fb3745514b nodeName:}" failed. No retries permitted until 2026-05-28 16:08:09.583599305 +0000 UTC m=+35.592979886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls") pod "image-registry-cf89b6c69-v7drk" (UID: "77b5a949-28ac-4915-866c-95fb3745514b") : secret "image-registry-tls" not found
May 28 16:08:08.583821 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:08.583629    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert podName:a854eb33-ccd9-437b-beec-3a4a3bdbf9c1 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:09.583614174 +0000 UTC m=+35.592994755 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert") pod "ingress-canary-c7b4h" (UID: "a854eb33-ccd9-437b-beec-3a4a3bdbf9c1") : secret "canary-serving-cert" not found
May 28 16:08:09.555377 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:09.555340    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:08:09.555534 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:09.555391    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:08:09.555534 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:09.555340    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:08:09.558129 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:09.558110    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 16:08:09.558722 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:09.558697    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 16:08:09.558833 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:09.558796    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xz8bh\""
May 28 16:08:09.558833 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:09.558807    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qjc5m\""
May 28 16:08:09.558833 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:09.558802    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 16:08:09.558833 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:09.558829    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 16:08:09.589945 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:09.589925    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:09.590267 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:09.589972    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:09.590267 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:09.590067    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 16:08:09.590267 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:09.590076    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:08:09.590267 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:09.590142    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls podName:f0016d8a-4dbe-4f30-82c2-30508031581f nodeName:}" failed. No retries permitted until 2026-05-28 16:08:11.59012261 +0000 UTC m=+37.599503200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls") pod "dns-default-8vnhr" (UID: "f0016d8a-4dbe-4f30-82c2-30508031581f") : secret "dns-default-metrics-tls" not found
May 28 16:08:09.590267 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:09.590145    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:08:09.590267 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:09.590081    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf89b6c69-v7drk: secret "image-registry-tls" not found
May 28 16:08:09.590267 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:09.590230    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls podName:77b5a949-28ac-4915-866c-95fb3745514b nodeName:}" failed. No retries permitted until 2026-05-28 16:08:11.590215316 +0000 UTC m=+37.599595914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls") pod "image-registry-cf89b6c69-v7drk" (UID: "77b5a949-28ac-4915-866c-95fb3745514b") : secret "image-registry-tls" not found
May 28 16:08:09.590267 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:09.590263    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:08:09.590553 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:09.590326    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert podName:a854eb33-ccd9-437b-beec-3a4a3bdbf9c1 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:11.590311179 +0000 UTC m=+37.599691764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert") pod "ingress-canary-c7b4h" (UID: "a854eb33-ccd9-437b-beec-3a4a3bdbf9c1") : secret "canary-serving-cert" not found
May 28 16:08:11.607209 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:11.607111    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:08:11.608048 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:11.607320    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:08:11.608048 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:11.607325    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:11.608048 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:11.607400    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert podName:a854eb33-ccd9-437b-beec-3a4a3bdbf9c1 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:15.607377922 +0000 UTC m=+41.616758524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert") pod "ingress-canary-c7b4h" (UID: "a854eb33-ccd9-437b-beec-3a4a3bdbf9c1") : secret "canary-serving-cert" not found
May 28 16:08:11.608048 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:11.607414    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:08:11.608048 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:11.607464    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls podName:f0016d8a-4dbe-4f30-82c2-30508031581f nodeName:}" failed. No retries permitted until 2026-05-28 16:08:15.60745004 +0000 UTC m=+41.616830625 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls") pod "dns-default-8vnhr" (UID: "f0016d8a-4dbe-4f30-82c2-30508031581f") : secret "dns-default-metrics-tls" not found
May 28 16:08:11.608048 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:11.607493    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:11.608048 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:11.607599    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 16:08:11.608048 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:11.607609    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf89b6c69-v7drk: secret "image-registry-tls" not found
May 28 16:08:11.608048 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:11.607648    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls podName:77b5a949-28ac-4915-866c-95fb3745514b nodeName:}" failed. No retries permitted until 2026-05-28 16:08:15.607636544 +0000 UTC m=+41.617017133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls") pod "image-registry-cf89b6c69-v7drk" (UID: "77b5a949-28ac-4915-866c-95fb3745514b") : secret "image-registry-tls" not found
May 28 16:08:13.423626 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:13.423591    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:08:13.425938 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:13.425914    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c44d78c-1adc-4837-8b08-187acc745ae7-original-pull-secret\") pod \"global-pull-secret-syncer-cgwbl\" (UID: \"7c44d78c-1adc-4837-8b08-187acc745ae7\") " pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:08:13.472475 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:13.472349    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgwbl"
May 28 16:08:13.627261 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:13.627229    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cgwbl"]
May 28 16:08:13.631419 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:08:13.631394    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c44d78c_1adc_4837_8b08_187acc745ae7.slice/crio-c1ebe6e2b5211006620fa824ec7eddb4031e0bda270cf1704af0b25b824f0636 WatchSource:0}: Error finding container c1ebe6e2b5211006620fa824ec7eddb4031e0bda270cf1704af0b25b824f0636: Status 404 returned error can't find the container with id c1ebe6e2b5211006620fa824ec7eddb4031e0bda270cf1704af0b25b824f0636
May 28 16:08:13.705030 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:13.704998    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cgwbl" event={"ID":"7c44d78c-1adc-4837-8b08-187acc745ae7","Type":"ContainerStarted","Data":"c1ebe6e2b5211006620fa824ec7eddb4031e0bda270cf1704af0b25b824f0636"}
May 28 16:08:13.707742 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:13.707714    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbtzl" event={"ID":"4639d4a1-39b6-4f80-8fef-f00a2e76635e","Type":"ContainerStarted","Data":"c00ab7f1479dce09338af4f6e8ff6e71270ee879b4f653fc90c9096d77daa57c"}
May 28 16:08:14.712439 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:14.712343    2556 generic.go:358] "Generic (PLEG): container finished" podID="4639d4a1-39b6-4f80-8fef-f00a2e76635e" containerID="c00ab7f1479dce09338af4f6e8ff6e71270ee879b4f653fc90c9096d77daa57c" exitCode=0
May 28 16:08:14.712439 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:14.712393    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbtzl" event={"ID":"4639d4a1-39b6-4f80-8fef-f00a2e76635e","Type":"ContainerDied","Data":"c00ab7f1479dce09338af4f6e8ff6e71270ee879b4f653fc90c9096d77daa57c"}
May 28 16:08:15.643785 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:15.643745    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:15.643953 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:15.643818    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:15.643953 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:15.643871    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:08:15.643953 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:15.643901    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:08:15.644103 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:15.643950    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 16:08:15.644103 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:15.643967    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf89b6c69-v7drk: secret "image-registry-tls" not found
May 28 16:08:15.644103 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:15.643979    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:08:15.644103 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:15.644014    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls podName:f0016d8a-4dbe-4f30-82c2-30508031581f nodeName:}" failed. No retries permitted until 2026-05-28 16:08:23.643991491 +0000 UTC m=+49.653372079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls") pod "dns-default-8vnhr" (UID: "f0016d8a-4dbe-4f30-82c2-30508031581f") : secret "dns-default-metrics-tls" not found
May 28 16:08:15.644103 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:15.644033    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls podName:77b5a949-28ac-4915-866c-95fb3745514b nodeName:}" failed. No retries permitted until 2026-05-28 16:08:23.64402491 +0000 UTC m=+49.653405491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls") pod "image-registry-cf89b6c69-v7drk" (UID: "77b5a949-28ac-4915-866c-95fb3745514b") : secret "image-registry-tls" not found
May 28 16:08:15.644103 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:15.644043    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert podName:a854eb33-ccd9-437b-beec-3a4a3bdbf9c1 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:23.644037535 +0000 UTC m=+49.653418115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert") pod "ingress-canary-c7b4h" (UID: "a854eb33-ccd9-437b-beec-3a4a3bdbf9c1") : secret "canary-serving-cert" not found
May 28 16:08:15.717362 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:15.717328    2556 generic.go:358] "Generic (PLEG): container finished" podID="4639d4a1-39b6-4f80-8fef-f00a2e76635e" containerID="72aa157975782a7fb1b11ad6a2585e4347d96b080394e7ce021de9d30b0cbeee" exitCode=0
May 28 16:08:15.717831 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:15.717379    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbtzl" event={"ID":"4639d4a1-39b6-4f80-8fef-f00a2e76635e","Type":"ContainerDied","Data":"72aa157975782a7fb1b11ad6a2585e4347d96b080394e7ce021de9d30b0cbeee"}
May 28 16:08:16.722544 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:16.722505    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rbtzl" event={"ID":"4639d4a1-39b6-4f80-8fef-f00a2e76635e","Type":"ContainerStarted","Data":"37e02f6e89d8801322a2e352ff6bc677a5b526e3dd7053da7ff9ad56a1f7e383"}
May 28 16:08:16.745615 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:16.745563    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rbtzl" podStartSLOduration=6.428484442 podStartE2EDuration="42.745549166s" podCreationTimestamp="2026-05-28 16:07:34 +0000 UTC" firstStartedPulling="2026-05-28 16:07:37.15842025 +0000 UTC m=+3.167800831" lastFinishedPulling="2026-05-28 16:08:13.475484966 +0000 UTC m=+39.484865555" observedRunningTime="2026-05-28 16:08:16.74546207 +0000 UTC m=+42.754842673" watchObservedRunningTime="2026-05-28 16:08:16.745549166 +0000 UTC m=+42.754929768"
May 28 16:08:18.727380 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:18.727350    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cgwbl" event={"ID":"7c44d78c-1adc-4837-8b08-187acc745ae7","Type":"ContainerStarted","Data":"71d1fc2e2274441a6bd9b11de275c658f9392db8d96ccd3998a67afb4acadc08"}
May 28 16:08:18.740430 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:18.740387    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cgwbl" podStartSLOduration=33.16822068 podStartE2EDuration="37.740375388s" podCreationTimestamp="2026-05-28 16:07:41 +0000 UTC" firstStartedPulling="2026-05-28 16:08:13.633594613 +0000 UTC m=+39.642975193" lastFinishedPulling="2026-05-28 16:08:18.205749313 +0000 UTC m=+44.215129901" observedRunningTime="2026-05-28 16:08:18.740362012 +0000 UTC m=+44.749742616" watchObservedRunningTime="2026-05-28 16:08:18.740375388 +0000 UTC m=+44.749755991"
May 28 16:08:23.696997 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:23.696957    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:23.697428 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:23.697027    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:23.697428 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:23.697100    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:08:23.697428 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:23.697122    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:08:23.697428 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:23.697171    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 16:08:23.697428 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:23.697184    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:08:23.697428 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:23.697191    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf89b6c69-v7drk: secret "image-registry-tls" not found
May 28 16:08:23.697428 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:23.697203    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls podName:f0016d8a-4dbe-4f30-82c2-30508031581f nodeName:}" failed. No retries permitted until 2026-05-28 16:08:39.697182615 +0000 UTC m=+65.706563208 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls") pod "dns-default-8vnhr" (UID: "f0016d8a-4dbe-4f30-82c2-30508031581f") : secret "dns-default-metrics-tls" not found
May 28 16:08:23.697428 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:23.697221    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert podName:a854eb33-ccd9-437b-beec-3a4a3bdbf9c1 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:39.697212561 +0000 UTC m=+65.706593143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert") pod "ingress-canary-c7b4h" (UID: "a854eb33-ccd9-437b-beec-3a4a3bdbf9c1") : secret "canary-serving-cert" not found
May 28 16:08:23.697428 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:23.697233    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls podName:77b5a949-28ac-4915-866c-95fb3745514b nodeName:}" failed. No retries permitted until 2026-05-28 16:08:39.697226545 +0000 UTC m=+65.706607125 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls") pod "image-registry-cf89b6c69-v7drk" (UID: "77b5a949-28ac-4915-866c-95fb3745514b") : secret "image-registry-tls" not found
May 28 16:08:33.692545 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:33.692510    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-28pqt"
May 28 16:08:39.713981 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:39.713938    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:08:39.714408 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:39.714000    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:08:39.714408 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:39.714046    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:08:39.714408 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:39.714090    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:08:39.714408 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:39.714150    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 16:08:39.714408 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:39.714159    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert podName:a854eb33-ccd9-437b-beec-3a4a3bdbf9c1 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:11.714141686 +0000 UTC m=+97.723522268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert") pod "ingress-canary-c7b4h" (UID: "a854eb33-ccd9-437b-beec-3a4a3bdbf9c1") : secret "canary-serving-cert" not found
May 28 16:08:39.714408 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:39.714163    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf89b6c69-v7drk: secret "image-registry-tls" not found
May 28 16:08:39.714408 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:39.714210    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls podName:77b5a949-28ac-4915-866c-95fb3745514b nodeName:}" failed. No retries permitted until 2026-05-28 16:09:11.714194558 +0000 UTC m=+97.723575153 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls") pod "image-registry-cf89b6c69-v7drk" (UID: "77b5a949-28ac-4915-866c-95fb3745514b") : secret "image-registry-tls" not found
May 28 16:08:39.714408 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:39.714160    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:08:39.714408 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:39.714272    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls podName:f0016d8a-4dbe-4f30-82c2-30508031581f nodeName:}" failed. No retries permitted until 2026-05-28 16:09:11.71425961 +0000 UTC m=+97.723640191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls") pod "dns-default-8vnhr" (UID: "f0016d8a-4dbe-4f30-82c2-30508031581f") : secret "dns-default-metrics-tls" not found
May 28 16:08:40.218124 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:40.218089    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:08:40.218297 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:40.218234    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zbf5g\" (UniqueName: \"kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g\") pod \"network-check-target-4dnsf\" (UID: \"ddd3a1ae-ac71-4312-8e01-cdd65f3cf383\") " pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:08:40.220775 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:40.220759    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 16:08:40.220833 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:40.220815    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 16:08:40.228714 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:40.228694    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 16:08:40.228771 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:08:40.228747    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs podName:37b01b62-805e-4475-bdeb-48b56af1211b nodeName:}" failed. No retries permitted until 2026-05-28 16:09:44.228732814 +0000 UTC m=+130.238113401 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs") pod "network-metrics-daemon-hkxh8" (UID: "37b01b62-805e-4475-bdeb-48b56af1211b") : secret "metrics-daemon-secret" not found
May 28 16:08:40.230443 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:40.230431    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 16:08:40.241495 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:40.241472    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbf5g\" (UniqueName: \"kubernetes.io/projected/ddd3a1ae-ac71-4312-8e01-cdd65f3cf383-kube-api-access-zbf5g\") pod \"network-check-target-4dnsf\" (UID: \"ddd3a1ae-ac71-4312-8e01-cdd65f3cf383\") " pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:08:40.468220 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:40.468138    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qjc5m\""
May 28 16:08:40.476049 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:40.476028    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:08:40.590149 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:40.590119    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4dnsf"]
May 28 16:08:40.594161 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:08:40.594118    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd3a1ae_ac71_4312_8e01_cdd65f3cf383.slice/crio-ed20691f8dddbc32b006993fcda99f2823780ad7f8308fad1c37f0e2d0e5a8a1 WatchSource:0}: Error finding container ed20691f8dddbc32b006993fcda99f2823780ad7f8308fad1c37f0e2d0e5a8a1: Status 404 returned error can't find the container with id ed20691f8dddbc32b006993fcda99f2823780ad7f8308fad1c37f0e2d0e5a8a1
May 28 16:08:40.768571 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:40.768493    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4dnsf" event={"ID":"ddd3a1ae-ac71-4312-8e01-cdd65f3cf383","Type":"ContainerStarted","Data":"ed20691f8dddbc32b006993fcda99f2823780ad7f8308fad1c37f0e2d0e5a8a1"}
May 28 16:08:43.775027 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:43.774942    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4dnsf" event={"ID":"ddd3a1ae-ac71-4312-8e01-cdd65f3cf383","Type":"ContainerStarted","Data":"b6d8376a263aa062b1a6647157b3f78d5c3754e46298b9166f6dcaeef05a294e"}
May 28 16:08:43.775389 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:43.775092    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:08:43.789925 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:08:43.789881    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4dnsf" podStartSLOduration=66.93264522 podStartE2EDuration="1m9.789867592s" podCreationTimestamp="2026-05-28 16:07:34 +0000 UTC" firstStartedPulling="2026-05-28 16:08:40.596084022 +0000 UTC m=+66.605464604" lastFinishedPulling="2026-05-28 16:08:43.453306383 +0000 UTC m=+69.462686976" observedRunningTime="2026-05-28 16:08:43.788687234 +0000 UTC m=+69.798067828" watchObservedRunningTime="2026-05-28 16:08:43.789867592 +0000 UTC m=+69.799248194"
May 28 16:09:08.875465 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.875328    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"]
May 28 16:09:08.877784 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.877763    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:08.879921 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.879901    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-n4l87\""
May 28 16:09:08.880225 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.880207    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 28 16:09:08.880281 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.880231    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 16:09:08.880792 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.880774    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 16:09:08.882148 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.882133    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 28 16:09:08.886862 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.886834    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"]
May 28 16:09:08.974825 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.974799    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fm7gk"]
May 28 16:09:08.976521 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.976507    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fm7gk"
May 28 16:09:08.978776 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.978753    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 28 16:09:08.979069 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.979045    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-brztr\""
May 28 16:09:08.979377 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.979058    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 28 16:09:08.981242 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.981223    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-nf4ql"]
May 28 16:09:08.983572 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.983553    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-856d89658d-wfcxn"]
May 28 16:09:08.983701 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.983687    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:08.985501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.985484    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fm7gk"]
May 28 16:09:08.985584 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.985566    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:08.986128 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.986108    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 28 16:09:08.986454 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.986142    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 28 16:09:08.986559 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.986203    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9zk4h\""
May 28 16:09:08.986658 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.986320    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 28 16:09:08.986991 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.986975    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 28 16:09:08.988185 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.988170    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9fr8w\""
May 28 16:09:08.988263 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.988230    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 28 16:09:08.988476 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.988459    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 28 16:09:08.988576 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.988460    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 16:09:08.988639 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.988586    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 28 16:09:08.989264 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.989248    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 16:09:08.989479 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.989461    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 28 16:09:08.993786 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.993764    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 28 16:09:08.993890 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.993844    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-nf4ql"]
May 28 16:09:08.994791 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:08.994772    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-856d89658d-wfcxn"]
May 28 16:09:09.019246 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.019207    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:09.019395 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.019284    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk7tj\" (UniqueName: \"kubernetes.io/projected/d3d0e71d-f6bc-43ae-8058-99036cfa080a-kube-api-access-qk7tj\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:09.019395 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.019316    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d3d0e71d-f6bc-43ae-8058-99036cfa080a-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:09.081318 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.081282    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-gq7tm"]
May 28 16:09:09.083714 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.083698    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.085836 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.085810    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 28 16:09:09.085965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.085934    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 16:09:09.085965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.085918    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 28 16:09:09.086066 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.085964    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 16:09:09.086066 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.086016    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mv5w2\""
May 28 16:09:09.091518 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.091502    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 28 16:09:09.093473 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.093450    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-gq7tm"]
May 28 16:09:09.119751 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.119725    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-stats-auth\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.119856 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.119763    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qk7tj\" (UniqueName: \"kubernetes.io/projected/d3d0e71d-f6bc-43ae-8058-99036cfa080a-kube-api-access-qk7tj\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:09.119856 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.119782    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.119856 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.119808    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d3d0e71d-f6bc-43ae-8058-99036cfa080a-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:09.120004 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.119868    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8b391da-56e4-4ac4-b40a-39aef2e34b9a-trusted-ca\") pod \"console-operator-76dff48d59-nf4ql\" (UID: \"a8b391da-56e4-4ac4-b40a-39aef2e34b9a\") " pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:09.120004 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.119896    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-default-certificate\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.120004 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.119960    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8b391da-56e4-4ac4-b40a-39aef2e34b9a-serving-cert\") pod \"console-operator-76dff48d59-nf4ql\" (UID: \"a8b391da-56e4-4ac4-b40a-39aef2e34b9a\") " pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:09.120004 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.119992    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tws86\" (UniqueName: \"kubernetes.io/projected/a8f87799-8eac-43d5-b7d2-488970f9c798-kube-api-access-tws86\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.120171 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.120023    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-567zz\" (UniqueName: \"kubernetes.io/projected/1c5d206c-686d-4c75-976f-9e3605fea7c9-kube-api-access-567zz\") pod \"volume-data-source-validator-5cf8c89d64-fm7gk\" (UID: \"1c5d206c-686d-4c75-976f-9e3605fea7c9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fm7gk"
May 28 16:09:09.120171 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.120050    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.120171 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.120076    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8b391da-56e4-4ac4-b40a-39aef2e34b9a-config\") pod \"console-operator-76dff48d59-nf4ql\" (UID: \"a8b391da-56e4-4ac4-b40a-39aef2e34b9a\") " pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:09.120171 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.120109    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9fwl\" (UniqueName: \"kubernetes.io/projected/a8b391da-56e4-4ac4-b40a-39aef2e34b9a-kube-api-access-z9fwl\") pod \"console-operator-76dff48d59-nf4ql\" (UID: \"a8b391da-56e4-4ac4-b40a-39aef2e34b9a\") " pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:09.120171 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.120150    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:09.120471 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:09.120218    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 16:09:09.120471 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:09.120276    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls podName:d3d0e71d-f6bc-43ae-8058-99036cfa080a nodeName:}" failed. No retries permitted until 2026-05-28 16:09:09.620263076 +0000 UTC m=+95.629643657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-t5299" (UID: "d3d0e71d-f6bc-43ae-8058-99036cfa080a") : secret "cluster-monitoring-operator-tls" not found
May 28 16:09:09.120471 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.120379    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d3d0e71d-f6bc-43ae-8058-99036cfa080a-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:09.129154 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.129105    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk7tj\" (UniqueName: \"kubernetes.io/projected/d3d0e71d-f6bc-43ae-8058-99036cfa080a-kube-api-access-qk7tj\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:09.221422 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.221372    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4e434f4-b121-4fb0-898f-edc4eb1840e5-service-ca-bundle\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.221422 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.221424    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4e434f4-b121-4fb0-898f-edc4eb1840e5-serving-cert\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.221626 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.221491    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8b391da-56e4-4ac4-b40a-39aef2e34b9a-trusted-ca\") pod \"console-operator-76dff48d59-nf4ql\" (UID: \"a8b391da-56e4-4ac4-b40a-39aef2e34b9a\") " pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:09.221626 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.221521    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4e434f4-b121-4fb0-898f-edc4eb1840e5-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.221626 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.221577    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-default-certificate\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.221626 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.221599    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8b391da-56e4-4ac4-b40a-39aef2e34b9a-serving-cert\") pod \"console-operator-76dff48d59-nf4ql\" (UID: \"a8b391da-56e4-4ac4-b40a-39aef2e34b9a\") " pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:09.221790 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.221629    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tws86\" (UniqueName: \"kubernetes.io/projected/a8f87799-8eac-43d5-b7d2-488970f9c798-kube-api-access-tws86\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.221790 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.221764    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v8vf\" (UniqueName: \"kubernetes.io/projected/f4e434f4-b121-4fb0-898f-edc4eb1840e5-kube-api-access-6v8vf\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.221875 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.221824    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-567zz\" (UniqueName: \"kubernetes.io/projected/1c5d206c-686d-4c75-976f-9e3605fea7c9-kube-api-access-567zz\") pod \"volume-data-source-validator-5cf8c89d64-fm7gk\" (UID: \"1c5d206c-686d-4c75-976f-9e3605fea7c9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fm7gk"
May 28 16:09:09.221935 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.221882    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.221935 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.221923    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8b391da-56e4-4ac4-b40a-39aef2e34b9a-config\") pod \"console-operator-76dff48d59-nf4ql\" (UID: \"a8b391da-56e4-4ac4-b40a-39aef2e34b9a\") " pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:09.222084 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.221984    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9fwl\" (UniqueName: \"kubernetes.io/projected/a8b391da-56e4-4ac4-b40a-39aef2e34b9a-kube-api-access-z9fwl\") pod \"console-operator-76dff48d59-nf4ql\" (UID: \"a8b391da-56e4-4ac4-b40a-39aef2e34b9a\") " pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:09.222084 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:09.222061    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 16:09:09.222200 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:09.222137    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs podName:a8f87799-8eac-43d5-b7d2-488970f9c798 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:09.722119231 +0000 UTC m=+95.731499818 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs") pod "router-default-856d89658d-wfcxn" (UID: "a8f87799-8eac-43d5-b7d2-488970f9c798") : secret "router-metrics-certs-default" not found
May 28 16:09:09.222339 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.222315    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-stats-auth\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.222420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.222348    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f4e434f4-b121-4fb0-898f-edc4eb1840e5-snapshots\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.222420 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.222391    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.222566 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:09.222546    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle podName:a8f87799-8eac-43d5-b7d2-488970f9c798 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:09.722528597 +0000 UTC m=+95.731909201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle") pod "router-default-856d89658d-wfcxn" (UID: "a8f87799-8eac-43d5-b7d2-488970f9c798") : configmap references non-existent config key: service-ca.crt
May 28 16:09:09.222566 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.222546    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4e434f4-b121-4fb0-898f-edc4eb1840e5-tmp\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.222743 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.222581    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8b391da-56e4-4ac4-b40a-39aef2e34b9a-trusted-ca\") pod \"console-operator-76dff48d59-nf4ql\" (UID: \"a8b391da-56e4-4ac4-b40a-39aef2e34b9a\") " pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:09.222743 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.222554    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8b391da-56e4-4ac4-b40a-39aef2e34b9a-config\") pod \"console-operator-76dff48d59-nf4ql\" (UID: \"a8b391da-56e4-4ac4-b40a-39aef2e34b9a\") " pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:09.224196 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.224170    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8b391da-56e4-4ac4-b40a-39aef2e34b9a-serving-cert\") pod \"console-operator-76dff48d59-nf4ql\" (UID: \"a8b391da-56e4-4ac4-b40a-39aef2e34b9a\") " pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:09.224273 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.224180    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-default-certificate\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.224448 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.224430    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-stats-auth\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.230275 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.230257    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tws86\" (UniqueName: \"kubernetes.io/projected/a8f87799-8eac-43d5-b7d2-488970f9c798-kube-api-access-tws86\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.230618 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.230595    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-567zz\" (UniqueName: \"kubernetes.io/projected/1c5d206c-686d-4c75-976f-9e3605fea7c9-kube-api-access-567zz\") pod \"volume-data-source-validator-5cf8c89d64-fm7gk\" (UID: \"1c5d206c-686d-4c75-976f-9e3605fea7c9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fm7gk"
May 28 16:09:09.230720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.230598    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9fwl\" (UniqueName: \"kubernetes.io/projected/a8b391da-56e4-4ac4-b40a-39aef2e34b9a-kube-api-access-z9fwl\") pod \"console-operator-76dff48d59-nf4ql\" (UID: \"a8b391da-56e4-4ac4-b40a-39aef2e34b9a\") " pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:09.289704 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.289665    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fm7gk"
May 28 16:09:09.297265 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.297243    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:09.324720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.323463    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f4e434f4-b121-4fb0-898f-edc4eb1840e5-snapshots\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.324720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.323542    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4e434f4-b121-4fb0-898f-edc4eb1840e5-tmp\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.324720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.323561    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4e434f4-b121-4fb0-898f-edc4eb1840e5-service-ca-bundle\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.324720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.323581    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4e434f4-b121-4fb0-898f-edc4eb1840e5-serving-cert\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.324720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.323619    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4e434f4-b121-4fb0-898f-edc4eb1840e5-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.324720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.323658    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6v8vf\" (UniqueName: \"kubernetes.io/projected/f4e434f4-b121-4fb0-898f-edc4eb1840e5-kube-api-access-6v8vf\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.324720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.324550    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4e434f4-b121-4fb0-898f-edc4eb1840e5-tmp\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.324720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.324722    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/f4e434f4-b121-4fb0-898f-edc4eb1840e5-snapshots\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.325232 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.325211    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4e434f4-b121-4fb0-898f-edc4eb1840e5-service-ca-bundle\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.325492 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.325469    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4e434f4-b121-4fb0-898f-edc4eb1840e5-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.327137 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.327119    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f4e434f4-b121-4fb0-898f-edc4eb1840e5-serving-cert\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.331279 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.331262    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v8vf\" (UniqueName: \"kubernetes.io/projected/f4e434f4-b121-4fb0-898f-edc4eb1840e5-kube-api-access-6v8vf\") pod \"insights-operator-78bdfb888c-gq7tm\" (UID: \"f4e434f4-b121-4fb0-898f-edc4eb1840e5\") " pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.393539 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.393507    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-gq7tm"
May 28 16:09:09.417263 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.416656    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fm7gk"]
May 28 16:09:09.422614 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:09.422584    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c5d206c_686d_4c75_976f_9e3605fea7c9.slice/crio-3040b4ff20a4a383cf515f8c457b8a4ab033e8275e95241c2d6e22077a7a1d1f WatchSource:0}: Error finding container 3040b4ff20a4a383cf515f8c457b8a4ab033e8275e95241c2d6e22077a7a1d1f: Status 404 returned error can't find the container with id 3040b4ff20a4a383cf515f8c457b8a4ab033e8275e95241c2d6e22077a7a1d1f
May 28 16:09:09.435787 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.435756    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-nf4ql"]
May 28 16:09:09.439588 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:09.439549    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b391da_56e4_4ac4_b40a_39aef2e34b9a.slice/crio-c4ad441f3727600c5a634763324378d9cfbdad5ff4d986c0780c92ebbe2ffc68 WatchSource:0}: Error finding container c4ad441f3727600c5a634763324378d9cfbdad5ff4d986c0780c92ebbe2ffc68: Status 404 returned error can't find the container with id c4ad441f3727600c5a634763324378d9cfbdad5ff4d986c0780c92ebbe2ffc68
May 28 16:09:09.520173 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.520140    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-gq7tm"]
May 28 16:09:09.523949 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:09.523921    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e434f4_b121_4fb0_898f_edc4eb1840e5.slice/crio-75b36b1032d626a2df517b6e7fa097a08e4f43957545ded6b73c23a21e7ce3ae WatchSource:0}: Error finding container 75b36b1032d626a2df517b6e7fa097a08e4f43957545ded6b73c23a21e7ce3ae: Status 404 returned error can't find the container with id 75b36b1032d626a2df517b6e7fa097a08e4f43957545ded6b73c23a21e7ce3ae
May 28 16:09:09.625994 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.625949    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:09.626160 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:09.626104    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 16:09:09.626200 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:09.626168    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls podName:d3d0e71d-f6bc-43ae-8058-99036cfa080a nodeName:}" failed. No retries permitted until 2026-05-28 16:09:10.626153153 +0000 UTC m=+96.635533733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-t5299" (UID: "d3d0e71d-f6bc-43ae-8058-99036cfa080a") : secret "cluster-monitoring-operator-tls" not found
May 28 16:09:09.726744 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.726636    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.726903 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.726749    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:09.726903 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:09.726792    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 16:09:09.726903 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:09.726870    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs podName:a8f87799-8eac-43d5-b7d2-488970f9c798 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:10.726852877 +0000 UTC m=+96.736233458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs") pod "router-default-856d89658d-wfcxn" (UID: "a8f87799-8eac-43d5-b7d2-488970f9c798") : secret "router-metrics-certs-default" not found
May 28 16:09:09.726903 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:09.726884    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle podName:a8f87799-8eac-43d5-b7d2-488970f9c798 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:10.726877599 +0000 UTC m=+96.736258180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle") pod "router-default-856d89658d-wfcxn" (UID: "a8f87799-8eac-43d5-b7d2-488970f9c798") : configmap references non-existent config key: service-ca.crt
May 28 16:09:09.822018 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.821985    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql" event={"ID":"a8b391da-56e4-4ac4-b40a-39aef2e34b9a","Type":"ContainerStarted","Data":"c4ad441f3727600c5a634763324378d9cfbdad5ff4d986c0780c92ebbe2ffc68"}
May 28 16:09:09.822866 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.822843    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-gq7tm" event={"ID":"f4e434f4-b121-4fb0-898f-edc4eb1840e5","Type":"ContainerStarted","Data":"75b36b1032d626a2df517b6e7fa097a08e4f43957545ded6b73c23a21e7ce3ae"}
May 28 16:09:09.823663 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:09.823644    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fm7gk" event={"ID":"1c5d206c-686d-4c75-976f-9e3605fea7c9","Type":"ContainerStarted","Data":"3040b4ff20a4a383cf515f8c457b8a4ab033e8275e95241c2d6e22077a7a1d1f"}
May 28 16:09:10.634992 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:10.634955    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:10.635363 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:10.635119    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 16:09:10.635363 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:10.635186    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls podName:d3d0e71d-f6bc-43ae-8058-99036cfa080a nodeName:}" failed. No retries permitted until 2026-05-28 16:09:12.635170843 +0000 UTC m=+98.644551428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-t5299" (UID: "d3d0e71d-f6bc-43ae-8058-99036cfa080a") : secret "cluster-monitoring-operator-tls" not found
May 28 16:09:10.736274 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:10.736234    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:10.736457 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:10.736342    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:10.736457 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:10.736409    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 16:09:10.736585 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:10.736487    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs podName:a8f87799-8eac-43d5-b7d2-488970f9c798 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:12.736465181 +0000 UTC m=+98.745845778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs") pod "router-default-856d89658d-wfcxn" (UID: "a8f87799-8eac-43d5-b7d2-488970f9c798") : secret "router-metrics-certs-default" not found
May 28 16:09:10.736585 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:10.736508    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle podName:a8f87799-8eac-43d5-b7d2-488970f9c798 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:12.736497782 +0000 UTC m=+98.745878364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle") pod "router-default-856d89658d-wfcxn" (UID: "a8f87799-8eac-43d5-b7d2-488970f9c798") : configmap references non-existent config key: service-ca.crt
May 28 16:09:11.745333 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:11.745297    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:09:11.745849 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:11.745361    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls\") pod \"image-registry-cf89b6c69-v7drk\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") " pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:09:11.745849 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:11.745400    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:09:11.745849 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:11.745462    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:09:11.745849 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:11.745498    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:09:11.745849 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:11.745472    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 16:09:11.745849 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:11.745540    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls podName:f0016d8a-4dbe-4f30-82c2-30508031581f nodeName:}" failed. No retries permitted until 2026-05-28 16:10:15.745516295 +0000 UTC m=+161.754896891 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls") pod "dns-default-8vnhr" (UID: "f0016d8a-4dbe-4f30-82c2-30508031581f") : secret "dns-default-metrics-tls" not found
May 28 16:09:11.745849 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:11.745543    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-cf89b6c69-v7drk: secret "image-registry-tls" not found
May 28 16:09:11.745849 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:11.745561    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert podName:a854eb33-ccd9-437b-beec-3a4a3bdbf9c1 nodeName:}" failed. No retries permitted until 2026-05-28 16:10:15.745550254 +0000 UTC m=+161.754930842 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert") pod "ingress-canary-c7b4h" (UID: "a854eb33-ccd9-437b-beec-3a4a3bdbf9c1") : secret "canary-serving-cert" not found
May 28 16:09:11.745849 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:11.745578    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls podName:77b5a949-28ac-4915-866c-95fb3745514b nodeName:}" failed. No retries permitted until 2026-05-28 16:10:15.745568723 +0000 UTC m=+161.754949309 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls") pod "image-registry-cf89b6c69-v7drk" (UID: "77b5a949-28ac-4915-866c-95fb3745514b") : secret "image-registry-tls" not found
May 28 16:09:11.829501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:11.829465    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fm7gk" event={"ID":"1c5d206c-686d-4c75-976f-9e3605fea7c9","Type":"ContainerStarted","Data":"43cb7281d608f4fe6a802fe79a765ee20f3f4879fe6844ca0281989c17684304"}
May 28 16:09:12.652125 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:12.652092    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:12.652259 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:12.652220    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 16:09:12.652311 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:12.652290    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls podName:d3d0e71d-f6bc-43ae-8058-99036cfa080a nodeName:}" failed. No retries permitted until 2026-05-28 16:09:16.652268648 +0000 UTC m=+102.661649249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-t5299" (UID: "d3d0e71d-f6bc-43ae-8058-99036cfa080a") : secret "cluster-monitoring-operator-tls" not found
May 28 16:09:12.753011 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:12.752908    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:12.753396 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:12.753016    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:12.753396 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:12.753063    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 16:09:12.753396 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:12.753132    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs podName:a8f87799-8eac-43d5-b7d2-488970f9c798 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:16.753113131 +0000 UTC m=+102.762493711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs") pod "router-default-856d89658d-wfcxn" (UID: "a8f87799-8eac-43d5-b7d2-488970f9c798") : secret "router-metrics-certs-default" not found
May 28 16:09:12.753396 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:12.753148    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle podName:a8f87799-8eac-43d5-b7d2-488970f9c798 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:16.75314184 +0000 UTC m=+102.762522421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle") pod "router-default-856d89658d-wfcxn" (UID: "a8f87799-8eac-43d5-b7d2-488970f9c798") : configmap references non-existent config key: service-ca.crt
May 28 16:09:12.833576 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:12.833552    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/0.log"
May 28 16:09:12.833749 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:12.833587    2556 generic.go:358] "Generic (PLEG): container finished" podID="a8b391da-56e4-4ac4-b40a-39aef2e34b9a" containerID="2577d74de26436dd8583384a904c68f9443497499afad5275e54a1e26754fabc" exitCode=255
May 28 16:09:12.833749 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:12.833652    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql" event={"ID":"a8b391da-56e4-4ac4-b40a-39aef2e34b9a","Type":"ContainerDied","Data":"2577d74de26436dd8583384a904c68f9443497499afad5275e54a1e26754fabc"}
May 28 16:09:12.833945 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:12.833925    2556 scope.go:117] "RemoveContainer" containerID="2577d74de26436dd8583384a904c68f9443497499afad5275e54a1e26754fabc"
May 28 16:09:12.835073 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:12.835040    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-gq7tm" event={"ID":"f4e434f4-b121-4fb0-898f-edc4eb1840e5","Type":"ContainerStarted","Data":"9f3ac721cb3d5b1960d0fd85b17c39386915597322d37e6595607d4296f8b342"}
May 28 16:09:12.848244 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:12.848154    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fm7gk" podStartSLOduration=3.00389846 podStartE2EDuration="4.848139732s" podCreationTimestamp="2026-05-28 16:09:08 +0000 UTC" firstStartedPulling="2026-05-28 16:09:09.424161638 +0000 UTC m=+95.433542219" lastFinishedPulling="2026-05-28 16:09:11.26840291 +0000 UTC m=+97.277783491" observedRunningTime="2026-05-28 16:09:11.843356474 +0000 UTC m=+97.852737077" watchObservedRunningTime="2026-05-28 16:09:12.848139732 +0000 UTC m=+98.857520336"
May 28 16:09:12.865720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:12.865664    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-gq7tm" podStartSLOduration=0.912025429 podStartE2EDuration="3.865652459s" podCreationTimestamp="2026-05-28 16:09:09 +0000 UTC" firstStartedPulling="2026-05-28 16:09:09.52569826 +0000 UTC m=+95.535078841" lastFinishedPulling="2026-05-28 16:09:12.479325287 +0000 UTC m=+98.488705871" observedRunningTime="2026-05-28 16:09:12.864998942 +0000 UTC m=+98.874379545" watchObservedRunningTime="2026-05-28 16:09:12.865652459 +0000 UTC m=+98.875033061"
May 28 16:09:13.355990 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.355956    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-d987z"]
May 28 16:09:13.357818 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.357794    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d987z"
May 28 16:09:13.359890 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.359868    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-q4lp9\""
May 28 16:09:13.365393 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.365366    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-d987z"]
May 28 16:09:13.458866 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.458825    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z85sv\" (UniqueName: \"kubernetes.io/projected/c6150d23-7376-434d-a87e-93833ab4acf2-kube-api-access-z85sv\") pod \"network-check-source-7f44b6dd87-d987z\" (UID: \"c6150d23-7376-434d-a87e-93833ab4acf2\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d987z"
May 28 16:09:13.560008 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.559974    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z85sv\" (UniqueName: \"kubernetes.io/projected/c6150d23-7376-434d-a87e-93833ab4acf2-kube-api-access-z85sv\") pod \"network-check-source-7f44b6dd87-d987z\" (UID: \"c6150d23-7376-434d-a87e-93833ab4acf2\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d987z"
May 28 16:09:13.568238 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.568204    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z85sv\" (UniqueName: \"kubernetes.io/projected/c6150d23-7376-434d-a87e-93833ab4acf2-kube-api-access-z85sv\") pod \"network-check-source-7f44b6dd87-d987z\" (UID: \"c6150d23-7376-434d-a87e-93833ab4acf2\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d987z"
May 28 16:09:13.666990 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.666947    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d987z"
May 28 16:09:13.784197 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.784169    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-d987z"]
May 28 16:09:13.787099 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:13.787063    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6150d23_7376_434d_a87e_93833ab4acf2.slice/crio-5d4dab0027d9dddde4d17fc6dbbb5d0b5b8fdba147c24f39032f3ced25e97785 WatchSource:0}: Error finding container 5d4dab0027d9dddde4d17fc6dbbb5d0b5b8fdba147c24f39032f3ced25e97785: Status 404 returned error can't find the container with id 5d4dab0027d9dddde4d17fc6dbbb5d0b5b8fdba147c24f39032f3ced25e97785
May 28 16:09:13.845444 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.845403    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d987z" event={"ID":"c6150d23-7376-434d-a87e-93833ab4acf2","Type":"ContainerStarted","Data":"5d4dab0027d9dddde4d17fc6dbbb5d0b5b8fdba147c24f39032f3ced25e97785"}
May 28 16:09:13.847268 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.847249    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/1.log"
May 28 16:09:13.847651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.847628    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/0.log"
May 28 16:09:13.847791 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.847684    2556 generic.go:358] "Generic (PLEG): container finished" podID="a8b391da-56e4-4ac4-b40a-39aef2e34b9a" containerID="c289d4c31b62e344aad6ce268e9fb7c15270b8218947cc31a5bb7ca6a328c1bc" exitCode=255
May 28 16:09:13.847791 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.847766    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql" event={"ID":"a8b391da-56e4-4ac4-b40a-39aef2e34b9a","Type":"ContainerDied","Data":"c289d4c31b62e344aad6ce268e9fb7c15270b8218947cc31a5bb7ca6a328c1bc"}
May 28 16:09:13.847913 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.847819    2556 scope.go:117] "RemoveContainer" containerID="2577d74de26436dd8583384a904c68f9443497499afad5275e54a1e26754fabc"
May 28 16:09:13.848050 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:13.848030    2556 scope.go:117] "RemoveContainer" containerID="c289d4c31b62e344aad6ce268e9fb7c15270b8218947cc31a5bb7ca6a328c1bc"
May 28 16:09:13.848268 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:13.848245    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-nf4ql_openshift-console-operator(a8b391da-56e4-4ac4-b40a-39aef2e34b9a)\"" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql" podUID="a8b391da-56e4-4ac4-b40a-39aef2e34b9a"
May 28 16:09:14.778842 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:14.778808    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4dnsf"
May 28 16:09:14.852229 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:14.852195    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d987z" event={"ID":"c6150d23-7376-434d-a87e-93833ab4acf2","Type":"ContainerStarted","Data":"fd0b1434cc56fffa0b7ee2a5d9af1366eecb5089a011716a82976df25beb67c8"}
May 28 16:09:14.853627 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:14.853604    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/1.log"
May 28 16:09:14.853986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:14.853970    2556 scope.go:117] "RemoveContainer" containerID="c289d4c31b62e344aad6ce268e9fb7c15270b8218947cc31a5bb7ca6a328c1bc"
May 28 16:09:14.854145 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:14.854127    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-nf4ql_openshift-console-operator(a8b391da-56e4-4ac4-b40a-39aef2e34b9a)\"" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql" podUID="a8b391da-56e4-4ac4-b40a-39aef2e34b9a"
May 28 16:09:14.865645 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:14.865600    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-d987z" podStartSLOduration=1.865585657 podStartE2EDuration="1.865585657s" podCreationTimestamp="2026-05-28 16:09:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:09:14.865138121 +0000 UTC m=+100.874518733" watchObservedRunningTime="2026-05-28 16:09:14.865585657 +0000 UTC m=+100.874966263"
May 28 16:09:16.042262 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:16.042234    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rp6qf_b03f6d14-4e8f-48cd-95ae-92ad1fda1692/dns-node-resolver/0.log"
May 28 16:09:16.687345 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:16.687292    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:16.687599 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:16.687583    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 16:09:16.687686 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:16.687662    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls podName:d3d0e71d-f6bc-43ae-8058-99036cfa080a nodeName:}" failed. No retries permitted until 2026-05-28 16:09:24.687638227 +0000 UTC m=+110.697018815 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-t5299" (UID: "d3d0e71d-f6bc-43ae-8058-99036cfa080a") : secret "cluster-monitoring-operator-tls" not found
May 28 16:09:16.787794 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:16.787738    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:16.787975 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:16.787905    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:16.787975 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:16.787903    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 16:09:16.788044 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:16.788008    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs podName:a8f87799-8eac-43d5-b7d2-488970f9c798 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:24.787994823 +0000 UTC m=+110.797375404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs") pod "router-default-856d89658d-wfcxn" (UID: "a8f87799-8eac-43d5-b7d2-488970f9c798") : secret "router-metrics-certs-default" not found
May 28 16:09:16.788106 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:16.788090    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle podName:a8f87799-8eac-43d5-b7d2-488970f9c798 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:24.78807667 +0000 UTC m=+110.797457252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle") pod "router-default-856d89658d-wfcxn" (UID: "a8f87799-8eac-43d5-b7d2-488970f9c798") : configmap references non-existent config key: service-ca.crt
May 28 16:09:16.845810 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:16.845787    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zk27v_7a61c0f7-38c8-4403-a285-28885c28bf6e/node-ca/0.log"
May 28 16:09:19.297988 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:19.297960    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:19.298352 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:19.297998    2556 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:19.298392 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:19.298351    2556 scope.go:117] "RemoveContainer" containerID="c289d4c31b62e344aad6ce268e9fb7c15270b8218947cc31a5bb7ca6a328c1bc"
May 28 16:09:19.298533 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:19.298515    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-nf4ql_openshift-console-operator(a8b391da-56e4-4ac4-b40a-39aef2e34b9a)\"" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql" podUID="a8b391da-56e4-4ac4-b40a-39aef2e34b9a"
May 28 16:09:24.749804 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:24.749763    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:24.750214 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:24.749901    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 16:09:24.750214 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:24.749971    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls podName:d3d0e71d-f6bc-43ae-8058-99036cfa080a nodeName:}" failed. No retries permitted until 2026-05-28 16:09:40.749956179 +0000 UTC m=+126.759336761 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-t5299" (UID: "d3d0e71d-f6bc-43ae-8058-99036cfa080a") : secret "cluster-monitoring-operator-tls" not found
May 28 16:09:24.851597 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:24.851552    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:24.851819 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:24.851714    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:24.854460 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:24.854428    2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 28 16:09:24.854602 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:24.854491    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle podName:a8f87799-8eac-43d5-b7d2-488970f9c798 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:40.854468324 +0000 UTC m=+126.863848919 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle") pod "router-default-856d89658d-wfcxn" (UID: "a8f87799-8eac-43d5-b7d2-488970f9c798") : configmap references non-existent config key: service-ca.crt
May 28 16:09:24.854602 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:24.854583    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs podName:a8f87799-8eac-43d5-b7d2-488970f9c798 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:40.854556019 +0000 UTC m=+126.863936618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs") pod "router-default-856d89658d-wfcxn" (UID: "a8f87799-8eac-43d5-b7d2-488970f9c798") : secret "router-metrics-certs-default" not found
May 28 16:09:33.555819 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:33.555781    2556 scope.go:117] "RemoveContainer" containerID="c289d4c31b62e344aad6ce268e9fb7c15270b8218947cc31a5bb7ca6a328c1bc"
May 28 16:09:33.899338 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:33.899312    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:09:33.899702 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:33.899687    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/1.log"
May 28 16:09:33.899754 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:33.899718    2556 generic.go:358] "Generic (PLEG): container finished" podID="a8b391da-56e4-4ac4-b40a-39aef2e34b9a" containerID="283eae2cff1a7a88cd53071b1f13deee20dcee5fca751a6e578e93cd808ee573" exitCode=255
May 28 16:09:33.899793 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:33.899753    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql" event={"ID":"a8b391da-56e4-4ac4-b40a-39aef2e34b9a","Type":"ContainerDied","Data":"283eae2cff1a7a88cd53071b1f13deee20dcee5fca751a6e578e93cd808ee573"}
May 28 16:09:33.899793 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:33.899784    2556 scope.go:117] "RemoveContainer" containerID="c289d4c31b62e344aad6ce268e9fb7c15270b8218947cc31a5bb7ca6a328c1bc"
May 28 16:09:33.900106 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:33.900089    2556 scope.go:117] "RemoveContainer" containerID="283eae2cff1a7a88cd53071b1f13deee20dcee5fca751a6e578e93cd808ee573"
May 28 16:09:33.900279 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:33.900261    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-nf4ql_openshift-console-operator(a8b391da-56e4-4ac4-b40a-39aef2e34b9a)\"" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql" podUID="a8b391da-56e4-4ac4-b40a-39aef2e34b9a"
May 28 16:09:34.903639 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:34.903613    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:09:39.297993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:39.297965    2556 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:39.297993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:39.297995    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:09:39.298649 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:39.298282    2556 scope.go:117] "RemoveContainer" containerID="283eae2cff1a7a88cd53071b1f13deee20dcee5fca751a6e578e93cd808ee573"
May 28 16:09:39.298649 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:39.298428    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-nf4ql_openshift-console-operator(a8b391da-56e4-4ac4-b40a-39aef2e34b9a)\"" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql" podUID="a8b391da-56e4-4ac4-b40a-39aef2e34b9a"
May 28 16:09:39.908929 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:39.908890    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-h825c"]
May 28 16:09:39.913008 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:39.912988    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-h825c"
May 28 16:09:39.917484 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:39.917460    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w7thz\""
May 28 16:09:39.917484 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:39.917470    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 28 16:09:39.917664 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:39.917523    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 28 16:09:39.923508 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:39.923488    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-h825c"]
May 28 16:09:39.972968 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:39.972939    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82f8d4e9-3580-470b-aad5-93ba5afa4984-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-h825c\" (UID: \"82f8d4e9-3580-470b-aad5-93ba5afa4984\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-h825c"
May 28 16:09:39.973086 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:39.972985    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82f8d4e9-3580-470b-aad5-93ba5afa4984-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-h825c\" (UID: \"82f8d4e9-3580-470b-aad5-93ba5afa4984\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-h825c"
May 28 16:09:40.027068 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.027042    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m587s"]
May 28 16:09:40.029958 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.029945    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.032216 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.032200    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4lxdz\""
May 28 16:09:40.032720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.032692    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 16:09:40.033189 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.033172    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 16:09:40.045277 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.045254    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m587s"]
May 28 16:09:40.073798 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.073773    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82f8d4e9-3580-470b-aad5-93ba5afa4984-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-h825c\" (UID: \"82f8d4e9-3580-470b-aad5-93ba5afa4984\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-h825c"
May 28 16:09:40.073911 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.073871    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.073911 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.073895    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-crio-socket\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.073999 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.073910    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.074038 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.073997    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npc2r\" (UniqueName: \"kubernetes.io/projected/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-kube-api-access-npc2r\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.074078 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.074037    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82f8d4e9-3580-470b-aad5-93ba5afa4984-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-h825c\" (UID: \"82f8d4e9-3580-470b-aad5-93ba5afa4984\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-h825c"
May 28 16:09:40.074116 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.074078    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-data-volume\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.074514 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.074499    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82f8d4e9-3580-470b-aad5-93ba5afa4984-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-h825c\" (UID: \"82f8d4e9-3580-470b-aad5-93ba5afa4984\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-h825c"
May 28 16:09:40.076295 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.076276    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/82f8d4e9-3580-470b-aad5-93ba5afa4984-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-h825c\" (UID: \"82f8d4e9-3580-470b-aad5-93ba5afa4984\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-h825c"
May 28 16:09:40.175464 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.175396    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.175464 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.175428    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-crio-socket\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.175464 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.175445    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.175725 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.175495    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-npc2r\" (UniqueName: \"kubernetes.io/projected/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-kube-api-access-npc2r\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.175725 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.175533    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-crio-socket\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.175725 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.175534    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-data-volume\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.175880 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.175820    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-data-volume\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.175955 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.175935    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.177711 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.177693    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.182942 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.182922    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npc2r\" (UniqueName: \"kubernetes.io/projected/87eaea8d-f1c6-4517-a859-4b5dc7c90e7d-kube-api-access-npc2r\") pod \"insights-runtime-extractor-m587s\" (UID: \"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d\") " pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.221922 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.221896    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-h825c"
May 28 16:09:40.338064 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.338025    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m587s"
May 28 16:09:40.339582 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.339557    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-h825c"]
May 28 16:09:40.343141 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:40.343119    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f8d4e9_3580_470b_aad5_93ba5afa4984.slice/crio-fadbf1eae9ad35e9b17d2b599488ead288a54aa86e0d55ab4c4e3df90b1108d5 WatchSource:0}: Error finding container fadbf1eae9ad35e9b17d2b599488ead288a54aa86e0d55ab4c4e3df90b1108d5: Status 404 returned error can't find the container with id fadbf1eae9ad35e9b17d2b599488ead288a54aa86e0d55ab4c4e3df90b1108d5
May 28 16:09:40.456157 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.456073    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m587s"]
May 28 16:09:40.459757 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:40.459730    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87eaea8d_f1c6_4517_a859_4b5dc7c90e7d.slice/crio-0707c6ec40f21cffa0b581632c39d6398c9f905dbf4925f3dff5541c7ef119b7 WatchSource:0}: Error finding container 0707c6ec40f21cffa0b581632c39d6398c9f905dbf4925f3dff5541c7ef119b7: Status 404 returned error can't find the container with id 0707c6ec40f21cffa0b581632c39d6398c9f905dbf4925f3dff5541c7ef119b7
May 28 16:09:40.783162 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.779919    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:40.783162 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.783152    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d0e71d-f6bc-43ae-8058-99036cfa080a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-t5299\" (UID: \"d3d0e71d-f6bc-43ae-8058-99036cfa080a\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:40.880974 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.880929    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:40.881165 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.881015    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:40.881755 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.881728    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f87799-8eac-43d5-b7d2-488970f9c798-service-ca-bundle\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:40.883555 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.883533    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8f87799-8eac-43d5-b7d2-488970f9c798-metrics-certs\") pod \"router-default-856d89658d-wfcxn\" (UID: \"a8f87799-8eac-43d5-b7d2-488970f9c798\") " pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:40.919260 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.919217    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m587s" event={"ID":"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d","Type":"ContainerStarted","Data":"45e4fb556c198994c86d751019102674bee9fdf6dcf990c988cfb30701d91e3a"}
May 28 16:09:40.919400 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.919265    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m587s" event={"ID":"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d","Type":"ContainerStarted","Data":"0707c6ec40f21cffa0b581632c39d6398c9f905dbf4925f3dff5541c7ef119b7"}
May 28 16:09:40.920280 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.920249    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-h825c" event={"ID":"82f8d4e9-3580-470b-aad5-93ba5afa4984","Type":"ContainerStarted","Data":"fadbf1eae9ad35e9b17d2b599488ead288a54aa86e0d55ab4c4e3df90b1108d5"}
May 28 16:09:40.987709 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.987662    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-n4l87\""
May 28 16:09:40.995745 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:40.995717    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"
May 28 16:09:41.104042 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:41.104012    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9fr8w\""
May 28 16:09:41.112829 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:41.112751    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:41.132765 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:41.132734    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299"]
May 28 16:09:41.146277 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:41.146242    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d0e71d_f6bc_43ae_8058_99036cfa080a.slice/crio-2342142a9eddda32f3c7ad2cd07b17aed2cfc87a0a0b9e136a705d76121e1b96 WatchSource:0}: Error finding container 2342142a9eddda32f3c7ad2cd07b17aed2cfc87a0a0b9e136a705d76121e1b96: Status 404 returned error can't find the container with id 2342142a9eddda32f3c7ad2cd07b17aed2cfc87a0a0b9e136a705d76121e1b96
May 28 16:09:41.294501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:41.294462    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-856d89658d-wfcxn"]
May 28 16:09:41.490899 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:41.490870    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f87799_8eac_43d5_b7d2_488970f9c798.slice/crio-779968e1f47582bc8f6b32b73923d08bdf5126f625ab5deaf2fa0800ddf7d28c WatchSource:0}: Error finding container 779968e1f47582bc8f6b32b73923d08bdf5126f625ab5deaf2fa0800ddf7d28c: Status 404 returned error can't find the container with id 779968e1f47582bc8f6b32b73923d08bdf5126f625ab5deaf2fa0800ddf7d28c
May 28 16:09:41.923892 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:41.923856    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-856d89658d-wfcxn" event={"ID":"a8f87799-8eac-43d5-b7d2-488970f9c798","Type":"ContainerStarted","Data":"b42f8e6044b47b4137bdcb523c141d14234b5c77cdff0e7387e6fdfa6ffc6123"}
May 28 16:09:41.923892 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:41.923896    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-856d89658d-wfcxn" event={"ID":"a8f87799-8eac-43d5-b7d2-488970f9c798","Type":"ContainerStarted","Data":"779968e1f47582bc8f6b32b73923d08bdf5126f625ab5deaf2fa0800ddf7d28c"}
May 28 16:09:41.925484 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:41.925461    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m587s" event={"ID":"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d","Type":"ContainerStarted","Data":"2bfff0173d86ac72cf411ad6fb9d145ca899d2bcad79350bae3345d23258f857"}
May 28 16:09:41.926664 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:41.926639    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-h825c" event={"ID":"82f8d4e9-3580-470b-aad5-93ba5afa4984","Type":"ContainerStarted","Data":"996ba96e9d5dfb6b2322eaee56f7b3ef86c33ea6323ed418869e20ee6b314c5e"}
May 28 16:09:41.927594 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:41.927569    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299" event={"ID":"d3d0e71d-f6bc-43ae-8058-99036cfa080a","Type":"ContainerStarted","Data":"2342142a9eddda32f3c7ad2cd07b17aed2cfc87a0a0b9e136a705d76121e1b96"}
May 28 16:09:41.941296 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:41.941257    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-856d89658d-wfcxn" podStartSLOduration=33.941242064 podStartE2EDuration="33.941242064s" podCreationTimestamp="2026-05-28 16:09:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:09:41.939949983 +0000 UTC m=+127.949330587" watchObservedRunningTime="2026-05-28 16:09:41.941242064 +0000 UTC m=+127.950622677"
May 28 16:09:41.953247 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:41.953194    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-h825c" podStartSLOduration=1.7596412639999999 podStartE2EDuration="2.953178505s" podCreationTimestamp="2026-05-28 16:09:39 +0000 UTC" firstStartedPulling="2026-05-28 16:09:40.345310609 +0000 UTC m=+126.354691191" lastFinishedPulling="2026-05-28 16:09:41.538847844 +0000 UTC m=+127.548228432" observedRunningTime="2026-05-28 16:09:41.952354677 +0000 UTC m=+127.961735280" watchObservedRunningTime="2026-05-28 16:09:41.953178505 +0000 UTC m=+127.962559108"
May 28 16:09:42.113009 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:42.112969    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:42.115326 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:42.115307    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:42.931128 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:42.931090    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:42.932470 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:42.932302    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-856d89658d-wfcxn"
May 28 16:09:43.864511 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:43.864428    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl"]
May 28 16:09:43.867431 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:43.867410    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl"
May 28 16:09:43.870239 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:43.870188    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 28 16:09:43.870826 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:43.870810    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cnh62\""
May 28 16:09:43.875250 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:43.875231    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl"]
May 28 16:09:43.909112 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:43.909090    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a873deb5-30f8-4880-9d59-1ae75ff3d242-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl\" (UID: \"a873deb5-30f8-4880-9d59-1ae75ff3d242\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl"
May 28 16:09:43.934886 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:43.934860    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m587s" event={"ID":"87eaea8d-f1c6-4517-a859-4b5dc7c90e7d","Type":"ContainerStarted","Data":"8d3f9921d47adf703bf71c31905e5478064527a998d8da7ae74fa079ce24e1cd"}
May 28 16:09:43.936214 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:43.936194    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299" event={"ID":"d3d0e71d-f6bc-43ae-8058-99036cfa080a","Type":"ContainerStarted","Data":"828b3c4ac67ded6881b565b24355e6e6f75300dc5e0d37634c24c9d7ffe692a8"}
May 28 16:09:43.953866 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:43.953831    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m587s" podStartSLOduration=1.092108402 podStartE2EDuration="3.953819653s" podCreationTimestamp="2026-05-28 16:09:40 +0000 UTC" firstStartedPulling="2026-05-28 16:09:40.515317125 +0000 UTC m=+126.524697705" lastFinishedPulling="2026-05-28 16:09:43.377028367 +0000 UTC m=+129.386408956" observedRunningTime="2026-05-28 16:09:43.952626273 +0000 UTC m=+129.962006876" watchObservedRunningTime="2026-05-28 16:09:43.953819653 +0000 UTC m=+129.963200255"
May 28 16:09:43.971665 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:43.968892    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-t5299" podStartSLOduration=33.737828362 podStartE2EDuration="35.968878394s" podCreationTimestamp="2026-05-28 16:09:08 +0000 UTC" firstStartedPulling="2026-05-28 16:09:41.148755567 +0000 UTC m=+127.158136148" lastFinishedPulling="2026-05-28 16:09:43.379805597 +0000 UTC m=+129.389186180" observedRunningTime="2026-05-28 16:09:43.967762679 +0000 UTC m=+129.977143282" watchObservedRunningTime="2026-05-28 16:09:43.968878394 +0000 UTC m=+129.978259001"
May 28 16:09:44.010136 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:44.010102    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a873deb5-30f8-4880-9d59-1ae75ff3d242-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl\" (UID: \"a873deb5-30f8-4880-9d59-1ae75ff3d242\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl"
May 28 16:09:44.012760 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:44.012729    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a873deb5-30f8-4880-9d59-1ae75ff3d242-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl\" (UID: \"a873deb5-30f8-4880-9d59-1ae75ff3d242\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl"
May 28 16:09:44.177658 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:44.177621    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl"
May 28 16:09:44.296907 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:44.296876    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl"]
May 28 16:09:44.299583 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:44.299553    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda873deb5_30f8_4880_9d59_1ae75ff3d242.slice/crio-36298193a280e6eb02775077cbc0582affa30a1a0aa8e03892c21c8a0e64ce26 WatchSource:0}: Error finding container 36298193a280e6eb02775077cbc0582affa30a1a0aa8e03892c21c8a0e64ce26: Status 404 returned error can't find the container with id 36298193a280e6eb02775077cbc0582affa30a1a0aa8e03892c21c8a0e64ce26
May 28 16:09:44.311855 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:44.311830    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:09:44.314073 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:44.314048    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37b01b62-805e-4475-bdeb-48b56af1211b-metrics-certs\") pod \"network-metrics-daemon-hkxh8\" (UID: \"37b01b62-805e-4475-bdeb-48b56af1211b\") " pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:09:44.379896 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:44.379871    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xz8bh\""
May 28 16:09:44.387889 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:44.387867    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hkxh8"
May 28 16:09:44.506343 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:44.506310    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hkxh8"]
May 28 16:09:44.509866 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:44.509835    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b01b62_805e_4475_bdeb_48b56af1211b.slice/crio-35fc442fc027047bf2e5c7f1207685e432f5e4f9bde96de14ff550c06869da91 WatchSource:0}: Error finding container 35fc442fc027047bf2e5c7f1207685e432f5e4f9bde96de14ff550c06869da91: Status 404 returned error can't find the container with id 35fc442fc027047bf2e5c7f1207685e432f5e4f9bde96de14ff550c06869da91
May 28 16:09:44.941161 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:44.941123    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl" event={"ID":"a873deb5-30f8-4880-9d59-1ae75ff3d242","Type":"ContainerStarted","Data":"36298193a280e6eb02775077cbc0582affa30a1a0aa8e03892c21c8a0e64ce26"}
May 28 16:09:44.942382 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:44.942340    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hkxh8" event={"ID":"37b01b62-805e-4475-bdeb-48b56af1211b","Type":"ContainerStarted","Data":"35fc442fc027047bf2e5c7f1207685e432f5e4f9bde96de14ff550c06869da91"}
May 28 16:09:45.947360 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:45.947326    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hkxh8" event={"ID":"37b01b62-805e-4475-bdeb-48b56af1211b","Type":"ContainerStarted","Data":"ee0ab9df21dd5091771838132b0c5e293cfd2e76c8a1a3034034e199bc803750"}
May 28 16:09:45.947815 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:45.947370    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hkxh8" event={"ID":"37b01b62-805e-4475-bdeb-48b56af1211b","Type":"ContainerStarted","Data":"53641fa67e5ead49efe043233bcb806ac77d1ab9de42756e8b7c9ed7baf482e6"}
May 28 16:09:45.948657 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:45.948633    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl" event={"ID":"a873deb5-30f8-4880-9d59-1ae75ff3d242","Type":"ContainerStarted","Data":"e5aceb8c5deaccdaf981aaddd573b0e8c07ab87f5281b297493bb8c328f85844"}
May 28 16:09:45.948837 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:45.948823    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl"
May 28 16:09:45.953729 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:45.953708    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl"
May 28 16:09:45.963767 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:45.963727    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hkxh8" podStartSLOduration=130.710398877 podStartE2EDuration="2m11.963715321s" podCreationTimestamp="2026-05-28 16:07:34 +0000 UTC" firstStartedPulling="2026-05-28 16:09:44.51176367 +0000 UTC m=+130.521144258" lastFinishedPulling="2026-05-28 16:09:45.765080116 +0000 UTC m=+131.774460702" observedRunningTime="2026-05-28 16:09:45.962500508 +0000 UTC m=+131.971881111" watchObservedRunningTime="2026-05-28 16:09:45.963715321 +0000 UTC m=+131.973095924"
May 28 16:09:46.921049 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:46.920992    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl" podStartSLOduration=2.456455091 podStartE2EDuration="3.920971128s" podCreationTimestamp="2026-05-28 16:09:43 +0000 UTC" firstStartedPulling="2026-05-28 16:09:44.301302886 +0000 UTC m=+130.310683470" lastFinishedPulling="2026-05-28 16:09:45.765818923 +0000 UTC m=+131.775199507" observedRunningTime="2026-05-28 16:09:45.977173656 +0000 UTC m=+131.986554260" watchObservedRunningTime="2026-05-28 16:09:46.920971128 +0000 UTC m=+132.930351728"
May 28 16:09:46.922282 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:46.922255    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"]
May 28 16:09:46.924546 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:46.924525    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:46.929569 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:46.929545    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 28 16:09:46.929954 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:46.929933    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 28 16:09:46.930377 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:46.930358    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nwkwh\""
May 28 16:09:46.930611 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:46.930598    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 16:09:46.935628 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:46.935608    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"]
May 28 16:09:47.034171 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.034143    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9655f758-5185-4968-8ab3-95f68684212a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-7nlb9\" (UID: \"9655f758-5185-4968-8ab3-95f68684212a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:47.034504 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.034181    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9655f758-5185-4968-8ab3-95f68684212a-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-7nlb9\" (UID: \"9655f758-5185-4968-8ab3-95f68684212a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:47.034504 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.034288    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljjzq\" (UniqueName: \"kubernetes.io/projected/9655f758-5185-4968-8ab3-95f68684212a-kube-api-access-ljjzq\") pod \"prometheus-operator-7779bbdd78-7nlb9\" (UID: \"9655f758-5185-4968-8ab3-95f68684212a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:47.034504 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.034355    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9655f758-5185-4968-8ab3-95f68684212a-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-7nlb9\" (UID: \"9655f758-5185-4968-8ab3-95f68684212a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:47.135555 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.135529    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9655f758-5185-4968-8ab3-95f68684212a-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-7nlb9\" (UID: \"9655f758-5185-4968-8ab3-95f68684212a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:47.135648 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.135585    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ljjzq\" (UniqueName: \"kubernetes.io/projected/9655f758-5185-4968-8ab3-95f68684212a-kube-api-access-ljjzq\") pod \"prometheus-operator-7779bbdd78-7nlb9\" (UID: \"9655f758-5185-4968-8ab3-95f68684212a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:47.135648 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.135620    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9655f758-5185-4968-8ab3-95f68684212a-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-7nlb9\" (UID: \"9655f758-5185-4968-8ab3-95f68684212a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:47.135752 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.135649    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9655f758-5185-4968-8ab3-95f68684212a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-7nlb9\" (UID: \"9655f758-5185-4968-8ab3-95f68684212a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:47.136149 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.136128    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9655f758-5185-4968-8ab3-95f68684212a-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-7nlb9\" (UID: \"9655f758-5185-4968-8ab3-95f68684212a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:47.137975 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.137955    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9655f758-5185-4968-8ab3-95f68684212a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-7nlb9\" (UID: \"9655f758-5185-4968-8ab3-95f68684212a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:47.138052 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.138034    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9655f758-5185-4968-8ab3-95f68684212a-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-7nlb9\" (UID: \"9655f758-5185-4968-8ab3-95f68684212a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:47.143835 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.143816    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljjzq\" (UniqueName: \"kubernetes.io/projected/9655f758-5185-4968-8ab3-95f68684212a-kube-api-access-ljjzq\") pod \"prometheus-operator-7779bbdd78-7nlb9\" (UID: \"9655f758-5185-4968-8ab3-95f68684212a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:47.237762 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.237654    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"
May 28 16:09:47.362928 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.362897    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9"]
May 28 16:09:47.366407 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:47.366378    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9655f758_5185_4968_8ab3_95f68684212a.slice/crio-1af998a69561b700d089d6f46fa4ed5837e2bdc47d29ef92b853d8ce590b2634 WatchSource:0}: Error finding container 1af998a69561b700d089d6f46fa4ed5837e2bdc47d29ef92b853d8ce590b2634: Status 404 returned error can't find the container with id 1af998a69561b700d089d6f46fa4ed5837e2bdc47d29ef92b853d8ce590b2634
May 28 16:09:47.953463 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:47.953426    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9" event={"ID":"9655f758-5185-4968-8ab3-95f68684212a","Type":"ContainerStarted","Data":"1af998a69561b700d089d6f46fa4ed5837e2bdc47d29ef92b853d8ce590b2634"}
May 28 16:09:48.957468 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:48.957435    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9" event={"ID":"9655f758-5185-4968-8ab3-95f68684212a","Type":"ContainerStarted","Data":"6d766d072fd48a41949e30e971734fbd4c4e319080ae2a6166f10c86f6092504"}
May 28 16:09:48.957468 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:48.957467    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9" event={"ID":"9655f758-5185-4968-8ab3-95f68684212a","Type":"ContainerStarted","Data":"cb8b9c0931e9a3c8202188115d088e58823752c1d4900420e1895659c20c4544"}
May 28 16:09:48.973727 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:48.973658    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-7nlb9" podStartSLOduration=1.5286914870000001 podStartE2EDuration="2.973643953s" podCreationTimestamp="2026-05-28 16:09:46 +0000 UTC" firstStartedPulling="2026-05-28 16:09:47.368183846 +0000 UTC m=+133.377564428" lastFinishedPulling="2026-05-28 16:09:48.813136313 +0000 UTC m=+134.822516894" observedRunningTime="2026-05-28 16:09:48.972163173 +0000 UTC m=+134.981543777" watchObservedRunningTime="2026-05-28 16:09:48.973643953 +0000 UTC m=+134.983024578"
May 28 16:09:51.288239 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.288207    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"]
May 28 16:09:51.290467 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.290450    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.298509 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.294376    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rfcwv\""
May 28 16:09:51.298509 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.294201    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 28 16:09:51.298509 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.294547    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 28 16:09:51.298509 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.294704    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 28 16:09:51.303867 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.303840    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"]
May 28 16:09:51.309333 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.309311    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r9dd6"]
May 28 16:09:51.311296 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.311282    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.313600 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.313579    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 16:09:51.313722 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.313623    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 16:09:51.313722 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.313698    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 16:09:51.313844 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.313824    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w2gpp\""
May 28 16:09:51.369978 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.369949    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-tls\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.369978 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.369980    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-metrics-client-ca\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.370174 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.370002    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.370174 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.370021    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.370174 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.370125    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-wtmp\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.370174 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.370153    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-textfile\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.370301 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.370175    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x76gt\" (UniqueName: \"kubernetes.io/projected/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-kube-api-access-x76gt\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.370301 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.370241    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.370301 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.370279    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-accelerators-collector-config\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.370393 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.370308    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzdp9\" (UniqueName: \"kubernetes.io/projected/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-kube-api-access-nzdp9\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.370393 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.370326    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.370393 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.370358    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.370393 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.370379    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-sys\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.370513 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.370406    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.370513 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.370428    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-root\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.471769 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.471735    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-wtmp\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.471769 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.471771    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-textfile\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472103 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.471795    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x76gt\" (UniqueName: \"kubernetes.io/projected/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-kube-api-access-x76gt\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.472103 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.471831    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.472103 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.471851    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-accelerators-collector-config\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472103 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.471877    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nzdp9\" (UniqueName: \"kubernetes.io/projected/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-kube-api-access-nzdp9\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472103 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.471900    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.472103 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.471935    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-wtmp\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472103 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.471946    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.472103 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.471974    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-sys\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472103 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.471999    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.472551 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.472155    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-textfile\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472551 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.472186    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-root\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472551 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.472200    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-sys\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472551 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.472278    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-tls\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472551 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.472288    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-root\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472551 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.472313    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-metrics-client-ca\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472551 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.472350    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472551 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.472382    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.472551 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.472404    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.472989 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.472604    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-accelerators-collector-config\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472989 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.472788    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-metrics-client-ca\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.472989 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.472814    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.473167 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.473147    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.474770 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.474741    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.474917 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.474895    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.475003 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.474989    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-node-exporter-tls\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.475040 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.475023    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.480379 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.480359    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzdp9\" (UniqueName: \"kubernetes.io/projected/deeda6be-4ce7-47d2-b8c4-7afcfe104c36-kube-api-access-nzdp9\") pod \"node-exporter-r9dd6\" (UID: \"deeda6be-4ce7-47d2-b8c4-7afcfe104c36\") " pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.480826 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.480805    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x76gt\" (UniqueName: \"kubernetes.io/projected/4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb-kube-api-access-x76gt\") pod \"kube-state-metrics-54fd6bc5c4-f6rpl\" (UID: \"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.555360 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.555308    2556 scope.go:117] "RemoveContainer" containerID="283eae2cff1a7a88cd53071b1f13deee20dcee5fca751a6e578e93cd808ee573"
May 28 16:09:51.555494 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:09:51.555478    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-nf4ql_openshift-console-operator(a8b391da-56e4-4ac4-b40a-39aef2e34b9a)\"" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql" podUID="a8b391da-56e4-4ac4-b40a-39aef2e34b9a"
May 28 16:09:51.601643 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.601623    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"
May 28 16:09:51.619354 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.619331    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r9dd6"
May 28 16:09:51.627294 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:51.627269    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeeda6be_4ce7_47d2_b8c4_7afcfe104c36.slice/crio-612ef877cb12529c074afcf1eaac95cfa820d65a8e8d4d2d3366b036b154ddb6 WatchSource:0}: Error finding container 612ef877cb12529c074afcf1eaac95cfa820d65a8e8d4d2d3366b036b154ddb6: Status 404 returned error can't find the container with id 612ef877cb12529c074afcf1eaac95cfa820d65a8e8d4d2d3366b036b154ddb6
May 28 16:09:51.725714 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.725667    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl"]
May 28 16:09:51.729340 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:51.729316    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4583b4cf_aa79_42b0_a5f0_cebf3e9bc1bb.slice/crio-3e0088a6bd23689dc1ff064c69cfbae94b0a91e9a4021aa413b9c70f41dbb29c WatchSource:0}: Error finding container 3e0088a6bd23689dc1ff064c69cfbae94b0a91e9a4021aa413b9c70f41dbb29c: Status 404 returned error can't find the container with id 3e0088a6bd23689dc1ff064c69cfbae94b0a91e9a4021aa413b9c70f41dbb29c
May 28 16:09:51.966141 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.966104    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl" event={"ID":"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb","Type":"ContainerStarted","Data":"3e0088a6bd23689dc1ff064c69cfbae94b0a91e9a4021aa413b9c70f41dbb29c"}
May 28 16:09:51.967103 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:51.967077    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r9dd6" event={"ID":"deeda6be-4ce7-47d2-b8c4-7afcfe104c36","Type":"ContainerStarted","Data":"612ef877cb12529c074afcf1eaac95cfa820d65a8e8d4d2d3366b036b154ddb6"}
May 28 16:09:52.334237 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.334146    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 16:09:52.338191 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.338166    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.340279 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.340256    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 16:09:52.341940 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.341404    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 16:09:52.341940 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.341450    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 16:09:52.341940 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.341701    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 16:09:52.341940 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.341712    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 16:09:52.341940 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.341859    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 16:09:52.341940 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.341916    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 16:09:52.342291 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.342072    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 16:09:52.342291 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.342268    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rlv54\""
May 28 16:09:52.342291 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.342278    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 16:09:52.351780 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.351741    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 16:09:52.381622 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.381590    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.381792 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.381640    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.381792 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.381692    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.381792 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.381727    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f46f76eb-57d9-464a-8ecc-ccaeccac4934-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.381792 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.381761    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f46f76eb-57d9-464a-8ecc-ccaeccac4934-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.381792 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.381784    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f46f76eb-57d9-464a-8ecc-ccaeccac4934-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.382040 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.381810    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.382040 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.381895    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-config-volume\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.382040 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.381923    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-web-config\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.382040 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.381947    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt7d6\" (UniqueName: \"kubernetes.io/projected/f46f76eb-57d9-464a-8ecc-ccaeccac4934-kube-api-access-pt7d6\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.382040 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.381973    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f46f76eb-57d9-464a-8ecc-ccaeccac4934-config-out\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.382040 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.382030    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.382319 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.382109    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46f76eb-57d9-464a-8ecc-ccaeccac4934-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.482892 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.482853    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46f76eb-57d9-464a-8ecc-ccaeccac4934-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.483059 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.482921    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.483059 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.482962    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.483059 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.483006    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.483220 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.483064    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f46f76eb-57d9-464a-8ecc-ccaeccac4934-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.483220 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.483110    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f46f76eb-57d9-464a-8ecc-ccaeccac4934-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.483220 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.483145    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f46f76eb-57d9-464a-8ecc-ccaeccac4934-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.483220 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.483215    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.483439 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.483287    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-config-volume\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.483439 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.483314    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-web-config\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.483439 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.483337    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pt7d6\" (UniqueName: \"kubernetes.io/projected/f46f76eb-57d9-464a-8ecc-ccaeccac4934-kube-api-access-pt7d6\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.483439 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.483365    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f46f76eb-57d9-464a-8ecc-ccaeccac4934-config-out\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.484066 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.484042    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46f76eb-57d9-464a-8ecc-ccaeccac4934-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.484155 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.484131    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f46f76eb-57d9-464a-8ecc-ccaeccac4934-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.485642 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.485615    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f46f76eb-57d9-464a-8ecc-ccaeccac4934-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.485770 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.485710    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.489000 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.488976    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f46f76eb-57d9-464a-8ecc-ccaeccac4934-config-out\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.489431 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.489365    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.489789 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.489764    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-web-config\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.490631 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.490589    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.490747 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.490720    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.491206 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.491161    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.491840 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.491800    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-config-volume\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.492592 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.492551    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f46f76eb-57d9-464a-8ecc-ccaeccac4934-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.493093 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.493053    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.493303 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.493283    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt7d6\" (UniqueName: \"kubernetes.io/projected/f46f76eb-57d9-464a-8ecc-ccaeccac4934-kube-api-access-pt7d6\") pod \"alertmanager-main-0\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.656156 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.656117    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 16:09:52.824289 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.824122    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 16:09:52.970957 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:52.970869    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r9dd6" event={"ID":"deeda6be-4ce7-47d2-b8c4-7afcfe104c36","Type":"ContainerStarted","Data":"5c701773796a25495ffcb3fb9b59ef60a040d46ea718dba01be46c970bbccdbb"}
May 28 16:09:53.135657 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:53.135619    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46f76eb_57d9_464a_8ecc_ccaeccac4934.slice/crio-876b246a0da349d37c76c28bd2021039597aedb0392b055f0dd52981d71bc0e9 WatchSource:0}: Error finding container 876b246a0da349d37c76c28bd2021039597aedb0392b055f0dd52981d71bc0e9: Status 404 returned error can't find the container with id 876b246a0da349d37c76c28bd2021039597aedb0392b055f0dd52981d71bc0e9
May 28 16:09:53.974619 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:53.974571    2556 generic.go:358] "Generic (PLEG): container finished" podID="deeda6be-4ce7-47d2-b8c4-7afcfe104c36" containerID="5c701773796a25495ffcb3fb9b59ef60a040d46ea718dba01be46c970bbccdbb" exitCode=0
May 28 16:09:53.975075 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:53.974645    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r9dd6" event={"ID":"deeda6be-4ce7-47d2-b8c4-7afcfe104c36","Type":"ContainerDied","Data":"5c701773796a25495ffcb3fb9b59ef60a040d46ea718dba01be46c970bbccdbb"}
May 28 16:09:53.975994 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:53.975971    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerStarted","Data":"876b246a0da349d37c76c28bd2021039597aedb0392b055f0dd52981d71bc0e9"}
May 28 16:09:53.977828 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:53.977803    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl" event={"ID":"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb","Type":"ContainerStarted","Data":"0ee9e3482587c7080f16cdc9e077936b24182b72393433dfeb1a03e65cb490f3"}
May 28 16:09:53.977955 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:53.977832    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl" event={"ID":"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb","Type":"ContainerStarted","Data":"bc22b4b246baabed68254507e95856973993628300c4609e3b4cf8a767ed86af"}
May 28 16:09:53.977955 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:53.977857    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl" event={"ID":"4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb","Type":"ContainerStarted","Data":"3dee3ea45fc069a292775124a69d226ecac70d26565fa1d837685c332dccdc27"}
May 28 16:09:54.010605 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:54.010553    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-f6rpl" podStartSLOduration=1.5754153579999999 podStartE2EDuration="3.010536733s" podCreationTimestamp="2026-05-28 16:09:51 +0000 UTC" firstStartedPulling="2026-05-28 16:09:51.731170242 +0000 UTC m=+137.740550823" lastFinishedPulling="2026-05-28 16:09:53.166291617 +0000 UTC m=+139.175672198" observedRunningTime="2026-05-28 16:09:54.009353009 +0000 UTC m=+140.018733612" watchObservedRunningTime="2026-05-28 16:09:54.010536733 +0000 UTC m=+140.019917336"
May 28 16:09:54.981814 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:54.981775    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r9dd6" event={"ID":"deeda6be-4ce7-47d2-b8c4-7afcfe104c36","Type":"ContainerStarted","Data":"9952ed48c737dd60d1768fda9b85f1f36e6fabf9465c62b70e2699df065d355f"}
May 28 16:09:54.982247 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:54.981820    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r9dd6" event={"ID":"deeda6be-4ce7-47d2-b8c4-7afcfe104c36","Type":"ContainerStarted","Data":"948b54ed8ac7f2b1c6a904965e95b13013bb465c480134066a6400f2ed9158aa"}
May 28 16:09:54.983068 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:54.983040    2556 generic.go:358] "Generic (PLEG): container finished" podID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerID="43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d" exitCode=0
May 28 16:09:54.983155 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:54.983123    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerDied","Data":"43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d"}
May 28 16:09:55.010013 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.009960    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r9dd6" podStartSLOduration=2.97105748 podStartE2EDuration="4.009946956s" podCreationTimestamp="2026-05-28 16:09:51 +0000 UTC" firstStartedPulling="2026-05-28 16:09:51.629116251 +0000 UTC m=+137.638496850" lastFinishedPulling="2026-05-28 16:09:52.668005732 +0000 UTC m=+138.677386326" observedRunningTime="2026-05-28 16:09:55.008980495 +0000 UTC m=+141.018361099" watchObservedRunningTime="2026-05-28 16:09:55.009946956 +0000 UTC m=+141.019327559"
May 28 16:09:55.585537 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.585504    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-658fbd4858-zlwwn"]
May 28 16:09:55.588807 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.588793    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.592236 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.592211    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2bblgesb6i0v\""
May 28 16:09:55.592379 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.592256    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 28 16:09:55.592379 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.592292    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 28 16:09:55.592379 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.592233    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 28 16:09:55.592379 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.592235    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 16:09:55.592379 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.592220    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xgr6b\""
May 28 16:09:55.595605 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.595584    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-658fbd4858-zlwwn"]
May 28 16:09:55.715110 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.715076    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-client-ca-bundle\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.715285 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.715124    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-audit-log\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.715285 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.715145    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-metrics-server-audit-profiles\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.715285 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.715228    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hndss\" (UniqueName: \"kubernetes.io/projected/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-kube-api-access-hndss\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.715405 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.715311    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-secret-metrics-server-tls\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.715483 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.715462    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.715538 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.715516    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-secret-metrics-server-client-certs\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.816395 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.816345    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hndss\" (UniqueName: \"kubernetes.io/projected/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-kube-api-access-hndss\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.816395 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.816407    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-secret-metrics-server-tls\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.816582 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.816477    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.816582 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.816508    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-secret-metrics-server-client-certs\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.816582 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.816535    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-client-ca-bundle\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.816582 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.816554    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-audit-log\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.816582 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.816574    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-metrics-server-audit-profiles\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.817077 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.817045    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-audit-log\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.817483 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.817457    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.817583 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.817520    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-metrics-server-audit-profiles\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.819008 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.818986    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-secret-metrics-server-tls\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.819141 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.819125    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-client-ca-bundle\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.819181 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.819164    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-secret-metrics-server-client-certs\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.824440 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.824415    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hndss\" (UniqueName: \"kubernetes.io/projected/b8ca5ed4-0800-4f86-8c6c-4d2045e21af8-kube-api-access-hndss\") pod \"metrics-server-658fbd4858-zlwwn\" (UID: \"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8\") " pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:55.899317 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:55.899281    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:09:56.028888 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:56.028725    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-658fbd4858-zlwwn"]
May 28 16:09:56.037027 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:09:56.036990    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ca5ed4_0800_4f86_8c6c_4d2045e21af8.slice/crio-7640fb917a71ab3a7be049576cad7e9d996d806a8accb72f3c85fe479a56605b WatchSource:0}: Error finding container 7640fb917a71ab3a7be049576cad7e9d996d806a8accb72f3c85fe479a56605b: Status 404 returned error can't find the container with id 7640fb917a71ab3a7be049576cad7e9d996d806a8accb72f3c85fe479a56605b
May 28 16:09:56.994066 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:56.994037    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerStarted","Data":"1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330"}
May 28 16:09:56.994066 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:56.994070    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerStarted","Data":"2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b"}
May 28 16:09:56.994262 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:56.994079    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerStarted","Data":"d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272"}
May 28 16:09:56.994262 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:56.994093    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerStarted","Data":"c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079"}
May 28 16:09:56.994262 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:56.994105    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerStarted","Data":"c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64"}
May 28 16:09:56.995282 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:56.995254    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn" event={"ID":"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8","Type":"ContainerStarted","Data":"7640fb917a71ab3a7be049576cad7e9d996d806a8accb72f3c85fe479a56605b"}
May 28 16:09:59.004198 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:59.004160    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerStarted","Data":"92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f"}
May 28 16:09:59.005466 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:59.005437    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn" event={"ID":"b8ca5ed4-0800-4f86-8c6c-4d2045e21af8","Type":"ContainerStarted","Data":"1e831563a63f2cda81f965c6afc5f4fad76f62048ef00d473672aa8239493d64"}
May 28 16:09:59.037080 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:59.037020    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.080650239 podStartE2EDuration="7.036999603s" podCreationTimestamp="2026-05-28 16:09:52 +0000 UTC" firstStartedPulling="2026-05-28 16:09:53.137744907 +0000 UTC m=+139.147125488" lastFinishedPulling="2026-05-28 16:09:58.094094268 +0000 UTC m=+144.103474852" observedRunningTime="2026-05-28 16:09:59.034098776 +0000 UTC m=+145.043479382" watchObservedRunningTime="2026-05-28 16:09:59.036999603 +0000 UTC m=+145.046380208"
May 28 16:09:59.064165 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:09:59.064119    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn" podStartSLOduration=2.01100679 podStartE2EDuration="4.064105663s" podCreationTimestamp="2026-05-28 16:09:55 +0000 UTC" firstStartedPulling="2026-05-28 16:09:56.039618675 +0000 UTC m=+142.048999261" lastFinishedPulling="2026-05-28 16:09:58.092717553 +0000 UTC m=+144.102098134" observedRunningTime="2026-05-28 16:09:59.063248594 +0000 UTC m=+145.072629198" watchObservedRunningTime="2026-05-28 16:09:59.064105663 +0000 UTC m=+145.073486266"
May 28 16:10:01.799510 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:01.799471    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cf89b6c69-v7drk"]
May 28 16:10:01.800049 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:10:01.799802    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-cf89b6c69-v7drk" podUID="77b5a949-28ac-4915-866c-95fb3745514b"
May 28 16:10:02.017077 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.014116    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:10:02.021121 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.021099    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:10:02.081156 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.081063    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77b5a949-28ac-4915-866c-95fb3745514b-installation-pull-secrets\") pod \"77b5a949-28ac-4915-866c-95fb3745514b\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") "
May 28 16:10:02.081156 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.081129    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77b5a949-28ac-4915-866c-95fb3745514b-registry-certificates\") pod \"77b5a949-28ac-4915-866c-95fb3745514b\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") "
May 28 16:10:02.081356 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.081160    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77b5a949-28ac-4915-866c-95fb3745514b-ca-trust-extracted\") pod \"77b5a949-28ac-4915-866c-95fb3745514b\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") "
May 28 16:10:02.081356 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.081205    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77b5a949-28ac-4915-866c-95fb3745514b-image-registry-private-configuration\") pod \"77b5a949-28ac-4915-866c-95fb3745514b\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") "
May 28 16:10:02.081356 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.081237    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb9gh\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-kube-api-access-gb9gh\") pod \"77b5a949-28ac-4915-866c-95fb3745514b\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") "
May 28 16:10:02.081356 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.081261    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-bound-sa-token\") pod \"77b5a949-28ac-4915-866c-95fb3745514b\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") "
May 28 16:10:02.081356 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.081304    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77b5a949-28ac-4915-866c-95fb3745514b-trusted-ca\") pod \"77b5a949-28ac-4915-866c-95fb3745514b\" (UID: \"77b5a949-28ac-4915-866c-95fb3745514b\") "
May 28 16:10:02.081605 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.081500    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77b5a949-28ac-4915-866c-95fb3745514b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "77b5a949-28ac-4915-866c-95fb3745514b" (UID: "77b5a949-28ac-4915-866c-95fb3745514b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:10:02.081605 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.081561    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77b5a949-28ac-4915-866c-95fb3745514b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "77b5a949-28ac-4915-866c-95fb3745514b" (UID: "77b5a949-28ac-4915-866c-95fb3745514b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:10:02.081771 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.081747    2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/77b5a949-28ac-4915-866c-95fb3745514b-registry-certificates\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:10:02.081771 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.081772    2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/77b5a949-28ac-4915-866c-95fb3745514b-ca-trust-extracted\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:10:02.081966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.081885    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77b5a949-28ac-4915-866c-95fb3745514b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "77b5a949-28ac-4915-866c-95fb3745514b" (UID: "77b5a949-28ac-4915-866c-95fb3745514b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:10:02.083584 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.083558    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-kube-api-access-gb9gh" (OuterVolumeSpecName: "kube-api-access-gb9gh") pod "77b5a949-28ac-4915-866c-95fb3745514b" (UID: "77b5a949-28ac-4915-866c-95fb3745514b"). InnerVolumeSpecName "kube-api-access-gb9gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:10:02.083584 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.083562    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77b5a949-28ac-4915-866c-95fb3745514b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "77b5a949-28ac-4915-866c-95fb3745514b" (UID: "77b5a949-28ac-4915-866c-95fb3745514b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:10:02.083744 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.083613    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "77b5a949-28ac-4915-866c-95fb3745514b" (UID: "77b5a949-28ac-4915-866c-95fb3745514b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:10:02.083744 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.083640    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77b5a949-28ac-4915-866c-95fb3745514b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "77b5a949-28ac-4915-866c-95fb3745514b" (UID: "77b5a949-28ac-4915-866c-95fb3745514b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:10:02.182451 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.182416    2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/77b5a949-28ac-4915-866c-95fb3745514b-installation-pull-secrets\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:10:02.182451 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.182445    2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/77b5a949-28ac-4915-866c-95fb3745514b-image-registry-private-configuration\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:10:02.182451 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.182459    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb9gh\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-kube-api-access-gb9gh\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:10:02.182700 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.182471    2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-bound-sa-token\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:10:02.182700 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:02.182484    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77b5a949-28ac-4915-866c-95fb3745514b-trusted-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:10:03.016852 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:03.016823    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cf89b6c69-v7drk"
May 28 16:10:03.051871 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:03.051842    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-cf89b6c69-v7drk"]
May 28 16:10:03.056518 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:03.056493    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-cf89b6c69-v7drk"]
May 28 16:10:03.191901 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:03.191856    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/77b5a949-28ac-4915-866c-95fb3745514b-registry-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:10:04.558037 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:04.558008    2556 scope.go:117] "RemoveContainer" containerID="283eae2cff1a7a88cd53071b1f13deee20dcee5fca751a6e578e93cd808ee573"
May 28 16:10:04.560480 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:04.560457    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77b5a949-28ac-4915-866c-95fb3745514b" path="/var/lib/kubelet/pods/77b5a949-28ac-4915-866c-95fb3745514b/volumes"
May 28 16:10:05.024102 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.024077    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:10:05.024266 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.024188    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql" event={"ID":"a8b391da-56e4-4ac4-b40a-39aef2e34b9a","Type":"ContainerStarted","Data":"5ca64039310c4decc366531e4084d0179ac84ab64c66ea7d03a0efbacb62ff14"}
May 28 16:10:05.024484 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.024460    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:10:05.044342 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.044293    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql" podStartSLOduration=54.007623169 podStartE2EDuration="57.044276467s" podCreationTimestamp="2026-05-28 16:09:08 +0000 UTC" firstStartedPulling="2026-05-28 16:09:09.441598776 +0000 UTC m=+95.450979375" lastFinishedPulling="2026-05-28 16:09:12.478252084 +0000 UTC m=+98.487632673" observedRunningTime="2026-05-28 16:10:05.042223647 +0000 UTC m=+151.051604265" watchObservedRunningTime="2026-05-28 16:10:05.044276467 +0000 UTC m=+151.053657074"
May 28 16:10:05.171099 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.171071    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-nf4ql"
May 28 16:10:05.350290 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.350202    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-klknq"]
May 28 16:10:05.353577 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.353555    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-klknq"
May 28 16:10:05.355912 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.355891    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 16:10:05.356008 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.355895    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ppcnf\""
May 28 16:10:05.356008 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.355972    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 16:10:05.362166 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.362143    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-klknq"]
May 28 16:10:05.513296 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.513263    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9t8b\" (UniqueName: \"kubernetes.io/projected/7af758c6-0d06-4c58-8df5-4d22adb32fa3-kube-api-access-z9t8b\") pod \"downloads-57bd96b888-klknq\" (UID: \"7af758c6-0d06-4c58-8df5-4d22adb32fa3\") " pod="openshift-console/downloads-57bd96b888-klknq"
May 28 16:10:05.613983 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.613899    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z9t8b\" (UniqueName: \"kubernetes.io/projected/7af758c6-0d06-4c58-8df5-4d22adb32fa3-kube-api-access-z9t8b\") pod \"downloads-57bd96b888-klknq\" (UID: \"7af758c6-0d06-4c58-8df5-4d22adb32fa3\") " pod="openshift-console/downloads-57bd96b888-klknq"
May 28 16:10:05.622989 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.622959    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9t8b\" (UniqueName: \"kubernetes.io/projected/7af758c6-0d06-4c58-8df5-4d22adb32fa3-kube-api-access-z9t8b\") pod \"downloads-57bd96b888-klknq\" (UID: \"7af758c6-0d06-4c58-8df5-4d22adb32fa3\") " pod="openshift-console/downloads-57bd96b888-klknq"
May 28 16:10:05.662928 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.662899    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-klknq"
May 28 16:10:05.786864 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:05.786829    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-klknq"]
May 28 16:10:05.789199 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:10:05.789169    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af758c6_0d06_4c58_8df5_4d22adb32fa3.slice/crio-b58a419dabe1c445db66979303e06b63dc604150f417198181c56b0be487e79b WatchSource:0}: Error finding container b58a419dabe1c445db66979303e06b63dc604150f417198181c56b0be487e79b: Status 404 returned error can't find the container with id b58a419dabe1c445db66979303e06b63dc604150f417198181c56b0be487e79b
May 28 16:10:06.027926 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:06.027894    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-klknq" event={"ID":"7af758c6-0d06-4c58-8df5-4d22adb32fa3","Type":"ContainerStarted","Data":"b58a419dabe1c445db66979303e06b63dc604150f417198181c56b0be487e79b"}
May 28 16:10:10.880308 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:10:10.880262    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8vnhr" podUID="f0016d8a-4dbe-4f30-82c2-30508031581f"
May 28 16:10:10.886458 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:10:10.886421    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-c7b4h" podUID="a854eb33-ccd9-437b-beec-3a4a3bdbf9c1"
May 28 16:10:11.043005 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:11.042970    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:10:11.043178 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:11.042970    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vnhr"
May 28 16:10:15.804307 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:15.804268    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:10:15.804800 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:15.804339    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:10:15.806995 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:15.806962    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0016d8a-4dbe-4f30-82c2-30508031581f-metrics-tls\") pod \"dns-default-8vnhr\" (UID: \"f0016d8a-4dbe-4f30-82c2-30508031581f\") " pod="openshift-dns/dns-default-8vnhr"
May 28 16:10:15.806995 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:15.806983    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a854eb33-ccd9-437b-beec-3a4a3bdbf9c1-cert\") pod \"ingress-canary-c7b4h\" (UID: \"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1\") " pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:10:15.846419 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:15.846393    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rfj6w\""
May 28 16:10:15.847049 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:15.847033    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ckq8r\""
May 28 16:10:15.854740 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:15.854716    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vnhr"
May 28 16:10:15.854851 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:15.854787    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c7b4h"
May 28 16:10:15.899987 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:15.899955    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:10:15.899987 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:15.899998    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:10:16.000845 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:16.000807    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8vnhr"]
May 28 16:10:16.003874 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:10:16.003842    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0016d8a_4dbe_4f30_82c2_30508031581f.slice/crio-ef625f9dbc54c57dfc2963646bfe1fd7a61e11d416ce545f108fdb8c04ec3cd8 WatchSource:0}: Error finding container ef625f9dbc54c57dfc2963646bfe1fd7a61e11d416ce545f108fdb8c04ec3cd8: Status 404 returned error can't find the container with id ef625f9dbc54c57dfc2963646bfe1fd7a61e11d416ce545f108fdb8c04ec3cd8
May 28 16:10:16.015636 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:16.015527    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c7b4h"]
May 28 16:10:16.018242 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:10:16.018213    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda854eb33_ccd9_437b_beec_3a4a3bdbf9c1.slice/crio-cd9bbad637f84247f78f6c97270f219822769a216482c879aecdb5dafed91f66 WatchSource:0}: Error finding container cd9bbad637f84247f78f6c97270f219822769a216482c879aecdb5dafed91f66: Status 404 returned error can't find the container with id cd9bbad637f84247f78f6c97270f219822769a216482c879aecdb5dafed91f66
May 28 16:10:16.061033 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:16.060966    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c7b4h" event={"ID":"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1","Type":"ContainerStarted","Data":"cd9bbad637f84247f78f6c97270f219822769a216482c879aecdb5dafed91f66"}
May 28 16:10:16.061906 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:16.061885    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vnhr" event={"ID":"f0016d8a-4dbe-4f30-82c2-30508031581f","Type":"ContainerStarted","Data":"ef625f9dbc54c57dfc2963646bfe1fd7a61e11d416ce545f108fdb8c04ec3cd8"}
May 28 16:10:19.073907 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:19.073874    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vnhr" event={"ID":"f0016d8a-4dbe-4f30-82c2-30508031581f","Type":"ContainerStarted","Data":"545a5579ff369ae5fd7a4f3c7fd457ad42807cae2d2c1def814e369d45aaf78e"}
May 28 16:10:19.073907 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:19.073912    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vnhr" event={"ID":"f0016d8a-4dbe-4f30-82c2-30508031581f","Type":"ContainerStarted","Data":"fe151e7001a90b43174c5dc6fad686108a191d8e67e79e0713f555e95dada6b0"}
May 28 16:10:19.074438 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:19.073962    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8vnhr"
May 28 16:10:19.075214 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:19.075195    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c7b4h" event={"ID":"a854eb33-ccd9-437b-beec-3a4a3bdbf9c1","Type":"ContainerStarted","Data":"49dc6cb437ed75d23c587e8d00e68ec05b915d5bc34715f40d0593b24f5c4cc3"}
May 28 16:10:19.094529 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:19.094465    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-8vnhr" podStartSLOduration=129.810194733 podStartE2EDuration="2m12.094450664s" podCreationTimestamp="2026-05-28 16:08:07 +0000 UTC" firstStartedPulling="2026-05-28 16:10:16.006248104 +0000 UTC m=+162.015628695" lastFinishedPulling="2026-05-28 16:10:18.290504041 +0000 UTC m=+164.299884626" observedRunningTime="2026-05-28 16:10:19.093320723 +0000 UTC m=+165.102701332" watchObservedRunningTime="2026-05-28 16:10:19.094450664 +0000 UTC m=+165.103831271"
May 28 16:10:19.108755 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:19.108704    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c7b4h" podStartSLOduration=129.839206671 podStartE2EDuration="2m12.108690776s" podCreationTimestamp="2026-05-28 16:08:07 +0000 UTC" firstStartedPulling="2026-05-28 16:10:16.020209676 +0000 UTC m=+162.029590257" lastFinishedPulling="2026-05-28 16:10:18.289693766 +0000 UTC m=+164.299074362" observedRunningTime="2026-05-28 16:10:19.107867425 +0000 UTC m=+165.117248032" watchObservedRunningTime="2026-05-28 16:10:19.108690776 +0000 UTC m=+165.118071387"
May 28 16:10:21.658924 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.658891    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-b7856c9b8-4q64j"]
May 28 16:10:21.661793 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.661766    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.662232 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.662086    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7g4p\" (UniqueName: \"kubernetes.io/projected/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-kube-api-access-p7g4p\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.662232 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.662129    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-oauth-serving-cert\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.662232 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.662165    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-oauth-config\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.662232 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.662210    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-service-ca\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.662232 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.662234    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-trusted-ca-bundle\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.662509 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.662261    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-serving-cert\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.662509 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.662334    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-config\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.664058 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.664034    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 16:10:21.664916 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.664892    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 16:10:21.665029 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.664920    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 16:10:21.665029 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.664937    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 16:10:21.665029 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.664948    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7r9nd\""
May 28 16:10:21.665269 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.665221    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 16:10:21.671085 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.669964    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 16:10:21.675548 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.675527    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b7856c9b8-4q64j"]
May 28 16:10:21.763032 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.762990    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-config\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.763199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.763062    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7g4p\" (UniqueName: \"kubernetes.io/projected/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-kube-api-access-p7g4p\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.763199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.763088    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-oauth-serving-cert\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.763199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.763110    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-oauth-config\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.763199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.763151    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-service-ca\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.763199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.763170    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-trusted-ca-bundle\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.763199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.763192    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-serving-cert\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.763883 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.763853    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-config\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.764007 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.763864    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-oauth-serving-cert\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.764074 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.764017    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-service-ca\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.764347 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.764319    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-trusted-ca-bundle\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.766069 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.766033    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-serving-cert\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.766255 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.766239    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-oauth-config\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.770831 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.770808    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7g4p\" (UniqueName: \"kubernetes.io/projected/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-kube-api-access-p7g4p\") pod \"console-b7856c9b8-4q64j\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") " pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:21.976252 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:21.976154    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:27.307162 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:27.307133    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b7856c9b8-4q64j"]
May 28 16:10:27.307575 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:10:27.307552    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1187fb32_fe2c_4f50_8127_ce4c1abe78ef.slice/crio-041bb39ac86042d45911ac6f35863eadb1bec11a51745ea0e2675032a7e32cdd WatchSource:0}: Error finding container 041bb39ac86042d45911ac6f35863eadb1bec11a51745ea0e2675032a7e32cdd: Status 404 returned error can't find the container with id 041bb39ac86042d45911ac6f35863eadb1bec11a51745ea0e2675032a7e32cdd
May 28 16:10:28.110135 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:28.110092    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7856c9b8-4q64j" event={"ID":"1187fb32-fe2c-4f50-8127-ce4c1abe78ef","Type":"ContainerStarted","Data":"041bb39ac86042d45911ac6f35863eadb1bec11a51745ea0e2675032a7e32cdd"}
May 28 16:10:28.112715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:28.112636    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-klknq" event={"ID":"7af758c6-0d06-4c58-8df5-4d22adb32fa3","Type":"ContainerStarted","Data":"bc04ecfcc68cf563a30adfcdc285165c8024be40faa3bee3ed4b43587002ef72"}
May 28 16:10:28.113180 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:28.113137    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-klknq"
May 28 16:10:28.130219 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:28.130194    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-klknq"
May 28 16:10:28.130665 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:28.130320    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-klknq" podStartSLOduration=1.665070224 podStartE2EDuration="23.13030694s" podCreationTimestamp="2026-05-28 16:10:05 +0000 UTC" firstStartedPulling="2026-05-28 16:10:05.791251867 +0000 UTC m=+151.800632461" lastFinishedPulling="2026-05-28 16:10:27.256488583 +0000 UTC m=+173.265869177" observedRunningTime="2026-05-28 16:10:28.129041283 +0000 UTC m=+174.138421888" watchObservedRunningTime="2026-05-28 16:10:28.13030694 +0000 UTC m=+174.139687547"
May 28 16:10:29.080832 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:29.080804    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8vnhr"
May 28 16:10:31.128106 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:31.128070    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7856c9b8-4q64j" event={"ID":"1187fb32-fe2c-4f50-8127-ce4c1abe78ef","Type":"ContainerStarted","Data":"b588d13867a8f7c9219faf3ac42a7eac598ce49a5d714fe68adc4fc688fea72b"}
May 28 16:10:31.145511 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:31.145452    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-b7856c9b8-4q64j" podStartSLOduration=6.551624154 podStartE2EDuration="10.145423505s" podCreationTimestamp="2026-05-28 16:10:21 +0000 UTC" firstStartedPulling="2026-05-28 16:10:27.309512103 +0000 UTC m=+173.318892684" lastFinishedPulling="2026-05-28 16:10:30.903311431 +0000 UTC m=+176.912692035" observedRunningTime="2026-05-28 16:10:31.144210076 +0000 UTC m=+177.153590681" watchObservedRunningTime="2026-05-28 16:10:31.145423505 +0000 UTC m=+177.154804120"
May 28 16:10:31.977266 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:31.977233    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:31.977266 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:31.977275    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:31.983094 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:31.983069    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:32.135986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:32.135959    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:10:35.906383 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:35.906351    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:10:35.911336 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:35.911309    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-658fbd4858-zlwwn"
May 28 16:10:38.151251 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:38.151217    2556 generic.go:358] "Generic (PLEG): container finished" podID="f4e434f4-b121-4fb0-898f-edc4eb1840e5" containerID="9f3ac721cb3d5b1960d0fd85b17c39386915597322d37e6595607d4296f8b342" exitCode=0
May 28 16:10:38.151630 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:38.151292    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-gq7tm" event={"ID":"f4e434f4-b121-4fb0-898f-edc4eb1840e5","Type":"ContainerDied","Data":"9f3ac721cb3d5b1960d0fd85b17c39386915597322d37e6595607d4296f8b342"}
May 28 16:10:38.151630 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:38.151614    2556 scope.go:117] "RemoveContainer" containerID="9f3ac721cb3d5b1960d0fd85b17c39386915597322d37e6595607d4296f8b342"
May 28 16:10:39.155827 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:10:39.155785    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-gq7tm" event={"ID":"f4e434f4-b121-4fb0-898f-edc4eb1840e5","Type":"ContainerStarted","Data":"96d961597f466088c2718ce7aae7f5f7540da14a6edd5466d8fc578362fc5c74"}
May 28 16:11:11.586404 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:11.586323    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 16:11:11.586848 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:11.586760    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="alertmanager" containerID="cri-o://c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64" gracePeriod=120
May 28 16:11:11.586924 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:11.586830    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="kube-rbac-proxy-metric" containerID="cri-o://1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330" gracePeriod=120
May 28 16:11:11.586924 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:11.586875    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="config-reloader" containerID="cri-o://c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079" gracePeriod=120
May 28 16:11:11.587023 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:11.586865    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="kube-rbac-proxy-web" containerID="cri-o://d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272" gracePeriod=120
May 28 16:11:11.587023 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:11.586925    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="kube-rbac-proxy" containerID="cri-o://2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b" gracePeriod=120
May 28 16:11:11.587023 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:11.586943    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="prom-label-proxy" containerID="cri-o://92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f" gracePeriod=120
May 28 16:11:12.257766 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.257731    2556 generic.go:358] "Generic (PLEG): container finished" podID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerID="92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f" exitCode=0
May 28 16:11:12.257766 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.257754    2556 generic.go:358] "Generic (PLEG): container finished" podID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerID="2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b" exitCode=0
May 28 16:11:12.257766 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.257761    2556 generic.go:358] "Generic (PLEG): container finished" podID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerID="c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079" exitCode=0
May 28 16:11:12.257766 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.257767    2556 generic.go:358] "Generic (PLEG): container finished" podID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerID="c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64" exitCode=0
May 28 16:11:12.258045 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.257810    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerDied","Data":"92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f"}
May 28 16:11:12.258045 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.257851    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerDied","Data":"2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b"}
May 28 16:11:12.258045 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.257865    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerDied","Data":"c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079"}
May 28 16:11:12.258045 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.257876    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerDied","Data":"c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64"}
May 28 16:11:12.849511 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.849488    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:12.912635 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.912554    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f46f76eb-57d9-464a-8ecc-ccaeccac4934-alertmanager-main-db\") pod \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") "
May 28 16:11:12.912635 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.912600    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-config-volume\") pod \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") "
May 28 16:11:12.912882 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.912634    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f46f76eb-57d9-464a-8ecc-ccaeccac4934-metrics-client-ca\") pod \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") "
May 28 16:11:12.912882 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.912699    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-web-config\") pod \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") "
May 28 16:11:12.912882 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.912725    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt7d6\" (UniqueName: \"kubernetes.io/projected/f46f76eb-57d9-464a-8ecc-ccaeccac4934-kube-api-access-pt7d6\") pod \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") "
May 28 16:11:12.912882 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.912760    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy-web\") pod \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") "
May 28 16:11:12.912882 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.912797    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-main-tls\") pod \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") "
May 28 16:11:12.912882 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.912821    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") "
May 28 16:11:12.912882 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.912845    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f46f76eb-57d9-464a-8ecc-ccaeccac4934-config-out\") pod \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") "
May 28 16:11:12.913241 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.912934    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f46f76eb-57d9-464a-8ecc-ccaeccac4934-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f46f76eb-57d9-464a-8ecc-ccaeccac4934" (UID: "f46f76eb-57d9-464a-8ecc-ccaeccac4934"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:11:12.913241 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.913043    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f46f76eb-57d9-464a-8ecc-ccaeccac4934-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f46f76eb-57d9-464a-8ecc-ccaeccac4934" (UID: "f46f76eb-57d9-464a-8ecc-ccaeccac4934"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:11:12.913431 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.913409    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46f76eb-57d9-464a-8ecc-ccaeccac4934-alertmanager-trusted-ca-bundle\") pod \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") "
May 28 16:11:12.913506 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.913475    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-cluster-tls-config\") pod \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") "
May 28 16:11:12.913506 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.913502    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f46f76eb-57d9-464a-8ecc-ccaeccac4934-tls-assets\") pod \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") "
May 28 16:11:12.913801 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.913779    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f46f76eb-57d9-464a-8ecc-ccaeccac4934-alertmanager-main-db\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:12.913879 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.913807    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f46f76eb-57d9-464a-8ecc-ccaeccac4934-metrics-client-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:12.914615 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.914583    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f46f76eb-57d9-464a-8ecc-ccaeccac4934-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f46f76eb-57d9-464a-8ecc-ccaeccac4934" (UID: "f46f76eb-57d9-464a-8ecc-ccaeccac4934"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:11:12.915763 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.915727    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f46f76eb-57d9-464a-8ecc-ccaeccac4934-config-out" (OuterVolumeSpecName: "config-out") pod "f46f76eb-57d9-464a-8ecc-ccaeccac4934" (UID: "f46f76eb-57d9-464a-8ecc-ccaeccac4934"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:11:12.915994 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.915957    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f46f76eb-57d9-464a-8ecc-ccaeccac4934" (UID: "f46f76eb-57d9-464a-8ecc-ccaeccac4934"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:12.916256 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.916230    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f46f76eb-57d9-464a-8ecc-ccaeccac4934" (UID: "f46f76eb-57d9-464a-8ecc-ccaeccac4934"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:12.916863 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.916829    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f46f76eb-57d9-464a-8ecc-ccaeccac4934" (UID: "f46f76eb-57d9-464a-8ecc-ccaeccac4934"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:12.916965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.916924    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-config-volume" (OuterVolumeSpecName: "config-volume") pod "f46f76eb-57d9-464a-8ecc-ccaeccac4934" (UID: "f46f76eb-57d9-464a-8ecc-ccaeccac4934"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:12.916965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.916922    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f46f76eb-57d9-464a-8ecc-ccaeccac4934-kube-api-access-pt7d6" (OuterVolumeSpecName: "kube-api-access-pt7d6") pod "f46f76eb-57d9-464a-8ecc-ccaeccac4934" (UID: "f46f76eb-57d9-464a-8ecc-ccaeccac4934"). InnerVolumeSpecName "kube-api-access-pt7d6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:11:12.917268 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.917247    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f46f76eb-57d9-464a-8ecc-ccaeccac4934-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f46f76eb-57d9-464a-8ecc-ccaeccac4934" (UID: "f46f76eb-57d9-464a-8ecc-ccaeccac4934"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:11:12.921155 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.921076    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f46f76eb-57d9-464a-8ecc-ccaeccac4934" (UID: "f46f76eb-57d9-464a-8ecc-ccaeccac4934"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:12.927036 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:12.927015    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-web-config" (OuterVolumeSpecName: "web-config") pod "f46f76eb-57d9-464a-8ecc-ccaeccac4934" (UID: "f46f76eb-57d9-464a-8ecc-ccaeccac4934"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:13.014289 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.014257    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy\") pod \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\" (UID: \"f46f76eb-57d9-464a-8ecc-ccaeccac4934\") "
May 28 16:11:13.014506 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.014490    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-web-config\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:13.014547 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.014514    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt7d6\" (UniqueName: \"kubernetes.io/projected/f46f76eb-57d9-464a-8ecc-ccaeccac4934-kube-api-access-pt7d6\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:13.014547 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.014530    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:13.014620 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.014546    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-main-tls\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:13.014620 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.014561    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:13.014620 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.014575    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f46f76eb-57d9-464a-8ecc-ccaeccac4934-config-out\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:13.014620 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.014590    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f46f76eb-57d9-464a-8ecc-ccaeccac4934-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:13.014620 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.014605    2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-cluster-tls-config\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:13.014620 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.014617    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f46f76eb-57d9-464a-8ecc-ccaeccac4934-tls-assets\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:13.014821 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.014631    2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-config-volume\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:13.016175 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.016156    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f46f76eb-57d9-464a-8ecc-ccaeccac4934" (UID: "f46f76eb-57d9-464a-8ecc-ccaeccac4934"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:13.115383 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.115349    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f46f76eb-57d9-464a-8ecc-ccaeccac4934-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:13.263734 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.263623    2556 generic.go:358] "Generic (PLEG): container finished" podID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerID="1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330" exitCode=0
May 28 16:11:13.263734 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.263647    2556 generic.go:358] "Generic (PLEG): container finished" podID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerID="d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272" exitCode=0
May 28 16:11:13.263734 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.263693    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerDied","Data":"1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330"}
May 28 16:11:13.263734 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.263721    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerDied","Data":"d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272"}
May 28 16:11:13.263734 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.263731    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f46f76eb-57d9-464a-8ecc-ccaeccac4934","Type":"ContainerDied","Data":"876b246a0da349d37c76c28bd2021039597aedb0392b055f0dd52981d71bc0e9"}
May 28 16:11:13.264101 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.263746    2556 scope.go:117] "RemoveContainer" containerID="92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f"
May 28 16:11:13.264101 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.263772    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.271422 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.271308    2556 scope.go:117] "RemoveContainer" containerID="1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330"
May 28 16:11:13.280430 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.280409    2556 scope.go:117] "RemoveContainer" containerID="2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b"
May 28 16:11:13.286910 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.286885    2556 scope.go:117] "RemoveContainer" containerID="d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272"
May 28 16:11:13.289243 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.289221    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 16:11:13.293038 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.293019    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 16:11:13.294732 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.294716    2556 scope.go:117] "RemoveContainer" containerID="c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079"
May 28 16:11:13.301224 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.301207    2556 scope.go:117] "RemoveContainer" containerID="c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64"
May 28 16:11:13.307426 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.307411    2556 scope.go:117] "RemoveContainer" containerID="43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d"
May 28 16:11:13.313723 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.313706    2556 scope.go:117] "RemoveContainer" containerID="92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f"
May 28 16:11:13.313986 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:11:13.313965    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f\": container with ID starting with 92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f not found: ID does not exist" containerID="92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f"
May 28 16:11:13.314073 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.313999    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f"} err="failed to get container status \"92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f\": rpc error: code = NotFound desc = could not find container \"92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f\": container with ID starting with 92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f not found: ID does not exist"
May 28 16:11:13.314073 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.314045    2556 scope.go:117] "RemoveContainer" containerID="1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330"
May 28 16:11:13.314298 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:11:13.314281    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330\": container with ID starting with 1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330 not found: ID does not exist" containerID="1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330"
May 28 16:11:13.314342 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.314306    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330"} err="failed to get container status \"1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330\": rpc error: code = NotFound desc = could not find container \"1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330\": container with ID starting with 1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330 not found: ID does not exist"
May 28 16:11:13.314342 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.314323    2556 scope.go:117] "RemoveContainer" containerID="2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b"
May 28 16:11:13.314553 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:11:13.314537    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b\": container with ID starting with 2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b not found: ID does not exist" containerID="2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b"
May 28 16:11:13.314631 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.314571    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b"} err="failed to get container status \"2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b\": rpc error: code = NotFound desc = could not find container \"2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b\": container with ID starting with 2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b not found: ID does not exist"
May 28 16:11:13.314631 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.314592    2556 scope.go:117] "RemoveContainer" containerID="d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272"
May 28 16:11:13.314853 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:11:13.314838    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272\": container with ID starting with d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272 not found: ID does not exist" containerID="d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272"
May 28 16:11:13.314894 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.314859    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272"} err="failed to get container status \"d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272\": rpc error: code = NotFound desc = could not find container \"d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272\": container with ID starting with d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272 not found: ID does not exist"
May 28 16:11:13.314894 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.314873    2556 scope.go:117] "RemoveContainer" containerID="c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079"
May 28 16:11:13.315537 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:11:13.315346    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079\": container with ID starting with c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079 not found: ID does not exist" containerID="c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079"
May 28 16:11:13.315537 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.315377    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079"} err="failed to get container status \"c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079\": rpc error: code = NotFound desc = could not find container \"c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079\": container with ID starting with c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079 not found: ID does not exist"
May 28 16:11:13.315537 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.315398    2556 scope.go:117] "RemoveContainer" containerID="c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64"
May 28 16:11:13.315803 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:11:13.315768    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64\": container with ID starting with c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64 not found: ID does not exist" containerID="c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64"
May 28 16:11:13.315872 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.315811    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64"} err="failed to get container status \"c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64\": rpc error: code = NotFound desc = could not find container \"c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64\": container with ID starting with c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64 not found: ID does not exist"
May 28 16:11:13.315872 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.315825    2556 scope.go:117] "RemoveContainer" containerID="43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d"
May 28 16:11:13.316173 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:11:13.316096    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d\": container with ID starting with 43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d not found: ID does not exist" containerID="43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d"
May 28 16:11:13.316173 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.316122    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d"} err="failed to get container status \"43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d\": rpc error: code = NotFound desc = could not find container \"43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d\": container with ID starting with 43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d not found: ID does not exist"
May 28 16:11:13.316173 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.316143    2556 scope.go:117] "RemoveContainer" containerID="92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f"
May 28 16:11:13.316424 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.316398    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f"} err="failed to get container status \"92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f\": rpc error: code = NotFound desc = could not find container \"92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f\": container with ID starting with 92dc59d970e7cd02333c048f8794f3b46010f805bf9c00f98cb65dab0926537f not found: ID does not exist"
May 28 16:11:13.316497 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.316426    2556 scope.go:117] "RemoveContainer" containerID="1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330"
May 28 16:11:13.316727 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.316704    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330"} err="failed to get container status \"1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330\": rpc error: code = NotFound desc = could not find container \"1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330\": container with ID starting with 1dd2dfa5a0d647164199f92d610878137a10667359579308182e0cc7e028d330 not found: ID does not exist"
May 28 16:11:13.316801 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.316729    2556 scope.go:117] "RemoveContainer" containerID="2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b"
May 28 16:11:13.317017 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.316986    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b"} err="failed to get container status \"2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b\": rpc error: code = NotFound desc = could not find container \"2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b\": container with ID starting with 2614e2dd24ca627e770757a448da9b8e433fe863f993482b2c9552a8d87cb14b not found: ID does not exist"
May 28 16:11:13.317070 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317017    2556 scope.go:117] "RemoveContainer" containerID="d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272"
May 28 16:11:13.317270 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317254    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272"} err="failed to get container status \"d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272\": rpc error: code = NotFound desc = could not find container \"d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272\": container with ID starting with d45e839e2d5f7022fda9d6bc4d04458c5b39de6a021835924c14a4ec6fd7a272 not found: ID does not exist"
May 28 16:11:13.317317 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317270    2556 scope.go:117] "RemoveContainer" containerID="c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079"
May 28 16:11:13.317486 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317470    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 16:11:13.317562 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317469    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079"} err="failed to get container status \"c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079\": rpc error: code = NotFound desc = could not find container \"c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079\": container with ID starting with c6e91dc0762d830e40c03eeb6d55e413754feb6def595c405ace1f1ad632c079 not found: ID does not exist"
May 28 16:11:13.317603 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317564    2556 scope.go:117] "RemoveContainer" containerID="c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64"
May 28 16:11:13.317819 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317784    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64"} err="failed to get container status \"c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64\": rpc error: code = NotFound desc = could not find container \"c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64\": container with ID starting with c25130a44cf38cb144fb07e5da6d7e5215c4232d7e73ea9622e0dc90351e3a64 not found: ID does not exist"
May 28 16:11:13.317819 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317810    2556 scope.go:117] "RemoveContainer" containerID="43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d"
May 28 16:11:13.317993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317840    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="kube-rbac-proxy-web"
May 28 16:11:13.317993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317866    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="kube-rbac-proxy-web"
May 28 16:11:13.317993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317884    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="alertmanager"
May 28 16:11:13.317993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317890    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="alertmanager"
May 28 16:11:13.317993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317897    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="prom-label-proxy"
May 28 16:11:13.317993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317902    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="prom-label-proxy"
May 28 16:11:13.317993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317926    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="config-reloader"
May 28 16:11:13.317993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317934    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="config-reloader"
May 28 16:11:13.317993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317941    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="kube-rbac-proxy"
May 28 16:11:13.317993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317949    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="kube-rbac-proxy"
May 28 16:11:13.317993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317964    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="init-config-reloader"
May 28 16:11:13.317993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317971    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="init-config-reloader"
May 28 16:11:13.317993 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.317979    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="kube-rbac-proxy-metric"
May 28 16:11:13.318441 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.318032    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="kube-rbac-proxy-metric"
May 28 16:11:13.318441 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.318124    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d"} err="failed to get container status \"43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d\": rpc error: code = NotFound desc = could not find container \"43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d\": container with ID starting with 43145da9adb8adb0f4cf4416284b1c859b78862a2c153f66975cfb5708e4877d not found: ID does not exist"
May 28 16:11:13.318441 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.318148    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="prom-label-proxy"
May 28 16:11:13.318441 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.318178    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="alertmanager"
May 28 16:11:13.318441 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.318190    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="kube-rbac-proxy"
May 28 16:11:13.318441 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.318197    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="kube-rbac-proxy-metric"
May 28 16:11:13.318441 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.318207    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="config-reloader"
May 28 16:11:13.318441 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.318214    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" containerName="kube-rbac-proxy-web"
May 28 16:11:13.329414 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.329396    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.332031 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.331930    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 16:11:13.332031 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.332004    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 16:11:13.332843 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.332823    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 16:11:13.333206 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.333091    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 16:11:13.333206 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.333127    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 16:11:13.333348 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.333257    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rlv54\""
May 28 16:11:13.333513 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.333493    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 16:11:13.333594 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.333516    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 16:11:13.333655 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.333606    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 16:11:13.333732 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.333653    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 16:11:13.337758 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.337739    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 16:11:13.417801 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.417773    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-web-config\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.417978 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.417807    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lktnv\" (UniqueName: \"kubernetes.io/projected/35043e24-0f16-4535-b768-6710f4d82d31-kube-api-access-lktnv\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.417978 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.417829    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.417978 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.417882    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35043e24-0f16-4535-b768-6710f4d82d31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.417978 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.417917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.417978 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.417965    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-config-volume\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.418133 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.418000    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.418133 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.418018    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35043e24-0f16-4535-b768-6710f4d82d31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.418133 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.418062    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.418133 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.418082    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35043e24-0f16-4535-b768-6710f4d82d31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.418133 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.418100    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35043e24-0f16-4535-b768-6710f4d82d31-config-out\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.418289 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.418169    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.418289 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.418205    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35043e24-0f16-4535-b768-6710f4d82d31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519218 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519140    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35043e24-0f16-4535-b768-6710f4d82d31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519218 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519187    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519392 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519221    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35043e24-0f16-4535-b768-6710f4d82d31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519392 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519250    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35043e24-0f16-4535-b768-6710f4d82d31-config-out\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519392 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519343    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519392 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519380    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35043e24-0f16-4535-b768-6710f4d82d31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519583 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519416    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-web-config\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519583 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519447    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lktnv\" (UniqueName: \"kubernetes.io/projected/35043e24-0f16-4535-b768-6710f4d82d31-kube-api-access-lktnv\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519583 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519478    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519583 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519503    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35043e24-0f16-4535-b768-6710f4d82d31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519583 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519532    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519583 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519566    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-config-volume\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519921 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519591    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/35043e24-0f16-4535-b768-6710f4d82d31-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.519921 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.519606    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.520461 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.520430    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/35043e24-0f16-4535-b768-6710f4d82d31-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.522138 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.522107    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/35043e24-0f16-4535-b768-6710f4d82d31-config-out\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.522243 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.522203    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/35043e24-0f16-4535-b768-6710f4d82d31-tls-assets\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.522317 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.522249    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.522398 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.522376    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.522521 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.522500    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.522845 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.522823    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.522845 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.522834    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35043e24-0f16-4535-b768-6710f4d82d31-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.522986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.522970    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-web-config\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.523076 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.523061    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.524132 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.524115    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/35043e24-0f16-4535-b768-6710f4d82d31-config-volume\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.529357 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.529335    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lktnv\" (UniqueName: \"kubernetes.io/projected/35043e24-0f16-4535-b768-6710f4d82d31-kube-api-access-lktnv\") pod \"alertmanager-main-0\" (UID: \"35043e24-0f16-4535-b768-6710f4d82d31\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.640958 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.640916    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 16:11:13.795049 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:13.795022    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 16:11:13.796923 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:11:13.796896    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35043e24_0f16_4535_b768_6710f4d82d31.slice/crio-da5d123469ae3cbdb51d81194a2254b990cd6b926fd040401f28b4ba281ae8c1 WatchSource:0}: Error finding container da5d123469ae3cbdb51d81194a2254b990cd6b926fd040401f28b4ba281ae8c1: Status 404 returned error can't find the container with id da5d123469ae3cbdb51d81194a2254b990cd6b926fd040401f28b4ba281ae8c1
May 28 16:11:14.268308 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.268270    2556 generic.go:358] "Generic (PLEG): container finished" podID="35043e24-0f16-4535-b768-6710f4d82d31" containerID="df03fd0644b8bba4ce1fc3ef8987a3eefe3c79cbb210e01904c67a4676f1c19f" exitCode=0
May 28 16:11:14.268706 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.268332    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35043e24-0f16-4535-b768-6710f4d82d31","Type":"ContainerDied","Data":"df03fd0644b8bba4ce1fc3ef8987a3eefe3c79cbb210e01904c67a4676f1c19f"}
May 28 16:11:14.268706 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.268357    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35043e24-0f16-4535-b768-6710f4d82d31","Type":"ContainerStarted","Data":"da5d123469ae3cbdb51d81194a2254b990cd6b926fd040401f28b4ba281ae8c1"}
May 28 16:11:14.562218 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.562189    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f46f76eb-57d9-464a-8ecc-ccaeccac4934" path="/var/lib/kubelet/pods/f46f76eb-57d9-464a-8ecc-ccaeccac4934/volumes"
May 28 16:11:14.636648 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.636607    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-847974dd68-hkpjr"]
May 28 16:11:14.638871 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.638851    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.649018 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.648988    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-847974dd68-hkpjr"]
May 28 16:11:14.728986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.728950    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-oauth-serving-cert\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.728986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.728993    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-service-ca\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.729192 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.729060    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-console-config\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.729192 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.729101    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmhtn\" (UniqueName: \"kubernetes.io/projected/e8a3674a-3042-4611-a088-d951bde892a9-kube-api-access-dmhtn\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.729192 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.729130    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a3674a-3042-4611-a088-d951bde892a9-console-oauth-config\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.729192 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.729149    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-trusted-ca-bundle\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.729192 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.729180    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a3674a-3042-4611-a088-d951bde892a9-console-serving-cert\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.829584 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.829495    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-oauth-serving-cert\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.829584 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.829551    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-service-ca\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.829816 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.829595    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-console-config\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.829816 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.829637    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dmhtn\" (UniqueName: \"kubernetes.io/projected/e8a3674a-3042-4611-a088-d951bde892a9-kube-api-access-dmhtn\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.829816 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.829691    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a3674a-3042-4611-a088-d951bde892a9-console-oauth-config\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.829816 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.829721    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-trusted-ca-bundle\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.829816 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.829750    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a3674a-3042-4611-a088-d951bde892a9-console-serving-cert\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.830296 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.830272    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-oauth-serving-cert\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.830383 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.830358    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-service-ca\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.830484 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.830455    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-console-config\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.830632 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.830509    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-trusted-ca-bundle\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.832596 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.832577    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a3674a-3042-4611-a088-d951bde892a9-console-oauth-config\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.832831 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.832809    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a3674a-3042-4611-a088-d951bde892a9-console-serving-cert\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.837138 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.837115    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmhtn\" (UniqueName: \"kubernetes.io/projected/e8a3674a-3042-4611-a088-d951bde892a9-kube-api-access-dmhtn\") pod \"console-847974dd68-hkpjr\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") " pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:14.965654 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:14.965619    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:15.094791 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:15.094715    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-847974dd68-hkpjr"]
May 28 16:11:15.097469 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:11:15.097439    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a3674a_3042_4611_a088_d951bde892a9.slice/crio-59b52073ab7f1032037c7eed501235a8a4ccd721c317246f5a048d280f28569e WatchSource:0}: Error finding container 59b52073ab7f1032037c7eed501235a8a4ccd721c317246f5a048d280f28569e: Status 404 returned error can't find the container with id 59b52073ab7f1032037c7eed501235a8a4ccd721c317246f5a048d280f28569e
May 28 16:11:15.275656 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:15.275624    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35043e24-0f16-4535-b768-6710f4d82d31","Type":"ContainerStarted","Data":"ac636974225592c00fe89ec154aab113c3a77eed8c8b0b8ef10a9584ba41c6f1"}
May 28 16:11:15.275656 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:15.275662    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35043e24-0f16-4535-b768-6710f4d82d31","Type":"ContainerStarted","Data":"e9b52db9eb8d5b711833e6d96fe347b7fcb8af9e6bf5308848148cee75f9704c"}
May 28 16:11:15.276142 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:15.275703    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35043e24-0f16-4535-b768-6710f4d82d31","Type":"ContainerStarted","Data":"0d38dfdea875647f6e84f1d7a4a25600466c7723db4808f997839f0838c9c43f"}
May 28 16:11:15.276142 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:15.275713    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35043e24-0f16-4535-b768-6710f4d82d31","Type":"ContainerStarted","Data":"17677db1d19d1640de67c8276efd7a8a0a3e5c8c3b3102265550467c9e4e8be3"}
May 28 16:11:15.276142 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:15.275724    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35043e24-0f16-4535-b768-6710f4d82d31","Type":"ContainerStarted","Data":"bc07aa5bb2d475601c2284bd777e23440b5152f071db1be4af6358cf42ce6099"}
May 28 16:11:15.276142 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:15.275754    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"35043e24-0f16-4535-b768-6710f4d82d31","Type":"ContainerStarted","Data":"63c917fb04c3cb511ff087fd15bf5632d7b2342abc1218065bb4aba128eeae63"}
May 28 16:11:15.277048 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:15.277027    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847974dd68-hkpjr" event={"ID":"e8a3674a-3042-4611-a088-d951bde892a9","Type":"ContainerStarted","Data":"032464fb9955682f2c7d812f43fc892be893a5e3cad7aab5067d85a0cf2afe34"}
May 28 16:11:15.277140 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:15.277055    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847974dd68-hkpjr" event={"ID":"e8a3674a-3042-4611-a088-d951bde892a9","Type":"ContainerStarted","Data":"59b52073ab7f1032037c7eed501235a8a4ccd721c317246f5a048d280f28569e"}
May 28 16:11:15.304623 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:15.304570    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.304553892 podStartE2EDuration="2.304553892s" podCreationTimestamp="2026-05-28 16:11:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:11:15.302737668 +0000 UTC m=+221.312118271" watchObservedRunningTime="2026-05-28 16:11:15.304553892 +0000 UTC m=+221.313934494"
May 28 16:11:15.322067 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:15.322009    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-847974dd68-hkpjr" podStartSLOduration=1.3219637579999999 podStartE2EDuration="1.321963758s" podCreationTimestamp="2026-05-28 16:11:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:11:15.320531799 +0000 UTC m=+221.329912404" watchObservedRunningTime="2026-05-28 16:11:15.321963758 +0000 UTC m=+221.331344363"
May 28 16:11:24.965999 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:24.965970    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:24.966529 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:24.966012    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:24.970588 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:24.970564    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:25.312147 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:25.312067    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:11:25.353655 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:25.353618    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b7856c9b8-4q64j"]
May 28 16:11:50.374789 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.374732    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-b7856c9b8-4q64j" podUID="1187fb32-fe2c-4f50-8127-ce4c1abe78ef" containerName="console" containerID="cri-o://b588d13867a8f7c9219faf3ac42a7eac598ce49a5d714fe68adc4fc688fea72b" gracePeriod=15
May 28 16:11:50.613901 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.613881    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b7856c9b8-4q64j_1187fb32-fe2c-4f50-8127-ce4c1abe78ef/console/0.log"
May 28 16:11:50.614042 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.613937    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:11:50.739190 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739112    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-config\") pod \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") "
May 28 16:11:50.739190 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739162    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-oauth-serving-cert\") pod \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") "
May 28 16:11:50.739361 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739275    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-trusted-ca-bundle\") pod \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") "
May 28 16:11:50.739361 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739323    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7g4p\" (UniqueName: \"kubernetes.io/projected/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-kube-api-access-p7g4p\") pod \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") "
May 28 16:11:50.739479 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739459    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-oauth-config\") pod \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") "
May 28 16:11:50.739534 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739508    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-service-ca\") pod \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") "
May 28 16:11:50.739583 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739489    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-config" (OuterVolumeSpecName: "console-config") pod "1187fb32-fe2c-4f50-8127-ce4c1abe78ef" (UID: "1187fb32-fe2c-4f50-8127-ce4c1abe78ef"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:11:50.739583 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739548    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-serving-cert\") pod \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\" (UID: \"1187fb32-fe2c-4f50-8127-ce4c1abe78ef\") "
May 28 16:11:50.739709 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739613    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1187fb32-fe2c-4f50-8127-ce4c1abe78ef" (UID: "1187fb32-fe2c-4f50-8127-ce4c1abe78ef"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:11:50.739709 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739662    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1187fb32-fe2c-4f50-8127-ce4c1abe78ef" (UID: "1187fb32-fe2c-4f50-8127-ce4c1abe78ef"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:11:50.739858 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739836    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-service-ca" (OuterVolumeSpecName: "service-ca") pod "1187fb32-fe2c-4f50-8127-ce4c1abe78ef" (UID: "1187fb32-fe2c-4f50-8127-ce4c1abe78ef"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:11:50.739914 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739897    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-config\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:50.739963 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739923    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-oauth-serving-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:50.739963 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.739938    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-trusted-ca-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:50.741549 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.741525    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1187fb32-fe2c-4f50-8127-ce4c1abe78ef" (UID: "1187fb32-fe2c-4f50-8127-ce4c1abe78ef"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:50.741657 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.741635    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1187fb32-fe2c-4f50-8127-ce4c1abe78ef" (UID: "1187fb32-fe2c-4f50-8127-ce4c1abe78ef"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:50.741715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.741635    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-kube-api-access-p7g4p" (OuterVolumeSpecName: "kube-api-access-p7g4p") pod "1187fb32-fe2c-4f50-8127-ce4c1abe78ef" (UID: "1187fb32-fe2c-4f50-8127-ce4c1abe78ef"). InnerVolumeSpecName "kube-api-access-p7g4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:11:50.841156 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.841131    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7g4p\" (UniqueName: \"kubernetes.io/projected/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-kube-api-access-p7g4p\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:50.841156 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.841157    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-oauth-config\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:50.841286 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.841167    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:50.841286 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:50.841175    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1187fb32-fe2c-4f50-8127-ce4c1abe78ef-console-serving-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:11:51.385319 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:51.385291    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b7856c9b8-4q64j_1187fb32-fe2c-4f50-8127-ce4c1abe78ef/console/0.log"
May 28 16:11:51.385747 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:51.385327    2556 generic.go:358] "Generic (PLEG): container finished" podID="1187fb32-fe2c-4f50-8127-ce4c1abe78ef" containerID="b588d13867a8f7c9219faf3ac42a7eac598ce49a5d714fe68adc4fc688fea72b" exitCode=2
May 28 16:11:51.385747 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:51.385361    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7856c9b8-4q64j" event={"ID":"1187fb32-fe2c-4f50-8127-ce4c1abe78ef","Type":"ContainerDied","Data":"b588d13867a8f7c9219faf3ac42a7eac598ce49a5d714fe68adc4fc688fea72b"}
May 28 16:11:51.385747 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:51.385405    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b7856c9b8-4q64j"
May 28 16:11:51.385747 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:51.385421    2556 scope.go:117] "RemoveContainer" containerID="b588d13867a8f7c9219faf3ac42a7eac598ce49a5d714fe68adc4fc688fea72b"
May 28 16:11:51.385747 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:51.385408    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b7856c9b8-4q64j" event={"ID":"1187fb32-fe2c-4f50-8127-ce4c1abe78ef","Type":"ContainerDied","Data":"041bb39ac86042d45911ac6f35863eadb1bec11a51745ea0e2675032a7e32cdd"}
May 28 16:11:51.394091 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:51.394066    2556 scope.go:117] "RemoveContainer" containerID="b588d13867a8f7c9219faf3ac42a7eac598ce49a5d714fe68adc4fc688fea72b"
May 28 16:11:51.394356 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:11:51.394336    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b588d13867a8f7c9219faf3ac42a7eac598ce49a5d714fe68adc4fc688fea72b\": container with ID starting with b588d13867a8f7c9219faf3ac42a7eac598ce49a5d714fe68adc4fc688fea72b not found: ID does not exist" containerID="b588d13867a8f7c9219faf3ac42a7eac598ce49a5d714fe68adc4fc688fea72b"
May 28 16:11:51.394402 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:51.394366    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b588d13867a8f7c9219faf3ac42a7eac598ce49a5d714fe68adc4fc688fea72b"} err="failed to get container status \"b588d13867a8f7c9219faf3ac42a7eac598ce49a5d714fe68adc4fc688fea72b\": rpc error: code = NotFound desc = could not find container \"b588d13867a8f7c9219faf3ac42a7eac598ce49a5d714fe68adc4fc688fea72b\": container with ID starting with b588d13867a8f7c9219faf3ac42a7eac598ce49a5d714fe68adc4fc688fea72b not found: ID does not exist"
May 28 16:11:51.405456 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:51.405427    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b7856c9b8-4q64j"]
May 28 16:11:51.408922 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:51.408901    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b7856c9b8-4q64j"]
May 28 16:11:52.559784 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:11:52.559744    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1187fb32-fe2c-4f50-8127-ce4c1abe78ef" path="/var/lib/kubelet/pods/1187fb32-fe2c-4f50-8127-ce4c1abe78ef/volumes"
May 28 16:12:21.190966 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.190931    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"]
May 28 16:12:21.191419 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.191254    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1187fb32-fe2c-4f50-8127-ce4c1abe78ef" containerName="console"
May 28 16:12:21.191419 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.191267    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1187fb32-fe2c-4f50-8127-ce4c1abe78ef" containerName="console"
May 28 16:12:21.191419 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.191326    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="1187fb32-fe2c-4f50-8127-ce4c1abe78ef" containerName="console"
May 28 16:12:21.193889 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.193871    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"
May 28 16:12:21.196138 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.196120    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 16:12:21.196908 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.196889    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4rvtr\""
May 28 16:12:21.196997 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.196891    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 16:12:21.201835 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.201815    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"]
May 28 16:12:21.299924 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.299888    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c4a2f1-2f37-48d0-8360-44808fad462f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst\" (UID: \"62c4a2f1-2f37-48d0-8360-44808fad462f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"
May 28 16:12:21.299924 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.299930    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c4a2f1-2f37-48d0-8360-44808fad462f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst\" (UID: \"62c4a2f1-2f37-48d0-8360-44808fad462f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"
May 28 16:12:21.300134 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.299999    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6hrz\" (UniqueName: \"kubernetes.io/projected/62c4a2f1-2f37-48d0-8360-44808fad462f-kube-api-access-n6hrz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst\" (UID: \"62c4a2f1-2f37-48d0-8360-44808fad462f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"
May 28 16:12:21.401199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.401150    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c4a2f1-2f37-48d0-8360-44808fad462f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst\" (UID: \"62c4a2f1-2f37-48d0-8360-44808fad462f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"
May 28 16:12:21.401199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.401208    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c4a2f1-2f37-48d0-8360-44808fad462f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst\" (UID: \"62c4a2f1-2f37-48d0-8360-44808fad462f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"
May 28 16:12:21.401370 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.401245    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6hrz\" (UniqueName: \"kubernetes.io/projected/62c4a2f1-2f37-48d0-8360-44808fad462f-kube-api-access-n6hrz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst\" (UID: \"62c4a2f1-2f37-48d0-8360-44808fad462f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"
May 28 16:12:21.401563 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.401541    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c4a2f1-2f37-48d0-8360-44808fad462f-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst\" (UID: \"62c4a2f1-2f37-48d0-8360-44808fad462f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"
May 28 16:12:21.401601 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.401564    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c4a2f1-2f37-48d0-8360-44808fad462f-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst\" (UID: \"62c4a2f1-2f37-48d0-8360-44808fad462f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"
May 28 16:12:21.409629 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.409600    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6hrz\" (UniqueName: \"kubernetes.io/projected/62c4a2f1-2f37-48d0-8360-44808fad462f-kube-api-access-n6hrz\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst\" (UID: \"62c4a2f1-2f37-48d0-8360-44808fad462f\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"
May 28 16:12:21.503576 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.503482    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"
May 28 16:12:21.625649 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:21.625616    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"]
May 28 16:12:21.629083 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:12:21.629048    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c4a2f1_2f37_48d0_8360_44808fad462f.slice/crio-6c7ea41fdf3348e4edc0d6c6a97aee6e1127db4e8b84f44afda3bcc2b950abc1 WatchSource:0}: Error finding container 6c7ea41fdf3348e4edc0d6c6a97aee6e1127db4e8b84f44afda3bcc2b950abc1: Status 404 returned error can't find the container with id 6c7ea41fdf3348e4edc0d6c6a97aee6e1127db4e8b84f44afda3bcc2b950abc1
May 28 16:12:22.480722 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:22.480667    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst" event={"ID":"62c4a2f1-2f37-48d0-8360-44808fad462f","Type":"ContainerStarted","Data":"6c7ea41fdf3348e4edc0d6c6a97aee6e1127db4e8b84f44afda3bcc2b950abc1"}
May 28 16:12:31.510808 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:31.510771    2556 generic.go:358] "Generic (PLEG): container finished" podID="62c4a2f1-2f37-48d0-8360-44808fad462f" containerID="d8f25299d95df0e3c21e8e4f88b7afdae1f80888a2466e6eec7c6a99928bce4a" exitCode=0
May 28 16:12:31.511179 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:31.510857    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst" event={"ID":"62c4a2f1-2f37-48d0-8360-44808fad462f","Type":"ContainerDied","Data":"d8f25299d95df0e3c21e8e4f88b7afdae1f80888a2466e6eec7c6a99928bce4a"}
May 28 16:12:34.428463 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:34.428436    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:12:34.428952 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:34.428502    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:12:34.431863 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:34.431839    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:12:34.432135 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:34.432110    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:12:34.438460 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:34.438377    2556 kubelet.go:1628] "Image garbage collection succeeded"
May 28 16:12:34.521177 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:34.521047    2556 generic.go:358] "Generic (PLEG): container finished" podID="62c4a2f1-2f37-48d0-8360-44808fad462f" containerID="18ba6284763841eb76d0b2822ce55420a32d50dba5e24b793c61501b99879385" exitCode=0
May 28 16:12:34.521177 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:34.521124    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst" event={"ID":"62c4a2f1-2f37-48d0-8360-44808fad462f","Type":"ContainerDied","Data":"18ba6284763841eb76d0b2822ce55420a32d50dba5e24b793c61501b99879385"}
May 28 16:12:40.542153 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:40.542075    2556 generic.go:358] "Generic (PLEG): container finished" podID="62c4a2f1-2f37-48d0-8360-44808fad462f" containerID="a47f3d0e830c6c68d49830238fe4d5352faf4c043bb37eca55022d16d16605ba" exitCode=0
May 28 16:12:40.542477 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:40.542164    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst" event={"ID":"62c4a2f1-2f37-48d0-8360-44808fad462f","Type":"ContainerDied","Data":"a47f3d0e830c6c68d49830238fe4d5352faf4c043bb37eca55022d16d16605ba"}
May 28 16:12:41.663410 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:41.663388    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"
May 28 16:12:41.785400 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:41.785358    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6hrz\" (UniqueName: \"kubernetes.io/projected/62c4a2f1-2f37-48d0-8360-44808fad462f-kube-api-access-n6hrz\") pod \"62c4a2f1-2f37-48d0-8360-44808fad462f\" (UID: \"62c4a2f1-2f37-48d0-8360-44808fad462f\") "
May 28 16:12:41.785400 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:41.785412    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c4a2f1-2f37-48d0-8360-44808fad462f-bundle\") pod \"62c4a2f1-2f37-48d0-8360-44808fad462f\" (UID: \"62c4a2f1-2f37-48d0-8360-44808fad462f\") "
May 28 16:12:41.785668 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:41.785449    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c4a2f1-2f37-48d0-8360-44808fad462f-util\") pod \"62c4a2f1-2f37-48d0-8360-44808fad462f\" (UID: \"62c4a2f1-2f37-48d0-8360-44808fad462f\") "
May 28 16:12:41.786123 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:41.786099    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c4a2f1-2f37-48d0-8360-44808fad462f-bundle" (OuterVolumeSpecName: "bundle") pod "62c4a2f1-2f37-48d0-8360-44808fad462f" (UID: "62c4a2f1-2f37-48d0-8360-44808fad462f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:12:41.787594 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:41.787569    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62c4a2f1-2f37-48d0-8360-44808fad462f-kube-api-access-n6hrz" (OuterVolumeSpecName: "kube-api-access-n6hrz") pod "62c4a2f1-2f37-48d0-8360-44808fad462f" (UID: "62c4a2f1-2f37-48d0-8360-44808fad462f"). InnerVolumeSpecName "kube-api-access-n6hrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:12:41.789492 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:41.789473    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62c4a2f1-2f37-48d0-8360-44808fad462f-util" (OuterVolumeSpecName: "util") pod "62c4a2f1-2f37-48d0-8360-44808fad462f" (UID: "62c4a2f1-2f37-48d0-8360-44808fad462f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:12:41.886706 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:41.886653    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6hrz\" (UniqueName: \"kubernetes.io/projected/62c4a2f1-2f37-48d0-8360-44808fad462f-kube-api-access-n6hrz\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:12:41.886706 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:41.886708    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62c4a2f1-2f37-48d0-8360-44808fad462f-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:12:41.886843 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:41.886723    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62c4a2f1-2f37-48d0-8360-44808fad462f-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:12:42.549012 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:42.548972    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst" event={"ID":"62c4a2f1-2f37-48d0-8360-44808fad462f","Type":"ContainerDied","Data":"6c7ea41fdf3348e4edc0d6c6a97aee6e1127db4e8b84f44afda3bcc2b950abc1"}
May 28 16:12:42.549012 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:42.549013    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c7ea41fdf3348e4edc0d6c6a97aee6e1127db4e8b84f44afda3bcc2b950abc1"
May 28 16:12:42.549325 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:42.549037    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dfbjst"
May 28 16:12:53.780662 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.780627    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"]
May 28 16:12:53.781116 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.780968    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c4a2f1-2f37-48d0-8360-44808fad462f" containerName="util"
May 28 16:12:53.781116 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.780980    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c4a2f1-2f37-48d0-8360-44808fad462f" containerName="util"
May 28 16:12:53.781116 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.780992    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c4a2f1-2f37-48d0-8360-44808fad462f" containerName="pull"
May 28 16:12:53.781116 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.780997    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c4a2f1-2f37-48d0-8360-44808fad462f" containerName="pull"
May 28 16:12:53.781116 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.781013    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62c4a2f1-2f37-48d0-8360-44808fad462f" containerName="extract"
May 28 16:12:53.781116 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.781018    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="62c4a2f1-2f37-48d0-8360-44808fad462f" containerName="extract"
May 28 16:12:53.781116 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.781066    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="62c4a2f1-2f37-48d0-8360-44808fad462f" containerName="extract"
May 28 16:12:53.783032 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.783008    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"
May 28 16:12:53.785330 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.785310    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 16:12:53.785935 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.785917    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 16:12:53.786023 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.785920    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4rvtr\""
May 28 16:12:53.799036 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.799014    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"]
May 28 16:12:53.883610 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.883574    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3208f4c5-a0f1-442f-ab3f-4088001b42d5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v\" (UID: \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"
May 28 16:12:53.883796 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.883618    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3208f4c5-a0f1-442f-ab3f-4088001b42d5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v\" (UID: \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"
May 28 16:12:53.883796 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.883706    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zqzl\" (UniqueName: \"kubernetes.io/projected/3208f4c5-a0f1-442f-ab3f-4088001b42d5-kube-api-access-4zqzl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v\" (UID: \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"
May 28 16:12:53.984590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.984541    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3208f4c5-a0f1-442f-ab3f-4088001b42d5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v\" (UID: \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"
May 28 16:12:53.984778 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.984605    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3208f4c5-a0f1-442f-ab3f-4088001b42d5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v\" (UID: \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"
May 28 16:12:53.984778 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.984643    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zqzl\" (UniqueName: \"kubernetes.io/projected/3208f4c5-a0f1-442f-ab3f-4088001b42d5-kube-api-access-4zqzl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v\" (UID: \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"
May 28 16:12:53.984969 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.984950    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3208f4c5-a0f1-442f-ab3f-4088001b42d5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v\" (UID: \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"
May 28 16:12:53.985030 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.985009    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3208f4c5-a0f1-442f-ab3f-4088001b42d5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v\" (UID: \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"
May 28 16:12:53.995808 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:53.995780    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zqzl\" (UniqueName: \"kubernetes.io/projected/3208f4c5-a0f1-442f-ab3f-4088001b42d5-kube-api-access-4zqzl\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v\" (UID: \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"
May 28 16:12:54.092033 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.091954    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"
May 28 16:12:54.214699 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.214550    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"]
May 28 16:12:54.217442 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:12:54.217416    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3208f4c5_a0f1_442f_ab3f_4088001b42d5.slice/crio-db2bf5beb1493d77290de485a8af7ea78a147255a9affd956ab89eac32717f48 WatchSource:0}: Error finding container db2bf5beb1493d77290de485a8af7ea78a147255a9affd956ab89eac32717f48: Status 404 returned error can't find the container with id db2bf5beb1493d77290de485a8af7ea78a147255a9affd956ab89eac32717f48
May 28 16:12:54.219137 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.219120    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 16:12:54.587216 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.587181    2556 generic.go:358] "Generic (PLEG): container finished" podID="3208f4c5-a0f1-442f-ab3f-4088001b42d5" containerID="129e051a0fa426a49f367aadbc762cb2885a9c417de239eb44506664cb24d3a2" exitCode=0
May 28 16:12:54.587418 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.587236    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v" event={"ID":"3208f4c5-a0f1-442f-ab3f-4088001b42d5","Type":"ContainerDied","Data":"129e051a0fa426a49f367aadbc762cb2885a9c417de239eb44506664cb24d3a2"}
May 28 16:12:54.587418 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.587256    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v" event={"ID":"3208f4c5-a0f1-442f-ab3f-4088001b42d5","Type":"ContainerStarted","Data":"db2bf5beb1493d77290de485a8af7ea78a147255a9affd956ab89eac32717f48"}
May 28 16:12:54.714192 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.714146    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-222mm"]
May 28 16:12:54.716345 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.716324    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-222mm"
May 28 16:12:54.718627 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.718602    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 28 16:12:54.718721 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.718661    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ffmj8\""
May 28 16:12:54.718791 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.718773    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 28 16:12:54.727356 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.727332    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-222mm"]
May 28 16:12:54.791082 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.791047    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07a05006-f781-4597-8e07-21024ae0bb89-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-222mm\" (UID: \"07a05006-f781-4597-8e07-21024ae0bb89\") " pod="cert-manager/cert-manager-webhook-587ccfb98-222mm"
May 28 16:12:54.791443 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.791147    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqn6v\" (UniqueName: \"kubernetes.io/projected/07a05006-f781-4597-8e07-21024ae0bb89-kube-api-access-kqn6v\") pod \"cert-manager-webhook-587ccfb98-222mm\" (UID: \"07a05006-f781-4597-8e07-21024ae0bb89\") " pod="cert-manager/cert-manager-webhook-587ccfb98-222mm"
May 28 16:12:54.891971 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.891939    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqn6v\" (UniqueName: \"kubernetes.io/projected/07a05006-f781-4597-8e07-21024ae0bb89-kube-api-access-kqn6v\") pod \"cert-manager-webhook-587ccfb98-222mm\" (UID: \"07a05006-f781-4597-8e07-21024ae0bb89\") " pod="cert-manager/cert-manager-webhook-587ccfb98-222mm"
May 28 16:12:54.892118 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.891996    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07a05006-f781-4597-8e07-21024ae0bb89-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-222mm\" (UID: \"07a05006-f781-4597-8e07-21024ae0bb89\") " pod="cert-manager/cert-manager-webhook-587ccfb98-222mm"
May 28 16:12:54.899350 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.899324    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/07a05006-f781-4597-8e07-21024ae0bb89-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-222mm\" (UID: \"07a05006-f781-4597-8e07-21024ae0bb89\") " pod="cert-manager/cert-manager-webhook-587ccfb98-222mm"
May 28 16:12:54.899470 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:54.899422    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqn6v\" (UniqueName: \"kubernetes.io/projected/07a05006-f781-4597-8e07-21024ae0bb89-kube-api-access-kqn6v\") pod \"cert-manager-webhook-587ccfb98-222mm\" (UID: \"07a05006-f781-4597-8e07-21024ae0bb89\") " pod="cert-manager/cert-manager-webhook-587ccfb98-222mm"
May 28 16:12:55.036560 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:55.036531    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-222mm"
May 28 16:12:55.160911 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:55.160582    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-222mm"]
May 28 16:12:55.163272 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:12:55.163246    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07a05006_f781_4597_8e07_21024ae0bb89.slice/crio-fc91e13d5b1a61afeb337f0e32abce0805dd8e1b4b59da129e07a21e263c065f WatchSource:0}: Error finding container fc91e13d5b1a61afeb337f0e32abce0805dd8e1b4b59da129e07a21e263c065f: Status 404 returned error can't find the container with id fc91e13d5b1a61afeb337f0e32abce0805dd8e1b4b59da129e07a21e263c065f
May 28 16:12:55.591119 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:55.591033    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-222mm" event={"ID":"07a05006-f781-4597-8e07-21024ae0bb89","Type":"ContainerStarted","Data":"fc91e13d5b1a61afeb337f0e32abce0805dd8e1b4b59da129e07a21e263c065f"}
May 28 16:12:58.604733 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:58.604695    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-222mm" event={"ID":"07a05006-f781-4597-8e07-21024ae0bb89","Type":"ContainerStarted","Data":"279db369f37b9da3629cd617bbd42c65a4b9db386b87ae1a0e4a212d16cd622b"}
May 28 16:12:58.605245 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:58.604768    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-222mm"
May 28 16:12:58.606318 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:58.606299    2556 generic.go:358] "Generic (PLEG): container finished" podID="3208f4c5-a0f1-442f-ab3f-4088001b42d5" containerID="c1458fdef4c42bbabcf4abe8c1a984b43f8ec2f3b79a0dab0b76f9dc6ab7068e" exitCode=0
May 28 16:12:58.606378 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:58.606353    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v" event={"ID":"3208f4c5-a0f1-442f-ab3f-4088001b42d5","Type":"ContainerDied","Data":"c1458fdef4c42bbabcf4abe8c1a984b43f8ec2f3b79a0dab0b76f9dc6ab7068e"}
May 28 16:12:58.626991 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:58.626946    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-222mm" podStartSLOduration=1.758878267 podStartE2EDuration="4.62693452s" podCreationTimestamp="2026-05-28 16:12:54 +0000 UTC" firstStartedPulling="2026-05-28 16:12:55.165088302 +0000 UTC m=+321.174468884" lastFinishedPulling="2026-05-28 16:12:58.033144553 +0000 UTC m=+324.042525137" observedRunningTime="2026-05-28 16:12:58.624998422 +0000 UTC m=+324.634379025" watchObservedRunningTime="2026-05-28 16:12:58.62693452 +0000 UTC m=+324.636315122"
May 28 16:12:59.612870 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:59.612835    2556 generic.go:358] "Generic (PLEG): container finished" podID="3208f4c5-a0f1-442f-ab3f-4088001b42d5" containerID="27845b4996b0807973e58f94c70d73392ac477e707563174bb3886c63462a81e" exitCode=0
May 28 16:12:59.613247 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:12:59.612919    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v" event={"ID":"3208f4c5-a0f1-442f-ab3f-4088001b42d5","Type":"ContainerDied","Data":"27845b4996b0807973e58f94c70d73392ac477e707563174bb3886c63462a81e"}
May 28 16:13:00.748630 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:00.748604    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"
May 28 16:13:00.845246 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:00.845216    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3208f4c5-a0f1-442f-ab3f-4088001b42d5-bundle\") pod \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\" (UID: \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\") "
May 28 16:13:00.845435 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:00.845257    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3208f4c5-a0f1-442f-ab3f-4088001b42d5-util\") pod \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\" (UID: \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\") "
May 28 16:13:00.845435 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:00.845352    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zqzl\" (UniqueName: \"kubernetes.io/projected/3208f4c5-a0f1-442f-ab3f-4088001b42d5-kube-api-access-4zqzl\") pod \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\" (UID: \"3208f4c5-a0f1-442f-ab3f-4088001b42d5\") "
May 28 16:13:00.845629 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:00.845600    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3208f4c5-a0f1-442f-ab3f-4088001b42d5-bundle" (OuterVolumeSpecName: "bundle") pod "3208f4c5-a0f1-442f-ab3f-4088001b42d5" (UID: "3208f4c5-a0f1-442f-ab3f-4088001b42d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:13:00.847450 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:00.847423    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3208f4c5-a0f1-442f-ab3f-4088001b42d5-kube-api-access-4zqzl" (OuterVolumeSpecName: "kube-api-access-4zqzl") pod "3208f4c5-a0f1-442f-ab3f-4088001b42d5" (UID: "3208f4c5-a0f1-442f-ab3f-4088001b42d5"). InnerVolumeSpecName "kube-api-access-4zqzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:13:00.849833 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:00.849799    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3208f4c5-a0f1-442f-ab3f-4088001b42d5-util" (OuterVolumeSpecName: "util") pod "3208f4c5-a0f1-442f-ab3f-4088001b42d5" (UID: "3208f4c5-a0f1-442f-ab3f-4088001b42d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:13:00.946071 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:00.945989    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3208f4c5-a0f1-442f-ab3f-4088001b42d5-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:13:00.946071 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:00.946018    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3208f4c5-a0f1-442f-ab3f-4088001b42d5-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:13:00.946071 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:00.946028    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zqzl\" (UniqueName: \"kubernetes.io/projected/3208f4c5-a0f1-442f-ab3f-4088001b42d5-kube-api-access-4zqzl\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:13:01.620863 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:01.620826    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v" event={"ID":"3208f4c5-a0f1-442f-ab3f-4088001b42d5","Type":"ContainerDied","Data":"db2bf5beb1493d77290de485a8af7ea78a147255a9affd956ab89eac32717f48"}
May 28 16:13:01.620863 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:01.620859    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rz8v"
May 28 16:13:01.621075 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:01.620862    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db2bf5beb1493d77290de485a8af7ea78a147255a9affd956ab89eac32717f48"
May 28 16:13:04.614863 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:04.614835    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-222mm"
May 28 16:13:07.326386 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.326347    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz"]
May 28 16:13:07.326878 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.326823    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3208f4c5-a0f1-442f-ab3f-4088001b42d5" containerName="extract"
May 28 16:13:07.326878 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.326841    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3208f4c5-a0f1-442f-ab3f-4088001b42d5" containerName="extract"
May 28 16:13:07.326878 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.326857    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3208f4c5-a0f1-442f-ab3f-4088001b42d5" containerName="util"
May 28 16:13:07.326878 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.326865    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3208f4c5-a0f1-442f-ab3f-4088001b42d5" containerName="util"
May 28 16:13:07.326878 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.326874    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3208f4c5-a0f1-442f-ab3f-4088001b42d5" containerName="pull"
May 28 16:13:07.327158 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.326882    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3208f4c5-a0f1-442f-ab3f-4088001b42d5" containerName="pull"
May 28 16:13:07.327158 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.326991    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="3208f4c5-a0f1-442f-ab3f-4088001b42d5" containerName="extract"
May 28 16:13:07.329453 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.329433    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz"
May 28 16:13:07.331568 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.331551    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 16:13:07.332409 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.332392    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 16:13:07.332501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.332480    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-x2gx7\""
May 28 16:13:07.338488 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.338464    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz"]
May 28 16:13:07.405206 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.405175    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm4nk\" (UniqueName: \"kubernetes.io/projected/cac529a7-70f9-4537-a88a-800beb240e2d-kube-api-access-dm4nk\") pod \"openshift-lws-operator-bfc7f696d-8h9pz\" (UID: \"cac529a7-70f9-4537-a88a-800beb240e2d\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz"
May 28 16:13:07.405364 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.405230    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cac529a7-70f9-4537-a88a-800beb240e2d-tmp\") pod \"openshift-lws-operator-bfc7f696d-8h9pz\" (UID: \"cac529a7-70f9-4537-a88a-800beb240e2d\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz"
May 28 16:13:07.505963 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.505930    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dm4nk\" (UniqueName: \"kubernetes.io/projected/cac529a7-70f9-4537-a88a-800beb240e2d-kube-api-access-dm4nk\") pod \"openshift-lws-operator-bfc7f696d-8h9pz\" (UID: \"cac529a7-70f9-4537-a88a-800beb240e2d\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz"
May 28 16:13:07.506119 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.505972    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cac529a7-70f9-4537-a88a-800beb240e2d-tmp\") pod \"openshift-lws-operator-bfc7f696d-8h9pz\" (UID: \"cac529a7-70f9-4537-a88a-800beb240e2d\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz"
May 28 16:13:07.506315 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.506281    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cac529a7-70f9-4537-a88a-800beb240e2d-tmp\") pod \"openshift-lws-operator-bfc7f696d-8h9pz\" (UID: \"cac529a7-70f9-4537-a88a-800beb240e2d\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz"
May 28 16:13:07.514092 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.514070    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm4nk\" (UniqueName: \"kubernetes.io/projected/cac529a7-70f9-4537-a88a-800beb240e2d-kube-api-access-dm4nk\") pod \"openshift-lws-operator-bfc7f696d-8h9pz\" (UID: \"cac529a7-70f9-4537-a88a-800beb240e2d\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz"
May 28 16:13:07.638775 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.638749    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz"
May 28 16:13:07.763814 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:07.763767    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz"]
May 28 16:13:07.768041 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:13:07.768014    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcac529a7_70f9_4537_a88a_800beb240e2d.slice/crio-93aae164b6df19ce7c200f840453490a98e43ead0c409eda60335af16066c4d7 WatchSource:0}: Error finding container 93aae164b6df19ce7c200f840453490a98e43ead0c409eda60335af16066c4d7: Status 404 returned error can't find the container with id 93aae164b6df19ce7c200f840453490a98e43ead0c409eda60335af16066c4d7
May 28 16:13:08.644384 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:08.644346    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz" event={"ID":"cac529a7-70f9-4537-a88a-800beb240e2d","Type":"ContainerStarted","Data":"93aae164b6df19ce7c200f840453490a98e43ead0c409eda60335af16066c4d7"}
May 28 16:13:10.651861 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:10.651825    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz" event={"ID":"cac529a7-70f9-4537-a88a-800beb240e2d","Type":"ContainerStarted","Data":"2510f8a840983c7a848f97f9fcaa4ecd1c9cf825906af6f4889b65a731f0ddc6"}
May 28 16:13:10.667597 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:10.667560    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-8h9pz" podStartSLOduration=1.620030195 podStartE2EDuration="3.667547802s" podCreationTimestamp="2026-05-28 16:13:07 +0000 UTC" firstStartedPulling="2026-05-28 16:13:07.769350795 +0000 UTC m=+333.778731377" lastFinishedPulling="2026-05-28 16:13:09.816868399 +0000 UTC m=+335.826248984" observedRunningTime="2026-05-28 16:13:10.666310347 +0000 UTC m=+336.675690949" watchObservedRunningTime="2026-05-28 16:13:10.667547802 +0000 UTC m=+336.676928405"
May 28 16:13:13.103544 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.103504    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"]
May 28 16:13:13.105863 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.105845    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"
May 28 16:13:13.108237 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.108202    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 16:13:13.108382 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.108246    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 16:13:13.108382 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.108324    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4rvtr\""
May 28 16:13:13.118474 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.115921    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"]
May 28 16:13:13.256960 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.256919    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa023163-2dd0-4c9d-9f93-758a18a04410-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5\" (UID: \"aa023163-2dd0-4c9d-9f93-758a18a04410\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"
May 28 16:13:13.256960 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.256964    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndcq8\" (UniqueName: \"kubernetes.io/projected/aa023163-2dd0-4c9d-9f93-758a18a04410-kube-api-access-ndcq8\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5\" (UID: \"aa023163-2dd0-4c9d-9f93-758a18a04410\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"
May 28 16:13:13.257180 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.257086    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa023163-2dd0-4c9d-9f93-758a18a04410-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5\" (UID: \"aa023163-2dd0-4c9d-9f93-758a18a04410\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"
May 28 16:13:13.357581 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.357504    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa023163-2dd0-4c9d-9f93-758a18a04410-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5\" (UID: \"aa023163-2dd0-4c9d-9f93-758a18a04410\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"
May 28 16:13:13.357581 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.357545    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndcq8\" (UniqueName: \"kubernetes.io/projected/aa023163-2dd0-4c9d-9f93-758a18a04410-kube-api-access-ndcq8\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5\" (UID: \"aa023163-2dd0-4c9d-9f93-758a18a04410\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"
May 28 16:13:13.357773 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.357587    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa023163-2dd0-4c9d-9f93-758a18a04410-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5\" (UID: \"aa023163-2dd0-4c9d-9f93-758a18a04410\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"
May 28 16:13:13.357958 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.357942    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa023163-2dd0-4c9d-9f93-758a18a04410-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5\" (UID: \"aa023163-2dd0-4c9d-9f93-758a18a04410\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"
May 28 16:13:13.357998 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.357939    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa023163-2dd0-4c9d-9f93-758a18a04410-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5\" (UID: \"aa023163-2dd0-4c9d-9f93-758a18a04410\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"
May 28 16:13:13.365406 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.365378    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndcq8\" (UniqueName: \"kubernetes.io/projected/aa023163-2dd0-4c9d-9f93-758a18a04410-kube-api-access-ndcq8\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5\" (UID: \"aa023163-2dd0-4c9d-9f93-758a18a04410\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"
May 28 16:13:13.422272 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.422232    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"
May 28 16:13:13.571347 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.571314    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"]
May 28 16:13:13.574726 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:13:13.574695    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa023163_2dd0_4c9d_9f93_758a18a04410.slice/crio-43eef48c4d277cab89914f76ddc17b1daf14e27b1a83a7489745b2642eb34a86 WatchSource:0}: Error finding container 43eef48c4d277cab89914f76ddc17b1daf14e27b1a83a7489745b2642eb34a86: Status 404 returned error can't find the container with id 43eef48c4d277cab89914f76ddc17b1daf14e27b1a83a7489745b2642eb34a86
May 28 16:13:13.663075 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.663032    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5" event={"ID":"aa023163-2dd0-4c9d-9f93-758a18a04410","Type":"ContainerStarted","Data":"77daec03cbb2c6ffca3bbf46c39f0e83d379fb3b166ae1c1b5eab9c012db0cc4"}
May 28 16:13:13.663075 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:13.663071    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5" event={"ID":"aa023163-2dd0-4c9d-9f93-758a18a04410","Type":"ContainerStarted","Data":"43eef48c4d277cab89914f76ddc17b1daf14e27b1a83a7489745b2642eb34a86"}
May 28 16:13:14.267888 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.267853    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-2fx7d"]
May 28 16:13:14.270654 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.270637    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-2fx7d"
May 28 16:13:14.272728 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.272703    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4q9b6\""
May 28 16:13:14.279590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.279569    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-2fx7d"]
May 28 16:13:14.364924 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.364894    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86-bound-sa-token\") pod \"cert-manager-79c8d999ff-2fx7d\" (UID: \"ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86\") " pod="cert-manager/cert-manager-79c8d999ff-2fx7d"
May 28 16:13:14.365098 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.365017    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7xw9\" (UniqueName: \"kubernetes.io/projected/ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86-kube-api-access-k7xw9\") pod \"cert-manager-79c8d999ff-2fx7d\" (UID: \"ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86\") " pod="cert-manager/cert-manager-79c8d999ff-2fx7d"
May 28 16:13:14.466202 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.466167    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7xw9\" (UniqueName: \"kubernetes.io/projected/ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86-kube-api-access-k7xw9\") pod \"cert-manager-79c8d999ff-2fx7d\" (UID: \"ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86\") " pod="cert-manager/cert-manager-79c8d999ff-2fx7d"
May 28 16:13:14.466399 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.466232    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86-bound-sa-token\") pod \"cert-manager-79c8d999ff-2fx7d\" (UID: \"ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86\") " pod="cert-manager/cert-manager-79c8d999ff-2fx7d"
May 28 16:13:14.473727 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.473703    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86-bound-sa-token\") pod \"cert-manager-79c8d999ff-2fx7d\" (UID: \"ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86\") " pod="cert-manager/cert-manager-79c8d999ff-2fx7d"
May 28 16:13:14.473998 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.473976    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7xw9\" (UniqueName: \"kubernetes.io/projected/ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86-kube-api-access-k7xw9\") pod \"cert-manager-79c8d999ff-2fx7d\" (UID: \"ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86\") " pod="cert-manager/cert-manager-79c8d999ff-2fx7d"
May 28 16:13:14.580421 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.580349    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-2fx7d"
May 28 16:13:14.669195 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.669162    2556 generic.go:358] "Generic (PLEG): container finished" podID="aa023163-2dd0-4c9d-9f93-758a18a04410" containerID="77daec03cbb2c6ffca3bbf46c39f0e83d379fb3b166ae1c1b5eab9c012db0cc4" exitCode=0
May 28 16:13:14.669370 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.669202    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5" event={"ID":"aa023163-2dd0-4c9d-9f93-758a18a04410","Type":"ContainerDied","Data":"77daec03cbb2c6ffca3bbf46c39f0e83d379fb3b166ae1c1b5eab9c012db0cc4"}
May 28 16:13:14.704224 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:14.704200    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-2fx7d"]
May 28 16:13:14.706354 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:13:14.706323    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea5c9378_dd15_42e3_a30f_a3d3f7c1ea86.slice/crio-b856152ceeca874590940f45d6bac000bbc6c12555df95f73cf1bb5c00c1ec5e WatchSource:0}: Error finding container b856152ceeca874590940f45d6bac000bbc6c12555df95f73cf1bb5c00c1ec5e: Status 404 returned error can't find the container with id b856152ceeca874590940f45d6bac000bbc6c12555df95f73cf1bb5c00c1ec5e
May 28 16:13:15.675425 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:15.675390    2556 generic.go:358] "Generic (PLEG): container finished" podID="aa023163-2dd0-4c9d-9f93-758a18a04410" containerID="b1ae0325a06b5831d0e1260a40c0a57a1eb842f571443eda42430866928f3c6a" exitCode=0
May 28 16:13:15.675850 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:15.675475    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5" event={"ID":"aa023163-2dd0-4c9d-9f93-758a18a04410","Type":"ContainerDied","Data":"b1ae0325a06b5831d0e1260a40c0a57a1eb842f571443eda42430866928f3c6a"}
May 28 16:13:15.677090 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:15.677046    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-2fx7d" event={"ID":"ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86","Type":"ContainerStarted","Data":"06b1ab6d6262344929b9a6700e58d1854dd9ff9ae3ca8335191af3ccce0a82bf"}
May 28 16:13:15.677090 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:15.677085    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-2fx7d" event={"ID":"ea5c9378-dd15-42e3-a30f-a3d3f7c1ea86","Type":"ContainerStarted","Data":"b856152ceeca874590940f45d6bac000bbc6c12555df95f73cf1bb5c00c1ec5e"}
May 28 16:13:15.705516 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:15.705478    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-2fx7d" podStartSLOduration=1.705463671 podStartE2EDuration="1.705463671s" podCreationTimestamp="2026-05-28 16:13:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:13:15.703951444 +0000 UTC m=+341.713332049" watchObservedRunningTime="2026-05-28 16:13:15.705463671 +0000 UTC m=+341.714844273"
May 28 16:13:16.681653 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:16.681620    2556 generic.go:358] "Generic (PLEG): container finished" podID="aa023163-2dd0-4c9d-9f93-758a18a04410" containerID="c84ab9f6aef01791c1dc5fd93b0cf6c79e3529958f30722b1b735dbcfbf54098" exitCode=0
May 28 16:13:16.682138 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:16.681708    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5" event={"ID":"aa023163-2dd0-4c9d-9f93-758a18a04410","Type":"ContainerDied","Data":"c84ab9f6aef01791c1dc5fd93b0cf6c79e3529958f30722b1b735dbcfbf54098"}
May 28 16:13:17.814837 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:17.814810    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"
May 28 16:13:17.894798 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:17.894765    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa023163-2dd0-4c9d-9f93-758a18a04410-util\") pod \"aa023163-2dd0-4c9d-9f93-758a18a04410\" (UID: \"aa023163-2dd0-4c9d-9f93-758a18a04410\") "
May 28 16:13:17.894945 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:17.894834    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndcq8\" (UniqueName: \"kubernetes.io/projected/aa023163-2dd0-4c9d-9f93-758a18a04410-kube-api-access-ndcq8\") pod \"aa023163-2dd0-4c9d-9f93-758a18a04410\" (UID: \"aa023163-2dd0-4c9d-9f93-758a18a04410\") "
May 28 16:13:17.894945 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:17.894870    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa023163-2dd0-4c9d-9f93-758a18a04410-bundle\") pod \"aa023163-2dd0-4c9d-9f93-758a18a04410\" (UID: \"aa023163-2dd0-4c9d-9f93-758a18a04410\") "
May 28 16:13:17.895564 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:17.895538    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa023163-2dd0-4c9d-9f93-758a18a04410-bundle" (OuterVolumeSpecName: "bundle") pod "aa023163-2dd0-4c9d-9f93-758a18a04410" (UID: "aa023163-2dd0-4c9d-9f93-758a18a04410"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:13:17.896915 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:17.896890    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa023163-2dd0-4c9d-9f93-758a18a04410-kube-api-access-ndcq8" (OuterVolumeSpecName: "kube-api-access-ndcq8") pod "aa023163-2dd0-4c9d-9f93-758a18a04410" (UID: "aa023163-2dd0-4c9d-9f93-758a18a04410"). InnerVolumeSpecName "kube-api-access-ndcq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:13:17.899891 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:17.899872    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa023163-2dd0-4c9d-9f93-758a18a04410-util" (OuterVolumeSpecName: "util") pod "aa023163-2dd0-4c9d-9f93-758a18a04410" (UID: "aa023163-2dd0-4c9d-9f93-758a18a04410"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:13:17.995947 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:17.995864    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndcq8\" (UniqueName: \"kubernetes.io/projected/aa023163-2dd0-4c9d-9f93-758a18a04410-kube-api-access-ndcq8\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:13:17.995947 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:17.995903    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa023163-2dd0-4c9d-9f93-758a18a04410-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:13:17.995947 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:17.995914    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa023163-2dd0-4c9d-9f93-758a18a04410-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:13:18.692888 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:18.692862    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5"
May 28 16:13:18.693033 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:18.692861    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5lncv5" event={"ID":"aa023163-2dd0-4c9d-9f93-758a18a04410","Type":"ContainerDied","Data":"43eef48c4d277cab89914f76ddc17b1daf14e27b1a83a7489745b2642eb34a86"}
May 28 16:13:18.693033 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:18.692973    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43eef48c4d277cab89914f76ddc17b1daf14e27b1a83a7489745b2642eb34a86"
May 28 16:13:27.081467 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.081381    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"]
May 28 16:13:27.081871 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.081767    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa023163-2dd0-4c9d-9f93-758a18a04410" containerName="util"
May 28 16:13:27.081871 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.081781    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa023163-2dd0-4c9d-9f93-758a18a04410" containerName="util"
May 28 16:13:27.081871 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.081795    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa023163-2dd0-4c9d-9f93-758a18a04410" containerName="pull"
May 28 16:13:27.081871 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.081800    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa023163-2dd0-4c9d-9f93-758a18a04410" containerName="pull"
May 28 16:13:27.081871 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.081813    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa023163-2dd0-4c9d-9f93-758a18a04410" containerName="extract"
May 28 16:13:27.081871 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.081819    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa023163-2dd0-4c9d-9f93-758a18a04410" containerName="extract"
May 28 16:13:27.081871 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.081868    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa023163-2dd0-4c9d-9f93-758a18a04410" containerName="extract"
May 28 16:13:27.083863 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.083847    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"
May 28 16:13:27.086210 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.086192    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 16:13:27.086953 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.086938    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 16:13:27.087005 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.086941    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4rvtr\""
May 28 16:13:27.095469 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.095446    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"]
May 28 16:13:27.172105 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.172064    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmvlp\" (UniqueName: \"kubernetes.io/projected/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-kube-api-access-mmvlp\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv\" (UID: \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"
May 28 16:13:27.172301 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.172132    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv\" (UID: \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"
May 28 16:13:27.172301 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.172158    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv\" (UID: \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"
May 28 16:13:27.273423 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.273385    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmvlp\" (UniqueName: \"kubernetes.io/projected/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-kube-api-access-mmvlp\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv\" (UID: \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"
May 28 16:13:27.273612 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.273441    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv\" (UID: \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"
May 28 16:13:27.273612 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.273466    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv\" (UID: \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"
May 28 16:13:27.273935 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.273910    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv\" (UID: \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"
May 28 16:13:27.273987 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.273921    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv\" (UID: \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"
May 28 16:13:27.282424 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.282401    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmvlp\" (UniqueName: \"kubernetes.io/projected/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-kube-api-access-mmvlp\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv\" (UID: \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"
May 28 16:13:27.392790 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.392756    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"
May 28 16:13:27.519225 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.519205    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"]
May 28 16:13:27.521269 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:13:27.521233    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1932f74f_af4c_48b6_b6a2_5c91d91d5f43.slice/crio-8619d984514ba0b16ddd9c3c7412c2ddb53b557ca30a377959706d0c71d818b2 WatchSource:0}: Error finding container 8619d984514ba0b16ddd9c3c7412c2ddb53b557ca30a377959706d0c71d818b2: Status 404 returned error can't find the container with id 8619d984514ba0b16ddd9c3c7412c2ddb53b557ca30a377959706d0c71d818b2
May 28 16:13:27.724454 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.724362    2556 generic.go:358] "Generic (PLEG): container finished" podID="1932f74f-af4c-48b6-b6a2-5c91d91d5f43" containerID="40dcc1c2b8b337466b89998d088817302be191b91811d4c4672d321883cba7fe" exitCode=0
May 28 16:13:27.724454 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.724414    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv" event={"ID":"1932f74f-af4c-48b6-b6a2-5c91d91d5f43","Type":"ContainerDied","Data":"40dcc1c2b8b337466b89998d088817302be191b91811d4c4672d321883cba7fe"}
May 28 16:13:27.724454 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:27.724449    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv" event={"ID":"1932f74f-af4c-48b6-b6a2-5c91d91d5f43","Type":"ContainerStarted","Data":"8619d984514ba0b16ddd9c3c7412c2ddb53b557ca30a377959706d0c71d818b2"}
May 28 16:13:28.599243 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.599167    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"]
May 28 16:13:28.601377 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.601355    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"
May 28 16:13:28.607495 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.607471    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pb8rq\""
May 28 16:13:28.607817 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.607794    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 16:13:28.607937 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.607824    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 16:13:28.608112 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.607942    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 16:13:28.608275 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.608259    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 16:13:28.619350 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.619331    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"]
May 28 16:13:28.686587 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.686554    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/733c5827-40c7-4d43-98af-ca57290ae164-apiservice-cert\") pod \"opendatahub-operator-controller-manager-95cfdd646-xnhlx\" (UID: \"733c5827-40c7-4d43-98af-ca57290ae164\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"
May 28 16:13:28.686761 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.686597    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcbfw\" (UniqueName: \"kubernetes.io/projected/733c5827-40c7-4d43-98af-ca57290ae164-kube-api-access-pcbfw\") pod \"opendatahub-operator-controller-manager-95cfdd646-xnhlx\" (UID: \"733c5827-40c7-4d43-98af-ca57290ae164\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"
May 28 16:13:28.686761 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.686704    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/733c5827-40c7-4d43-98af-ca57290ae164-webhook-cert\") pod \"opendatahub-operator-controller-manager-95cfdd646-xnhlx\" (UID: \"733c5827-40c7-4d43-98af-ca57290ae164\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"
May 28 16:13:28.729109 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.729081    2556 generic.go:358] "Generic (PLEG): container finished" podID="1932f74f-af4c-48b6-b6a2-5c91d91d5f43" containerID="83f6b3d49c91ea337f5e6eaaace3c36a3b5b8fb1f08a5e37a369bd93df3d7458" exitCode=0
May 28 16:13:28.729279 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.729172    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv" event={"ID":"1932f74f-af4c-48b6-b6a2-5c91d91d5f43","Type":"ContainerDied","Data":"83f6b3d49c91ea337f5e6eaaace3c36a3b5b8fb1f08a5e37a369bd93df3d7458"}
May 28 16:13:28.787289 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.787264    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/733c5827-40c7-4d43-98af-ca57290ae164-apiservice-cert\") pod \"opendatahub-operator-controller-manager-95cfdd646-xnhlx\" (UID: \"733c5827-40c7-4d43-98af-ca57290ae164\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"
May 28 16:13:28.787442 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.787297    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcbfw\" (UniqueName: \"kubernetes.io/projected/733c5827-40c7-4d43-98af-ca57290ae164-kube-api-access-pcbfw\") pod \"opendatahub-operator-controller-manager-95cfdd646-xnhlx\" (UID: \"733c5827-40c7-4d43-98af-ca57290ae164\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"
May 28 16:13:28.787442 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.787329    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/733c5827-40c7-4d43-98af-ca57290ae164-webhook-cert\") pod \"opendatahub-operator-controller-manager-95cfdd646-xnhlx\" (UID: \"733c5827-40c7-4d43-98af-ca57290ae164\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"
May 28 16:13:28.789655 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.789629    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/733c5827-40c7-4d43-98af-ca57290ae164-apiservice-cert\") pod \"opendatahub-operator-controller-manager-95cfdd646-xnhlx\" (UID: \"733c5827-40c7-4d43-98af-ca57290ae164\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"
May 28 16:13:28.789783 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.789650    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/733c5827-40c7-4d43-98af-ca57290ae164-webhook-cert\") pod \"opendatahub-operator-controller-manager-95cfdd646-xnhlx\" (UID: \"733c5827-40c7-4d43-98af-ca57290ae164\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"
May 28 16:13:28.796071 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.796048    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcbfw\" (UniqueName: \"kubernetes.io/projected/733c5827-40c7-4d43-98af-ca57290ae164-kube-api-access-pcbfw\") pod \"opendatahub-operator-controller-manager-95cfdd646-xnhlx\" (UID: \"733c5827-40c7-4d43-98af-ca57290ae164\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"
May 28 16:13:28.911498 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:28.911473    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"
May 28 16:13:29.071855 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:29.071829    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"]
May 28 16:13:29.074057 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:13:29.074031    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733c5827_40c7_4d43_98af_ca57290ae164.slice/crio-0fc8f684a3cc54f7e93eaad6a9bb350ce3b550cbf9dd61635bfcf9a3865e67c1 WatchSource:0}: Error finding container 0fc8f684a3cc54f7e93eaad6a9bb350ce3b550cbf9dd61635bfcf9a3865e67c1: Status 404 returned error can't find the container with id 0fc8f684a3cc54f7e93eaad6a9bb350ce3b550cbf9dd61635bfcf9a3865e67c1
May 28 16:13:29.735184 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:29.735141    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx" event={"ID":"733c5827-40c7-4d43-98af-ca57290ae164","Type":"ContainerStarted","Data":"0fc8f684a3cc54f7e93eaad6a9bb350ce3b550cbf9dd61635bfcf9a3865e67c1"}
May 28 16:13:29.737443 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:29.737369    2556 generic.go:358] "Generic (PLEG): container finished" podID="1932f74f-af4c-48b6-b6a2-5c91d91d5f43" containerID="2d229aa12c244da78f82e98deeea96d3852561a1e3b7fb22b5f4fce902a15873" exitCode=0
May 28 16:13:29.737443 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:29.737407    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv" event={"ID":"1932f74f-af4c-48b6-b6a2-5c91d91d5f43","Type":"ContainerDied","Data":"2d229aa12c244da78f82e98deeea96d3852561a1e3b7fb22b5f4fce902a15873"}
May 28 16:13:31.465315 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.465291    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"
May 28 16:13:31.613259 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.613229    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmvlp\" (UniqueName: \"kubernetes.io/projected/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-kube-api-access-mmvlp\") pod \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\" (UID: \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\") "
May 28 16:13:31.613422 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.613281    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-util\") pod \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\" (UID: \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\") "
May 28 16:13:31.613422 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.613315    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-bundle\") pod \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\" (UID: \"1932f74f-af4c-48b6-b6a2-5c91d91d5f43\") "
May 28 16:13:31.614260 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.614228    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-bundle" (OuterVolumeSpecName: "bundle") pod "1932f74f-af4c-48b6-b6a2-5c91d91d5f43" (UID: "1932f74f-af4c-48b6-b6a2-5c91d91d5f43"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:13:31.615481 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.615451    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-kube-api-access-mmvlp" (OuterVolumeSpecName: "kube-api-access-mmvlp") pod "1932f74f-af4c-48b6-b6a2-5c91d91d5f43" (UID: "1932f74f-af4c-48b6-b6a2-5c91d91d5f43"). InnerVolumeSpecName "kube-api-access-mmvlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:13:31.618406 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.618377    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-util" (OuterVolumeSpecName: "util") pod "1932f74f-af4c-48b6-b6a2-5c91d91d5f43" (UID: "1932f74f-af4c-48b6-b6a2-5c91d91d5f43"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:13:31.714850 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.714779    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:13:31.714850 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.714812    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmvlp\" (UniqueName: \"kubernetes.io/projected/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-kube-api-access-mmvlp\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:13:31.714850 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.714828    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1932f74f-af4c-48b6-b6a2-5c91d91d5f43-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:13:31.746366 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.746337    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv"
May 28 16:13:31.746578 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.746340    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9crsvv" event={"ID":"1932f74f-af4c-48b6-b6a2-5c91d91d5f43","Type":"ContainerDied","Data":"8619d984514ba0b16ddd9c3c7412c2ddb53b557ca30a377959706d0c71d818b2"}
May 28 16:13:31.746578 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.746450    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8619d984514ba0b16ddd9c3c7412c2ddb53b557ca30a377959706d0c71d818b2"
May 28 16:13:31.747904 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.747879    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx" event={"ID":"733c5827-40c7-4d43-98af-ca57290ae164","Type":"ContainerStarted","Data":"2291788d9956f1784a7b19859dd8fffe9b0998ddccf26fcfd86ddf3a985dffd6"}
May 28 16:13:31.748029 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.748016    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"
May 28 16:13:31.765699 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:31.765581    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx" podStartSLOduration=1.366270321 podStartE2EDuration="3.765568439s" podCreationTimestamp="2026-05-28 16:13:28 +0000 UTC" firstStartedPulling="2026-05-28 16:13:29.075903778 +0000 UTC m=+355.085284363" lastFinishedPulling="2026-05-28 16:13:31.4752019 +0000 UTC m=+357.484582481" observedRunningTime="2026-05-28 16:13:31.764254729 +0000 UTC m=+357.773635332" watchObservedRunningTime="2026-05-28 16:13:31.765568439 +0000 UTC m=+357.774949043"
May 28 16:13:42.754398 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:42.754365    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-xnhlx"
May 28 16:13:45.549119 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.549084    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"]
May 28 16:13:45.549545 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.549401    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1932f74f-af4c-48b6-b6a2-5c91d91d5f43" containerName="pull"
May 28 16:13:45.549545 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.549410    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1932f74f-af4c-48b6-b6a2-5c91d91d5f43" containerName="pull"
May 28 16:13:45.549545 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.549420    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1932f74f-af4c-48b6-b6a2-5c91d91d5f43" containerName="util"
May 28 16:13:45.549545 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.549426    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1932f74f-af4c-48b6-b6a2-5c91d91d5f43" containerName="util"
May 28 16:13:45.549545 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.549433    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1932f74f-af4c-48b6-b6a2-5c91d91d5f43" containerName="extract"
May 28 16:13:45.549545 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.549439    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1932f74f-af4c-48b6-b6a2-5c91d91d5f43" containerName="extract"
May 28 16:13:45.549545 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.549489    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="1932f74f-af4c-48b6-b6a2-5c91d91d5f43" containerName="extract"
May 28 16:13:45.552170 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.552153    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"
May 28 16:13:45.555384 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.555358    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4rvtr\""
May 28 16:13:45.555862 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.555844    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 16:13:45.556145 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.556125    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 16:13:45.575726 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.575700    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"]
May 28 16:13:45.730867 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.730830    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5\" (UID: \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"
May 28 16:13:45.731038 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.730872    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fc7p\" (UniqueName: \"kubernetes.io/projected/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-kube-api-access-7fc7p\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5\" (UID: \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"
May 28 16:13:45.731038 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.730913    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5\" (UID: \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"
May 28 16:13:45.831487 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.831408    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5\" (UID: \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"
May 28 16:13:45.831640 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.831544    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5\" (UID: \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"
May 28 16:13:45.831640 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.831572    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fc7p\" (UniqueName: \"kubernetes.io/projected/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-kube-api-access-7fc7p\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5\" (UID: \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"
May 28 16:13:45.831886 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.831866    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5\" (UID: \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"
May 28 16:13:45.831949 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.831893    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5\" (UID: \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"
May 28 16:13:45.839770 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.839743    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fc7p\" (UniqueName: \"kubernetes.io/projected/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-kube-api-access-7fc7p\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5\" (UID: \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"
May 28 16:13:45.861146 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.861127    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"
May 28 16:13:45.993450 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:45.993422    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"]
May 28 16:13:45.994947 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:13:45.994915    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3ff6b0_0b1c_4312_9d9a_ddea062d4054.slice/crio-e645a25238e1ec2c9c49ad730e0cc89919a6b5e1773e483870384dcf097b946b WatchSource:0}: Error finding container e645a25238e1ec2c9c49ad730e0cc89919a6b5e1773e483870384dcf097b946b: Status 404 returned error can't find the container with id e645a25238e1ec2c9c49ad730e0cc89919a6b5e1773e483870384dcf097b946b
May 28 16:13:46.143497 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.143470    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"]
May 28 16:13:46.145590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.145574    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"
May 28 16:13:46.148130 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.148107    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x4nhq\""
May 28 16:13:46.148234 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.148218    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 28 16:13:46.148283 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.148222    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 28 16:13:46.160790 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.160768    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"]
May 28 16:13:46.233880 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.233849    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rzkf\" (UniqueName: \"kubernetes.io/projected/023c7ff7-6c2d-4411-93ac-da24693206a3-kube-api-access-2rzkf\") pod \"kube-auth-proxy-6949b9c5f6-h6sw4\" (UID: \"023c7ff7-6c2d-4411-93ac-da24693206a3\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"
May 28 16:13:46.234054 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.233946    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/023c7ff7-6c2d-4411-93ac-da24693206a3-tls-certs\") pod \"kube-auth-proxy-6949b9c5f6-h6sw4\" (UID: \"023c7ff7-6c2d-4411-93ac-da24693206a3\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"
May 28 16:13:46.234054 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.233975    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/023c7ff7-6c2d-4411-93ac-da24693206a3-tmp\") pod \"kube-auth-proxy-6949b9c5f6-h6sw4\" (UID: \"023c7ff7-6c2d-4411-93ac-da24693206a3\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"
May 28 16:13:46.334498 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.334467    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/023c7ff7-6c2d-4411-93ac-da24693206a3-tls-certs\") pod \"kube-auth-proxy-6949b9c5f6-h6sw4\" (UID: \"023c7ff7-6c2d-4411-93ac-da24693206a3\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"
May 28 16:13:46.334698 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.334510    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/023c7ff7-6c2d-4411-93ac-da24693206a3-tmp\") pod \"kube-auth-proxy-6949b9c5f6-h6sw4\" (UID: \"023c7ff7-6c2d-4411-93ac-da24693206a3\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"
May 28 16:13:46.334698 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.334569    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rzkf\" (UniqueName: \"kubernetes.io/projected/023c7ff7-6c2d-4411-93ac-da24693206a3-kube-api-access-2rzkf\") pod \"kube-auth-proxy-6949b9c5f6-h6sw4\" (UID: \"023c7ff7-6c2d-4411-93ac-da24693206a3\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"
May 28 16:13:46.336882 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.336857    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/023c7ff7-6c2d-4411-93ac-da24693206a3-tmp\") pod \"kube-auth-proxy-6949b9c5f6-h6sw4\" (UID: \"023c7ff7-6c2d-4411-93ac-da24693206a3\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"
May 28 16:13:46.337082 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.337060    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/023c7ff7-6c2d-4411-93ac-da24693206a3-tls-certs\") pod \"kube-auth-proxy-6949b9c5f6-h6sw4\" (UID: \"023c7ff7-6c2d-4411-93ac-da24693206a3\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"
May 28 16:13:46.342582 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.342526    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rzkf\" (UniqueName: \"kubernetes.io/projected/023c7ff7-6c2d-4411-93ac-da24693206a3-kube-api-access-2rzkf\") pod \"kube-auth-proxy-6949b9c5f6-h6sw4\" (UID: \"023c7ff7-6c2d-4411-93ac-da24693206a3\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"
May 28 16:13:46.471740 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.471705    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"
May 28 16:13:46.604214 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.604117    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4"]
May 28 16:13:46.606453 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:13:46.606424    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023c7ff7_6c2d_4411_93ac_da24693206a3.slice/crio-5f56b1f917fd4b3cf9781ebc3fcec0151486a1c103afc5c6ff7bc11edbf86807 WatchSource:0}: Error finding container 5f56b1f917fd4b3cf9781ebc3fcec0151486a1c103afc5c6ff7bc11edbf86807: Status 404 returned error can't find the container with id 5f56b1f917fd4b3cf9781ebc3fcec0151486a1c103afc5c6ff7bc11edbf86807
May 28 16:13:46.799567 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.799535    2556 generic.go:358] "Generic (PLEG): container finished" podID="7d3ff6b0-0b1c-4312-9d9a-ddea062d4054" containerID="b7493d89d2ec3539edc1508392c3737a4a56218abfe5ef3c7973a2fcea4bbe18" exitCode=0
May 28 16:13:46.799763 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.799607    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5" event={"ID":"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054","Type":"ContainerDied","Data":"b7493d89d2ec3539edc1508392c3737a4a56218abfe5ef3c7973a2fcea4bbe18"}
May 28 16:13:46.799763 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.799633    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5" event={"ID":"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054","Type":"ContainerStarted","Data":"e645a25238e1ec2c9c49ad730e0cc89919a6b5e1773e483870384dcf097b946b"}
May 28 16:13:46.800720 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:46.800696    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4" event={"ID":"023c7ff7-6c2d-4411-93ac-da24693206a3","Type":"ContainerStarted","Data":"5f56b1f917fd4b3cf9781ebc3fcec0151486a1c103afc5c6ff7bc11edbf86807"}
May 28 16:13:47.807548 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:47.807063    2556 generic.go:358] "Generic (PLEG): container finished" podID="7d3ff6b0-0b1c-4312-9d9a-ddea062d4054" containerID="34f23d276280199d0622bad5df6cebd61e84bf2b8fe1e3fe0d1fa873460d1bcb" exitCode=0
May 28 16:13:47.807548 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:47.807232    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5" event={"ID":"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054","Type":"ContainerDied","Data":"34f23d276280199d0622bad5df6cebd61e84bf2b8fe1e3fe0d1fa873460d1bcb"}
May 28 16:13:48.814425 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:48.814339    2556 generic.go:358] "Generic (PLEG): container finished" podID="7d3ff6b0-0b1c-4312-9d9a-ddea062d4054" containerID="3296ee5ff508d7149038e2fe470955648b6c560e59b3b25e59885f4855f2cf44" exitCode=0
May 28 16:13:48.814425 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:48.814405    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5" event={"ID":"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054","Type":"ContainerDied","Data":"3296ee5ff508d7149038e2fe470955648b6c560e59b3b25e59885f4855f2cf44"}
May 28 16:13:49.820457 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.820416    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4" event={"ID":"023c7ff7-6c2d-4411-93ac-da24693206a3","Type":"ContainerStarted","Data":"8382031711c3cbf312c940f9c6ccbab8c1ce3d6309a5c407caa494675bffaabc"}
May 28 16:13:49.840437 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.840387    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-h6sw4" podStartSLOduration=0.831176975 podStartE2EDuration="3.840370895s" podCreationTimestamp="2026-05-28 16:13:46 +0000 UTC" firstStartedPulling="2026-05-28 16:13:46.608408504 +0000 UTC m=+372.617789085" lastFinishedPulling="2026-05-28 16:13:49.61760242 +0000 UTC m=+375.626983005" observedRunningTime="2026-05-28 16:13:49.839132284 +0000 UTC m=+375.848512886" watchObservedRunningTime="2026-05-28 16:13:49.840370895 +0000 UTC m=+375.849751497"
May 28 16:13:49.890896 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.890866    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-fblnw"]
May 28 16:13:49.893433 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.893415    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-fblnw"
May 28 16:13:49.895808 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.895788    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 28 16:13:49.896279 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.895824    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-r2swb\""
May 28 16:13:49.899217 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.899123    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-fblnw"]
May 28 16:13:49.954316 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.954295    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"
May 28 16:13:49.968104 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.968082    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fc7p\" (UniqueName: \"kubernetes.io/projected/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-kube-api-access-7fc7p\") pod \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\" (UID: \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\") "
May 28 16:13:49.968193 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.968141    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-util\") pod \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\" (UID: \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\") "
May 28 16:13:49.968193 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.968172    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-bundle\") pod \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\" (UID: \"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054\") "
May 28 16:13:49.968323 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.968308    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psc6c\" (UniqueName: \"kubernetes.io/projected/9c4ca407-2438-4b50-bc71-340a1b3801bb-kube-api-access-psc6c\") pod \"odh-model-controller-858dbf95b8-fblnw\" (UID: \"9c4ca407-2438-4b50-bc71-340a1b3801bb\") " pod="opendatahub/odh-model-controller-858dbf95b8-fblnw"
May 28 16:13:49.968378 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.968340    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c4ca407-2438-4b50-bc71-340a1b3801bb-cert\") pod \"odh-model-controller-858dbf95b8-fblnw\" (UID: \"9c4ca407-2438-4b50-bc71-340a1b3801bb\") " pod="opendatahub/odh-model-controller-858dbf95b8-fblnw"
May 28 16:13:49.969071 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.969049    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-bundle" (OuterVolumeSpecName: "bundle") pod "7d3ff6b0-0b1c-4312-9d9a-ddea062d4054" (UID: "7d3ff6b0-0b1c-4312-9d9a-ddea062d4054"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:13:49.970081 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.970053    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-kube-api-access-7fc7p" (OuterVolumeSpecName: "kube-api-access-7fc7p") pod "7d3ff6b0-0b1c-4312-9d9a-ddea062d4054" (UID: "7d3ff6b0-0b1c-4312-9d9a-ddea062d4054"). InnerVolumeSpecName "kube-api-access-7fc7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:13:49.974378 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:49.974328    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-util" (OuterVolumeSpecName: "util") pod "7d3ff6b0-0b1c-4312-9d9a-ddea062d4054" (UID: "7d3ff6b0-0b1c-4312-9d9a-ddea062d4054"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:13:50.069054 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:50.069019    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psc6c\" (UniqueName: \"kubernetes.io/projected/9c4ca407-2438-4b50-bc71-340a1b3801bb-kube-api-access-psc6c\") pod \"odh-model-controller-858dbf95b8-fblnw\" (UID: \"9c4ca407-2438-4b50-bc71-340a1b3801bb\") " pod="opendatahub/odh-model-controller-858dbf95b8-fblnw"
May 28 16:13:50.069236 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:50.069063    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c4ca407-2438-4b50-bc71-340a1b3801bb-cert\") pod \"odh-model-controller-858dbf95b8-fblnw\" (UID: \"9c4ca407-2438-4b50-bc71-340a1b3801bb\") " pod="opendatahub/odh-model-controller-858dbf95b8-fblnw"
May 28 16:13:50.069236 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:50.069134    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fc7p\" (UniqueName: \"kubernetes.io/projected/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-kube-api-access-7fc7p\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:13:50.069236 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:50.069144    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:13:50.069236 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:50.069153    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d3ff6b0-0b1c-4312-9d9a-ddea062d4054-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:13:50.069236 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:13:50.069220    2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 28 16:13:50.069498 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:13:50.069269    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c4ca407-2438-4b50-bc71-340a1b3801bb-cert podName:9c4ca407-2438-4b50-bc71-340a1b3801bb nodeName:}" failed. No retries permitted until 2026-05-28 16:13:50.56925355 +0000 UTC m=+376.578634132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9c4ca407-2438-4b50-bc71-340a1b3801bb-cert") pod "odh-model-controller-858dbf95b8-fblnw" (UID: "9c4ca407-2438-4b50-bc71-340a1b3801bb") : secret "odh-model-controller-webhook-cert" not found
May 28 16:13:50.077504 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:50.077481    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psc6c\" (UniqueName: \"kubernetes.io/projected/9c4ca407-2438-4b50-bc71-340a1b3801bb-kube-api-access-psc6c\") pod \"odh-model-controller-858dbf95b8-fblnw\" (UID: \"9c4ca407-2438-4b50-bc71-340a1b3801bb\") " pod="opendatahub/odh-model-controller-858dbf95b8-fblnw"
May 28 16:13:50.572749 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:50.572724    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c4ca407-2438-4b50-bc71-340a1b3801bb-cert\") pod \"odh-model-controller-858dbf95b8-fblnw\" (UID: \"9c4ca407-2438-4b50-bc71-340a1b3801bb\") " pod="opendatahub/odh-model-controller-858dbf95b8-fblnw"
May 28 16:13:50.572873 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:13:50.572850    2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 28 16:13:50.572912 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:13:50.572903    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c4ca407-2438-4b50-bc71-340a1b3801bb-cert podName:9c4ca407-2438-4b50-bc71-340a1b3801bb nodeName:}" failed. No retries permitted until 2026-05-28 16:13:51.572888373 +0000 UTC m=+377.582268954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9c4ca407-2438-4b50-bc71-340a1b3801bb-cert") pod "odh-model-controller-858dbf95b8-fblnw" (UID: "9c4ca407-2438-4b50-bc71-340a1b3801bb") : secret "odh-model-controller-webhook-cert" not found
May 28 16:13:50.827476 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:50.827393    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5"
May 28 16:13:50.827476 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:50.827389    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c48352bzc5" event={"ID":"7d3ff6b0-0b1c-4312-9d9a-ddea062d4054","Type":"ContainerDied","Data":"e645a25238e1ec2c9c49ad730e0cc89919a6b5e1773e483870384dcf097b946b"}
May 28 16:13:50.827476 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:50.827443    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e645a25238e1ec2c9c49ad730e0cc89919a6b5e1773e483870384dcf097b946b"
May 28 16:13:51.582964 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:51.582924    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c4ca407-2438-4b50-bc71-340a1b3801bb-cert\") pod \"odh-model-controller-858dbf95b8-fblnw\" (UID: \"9c4ca407-2438-4b50-bc71-340a1b3801bb\") " pod="opendatahub/odh-model-controller-858dbf95b8-fblnw"
May 28 16:13:51.585246 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:51.585224    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c4ca407-2438-4b50-bc71-340a1b3801bb-cert\") pod \"odh-model-controller-858dbf95b8-fblnw\" (UID: \"9c4ca407-2438-4b50-bc71-340a1b3801bb\") " pod="opendatahub/odh-model-controller-858dbf95b8-fblnw"
May 28 16:13:51.707497 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:51.707467    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-fblnw"
May 28 16:13:52.042715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:52.042692    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-fblnw"]
May 28 16:13:52.045197 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:13:52.045168    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4ca407_2438_4b50_bc71_340a1b3801bb.slice/crio-6ba02fe4388e2b22090311ea2af26461df12acfdb2edbae2998f41fdd72db75b WatchSource:0}: Error finding container 6ba02fe4388e2b22090311ea2af26461df12acfdb2edbae2998f41fdd72db75b: Status 404 returned error can't find the container with id 6ba02fe4388e2b22090311ea2af26461df12acfdb2edbae2998f41fdd72db75b
May 28 16:13:52.835687 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:52.835645    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-fblnw" event={"ID":"9c4ca407-2438-4b50-bc71-340a1b3801bb","Type":"ContainerStarted","Data":"6ba02fe4388e2b22090311ea2af26461df12acfdb2edbae2998f41fdd72db75b"}
May 28 16:13:55.343313 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.343281    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-sptlh"]
May 28 16:13:55.343784 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.343738    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d3ff6b0-0b1c-4312-9d9a-ddea062d4054" containerName="extract"
May 28 16:13:55.343850 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.343797    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d3ff6b0-0b1c-4312-9d9a-ddea062d4054" containerName="extract"
May 28 16:13:55.343850 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.343821    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d3ff6b0-0b1c-4312-9d9a-ddea062d4054" containerName="pull"
May 28 16:13:55.343850 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.343830    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d3ff6b0-0b1c-4312-9d9a-ddea062d4054" containerName="pull"
May 28 16:13:55.343850 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.343846    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d3ff6b0-0b1c-4312-9d9a-ddea062d4054" containerName="util"
May 28 16:13:55.344212 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.343854    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d3ff6b0-0b1c-4312-9d9a-ddea062d4054" containerName="util"
May 28 16:13:55.344212 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.343952    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="7d3ff6b0-0b1c-4312-9d9a-ddea062d4054" containerName="extract"
May 28 16:13:55.345766 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.345751    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-sptlh"
May 28 16:13:55.348298 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.348236    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 28 16:13:55.348409 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.348378    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-m5lj4\""
May 28 16:13:55.358882 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.358831    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-sptlh"]
May 28 16:13:55.416789 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.416764    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76-cert\") pod \"kserve-controller-manager-856948b99f-sptlh\" (UID: \"1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76\") " pod="opendatahub/kserve-controller-manager-856948b99f-sptlh"
May 28 16:13:55.416899 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.416816    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8k8f\" (UniqueName: \"kubernetes.io/projected/1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76-kube-api-access-t8k8f\") pod \"kserve-controller-manager-856948b99f-sptlh\" (UID: \"1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76\") " pod="opendatahub/kserve-controller-manager-856948b99f-sptlh"
May 28 16:13:55.518019 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.517986    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76-cert\") pod \"kserve-controller-manager-856948b99f-sptlh\" (UID: \"1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76\") " pod="opendatahub/kserve-controller-manager-856948b99f-sptlh"
May 28 16:13:55.518194 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:13:55.518156    2556 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 28 16:13:55.518248 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.518158    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8k8f\" (UniqueName: \"kubernetes.io/projected/1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76-kube-api-access-t8k8f\") pod \"kserve-controller-manager-856948b99f-sptlh\" (UID: \"1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76\") " pod="opendatahub/kserve-controller-manager-856948b99f-sptlh"
May 28 16:13:55.518248 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:13:55.518223    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76-cert podName:1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76 nodeName:}" failed. No retries permitted until 2026-05-28 16:13:56.018198411 +0000 UTC m=+382.027578995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76-cert") pod "kserve-controller-manager-856948b99f-sptlh" (UID: "1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76") : secret "kserve-webhook-server-cert" not found
May 28 16:13:55.530525 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.530503    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8k8f\" (UniqueName: \"kubernetes.io/projected/1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76-kube-api-access-t8k8f\") pod \"kserve-controller-manager-856948b99f-sptlh\" (UID: \"1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76\") " pod="opendatahub/kserve-controller-manager-856948b99f-sptlh"
May 28 16:13:55.848823 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.848788    2556 generic.go:358] "Generic (PLEG): container finished" podID="9c4ca407-2438-4b50-bc71-340a1b3801bb" containerID="adff4218142457e2a89f263803162011fc52d4358dc874adbca69e65ce51ecf3" exitCode=1
May 28 16:13:55.849098 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.848824    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-fblnw" event={"ID":"9c4ca407-2438-4b50-bc71-340a1b3801bb","Type":"ContainerDied","Data":"adff4218142457e2a89f263803162011fc52d4358dc874adbca69e65ce51ecf3"}
May 28 16:13:55.849178 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:55.849110    2556 scope.go:117] "RemoveContainer" containerID="adff4218142457e2a89f263803162011fc52d4358dc874adbca69e65ce51ecf3"
May 28 16:13:56.023128 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:56.023087    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76-cert\") pod \"kserve-controller-manager-856948b99f-sptlh\" (UID: \"1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76\") " pod="opendatahub/kserve-controller-manager-856948b99f-sptlh"
May 28 16:13:56.025727 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:56.025702    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76-cert\") pod \"kserve-controller-manager-856948b99f-sptlh\" (UID: \"1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76\") " pod="opendatahub/kserve-controller-manager-856948b99f-sptlh"
May 28 16:13:56.267006 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:56.266969    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-sptlh"
May 28 16:13:56.428744 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:56.428072    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-sptlh"]
May 28 16:13:56.436194 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:13:56.436167    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b5443a0_f7ba_45eb_9a9d_fb791eb0ca76.slice/crio-e2916488c02669f7351775717f99629607340c52f67e07e6521c3d7b8c160847 WatchSource:0}: Error finding container e2916488c02669f7351775717f99629607340c52f67e07e6521c3d7b8c160847: Status 404 returned error can't find the container with id e2916488c02669f7351775717f99629607340c52f67e07e6521c3d7b8c160847
May 28 16:13:56.853775 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:56.853661    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-sptlh" event={"ID":"1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76","Type":"ContainerStarted","Data":"e2916488c02669f7351775717f99629607340c52f67e07e6521c3d7b8c160847"}
May 28 16:13:56.855271 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:56.855248    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-fblnw" event={"ID":"9c4ca407-2438-4b50-bc71-340a1b3801bb","Type":"ContainerStarted","Data":"35c2aed8cec209f6bae0c29f4e3e838ed8eeb000f9b90533614be30d4f885e87"}
May 28 16:13:56.855416 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:56.855405    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-fblnw"
May 28 16:13:56.872971 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:56.872931    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-fblnw" podStartSLOduration=3.790987376 podStartE2EDuration="7.872917274s" podCreationTimestamp="2026-05-28 16:13:49 +0000 UTC" firstStartedPulling="2026-05-28 16:13:52.046605539 +0000 UTC m=+378.055986119" lastFinishedPulling="2026-05-28 16:13:56.128535422 +0000 UTC m=+382.137916017" observedRunningTime="2026-05-28 16:13:56.869830304 +0000 UTC m=+382.879210906" watchObservedRunningTime="2026-05-28 16:13:56.872917274 +0000 UTC m=+382.882297877"
May 28 16:13:59.813400 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.813349    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"]
May 28 16:13:59.818787 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.818764    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"
May 28 16:13:59.822917 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.822891    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 16:13:59.823433 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.823413    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4rvtr\""
May 28 16:13:59.825817 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.825508    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"]
May 28 16:13:59.826962 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.826942    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 16:13:59.863368 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.863314    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d04322a-aff6-455d-a538-a567e82de0db-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7\" (UID: \"8d04322a-aff6-455d-a538-a567e82de0db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"
May 28 16:13:59.863512 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.863371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv8wm\" (UniqueName: \"kubernetes.io/projected/8d04322a-aff6-455d-a538-a567e82de0db-kube-api-access-wv8wm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7\" (UID: \"8d04322a-aff6-455d-a538-a567e82de0db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"
May 28 16:13:59.863576 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.863516    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d04322a-aff6-455d-a538-a567e82de0db-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7\" (UID: \"8d04322a-aff6-455d-a538-a567e82de0db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"
May 28 16:13:59.964299 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.964259    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d04322a-aff6-455d-a538-a567e82de0db-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7\" (UID: \"8d04322a-aff6-455d-a538-a567e82de0db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"
May 28 16:13:59.964476 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.964337    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d04322a-aff6-455d-a538-a567e82de0db-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7\" (UID: \"8d04322a-aff6-455d-a538-a567e82de0db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"
May 28 16:13:59.964476 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.964374    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wv8wm\" (UniqueName: \"kubernetes.io/projected/8d04322a-aff6-455d-a538-a567e82de0db-kube-api-access-wv8wm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7\" (UID: \"8d04322a-aff6-455d-a538-a567e82de0db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"
May 28 16:13:59.964723 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.964700    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d04322a-aff6-455d-a538-a567e82de0db-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7\" (UID: \"8d04322a-aff6-455d-a538-a567e82de0db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"
May 28 16:13:59.964723 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.964710    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d04322a-aff6-455d-a538-a567e82de0db-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7\" (UID: \"8d04322a-aff6-455d-a538-a567e82de0db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"
May 28 16:13:59.982243 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:13:59.982215    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv8wm\" (UniqueName: \"kubernetes.io/projected/8d04322a-aff6-455d-a538-a567e82de0db-kube-api-access-wv8wm\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7\" (UID: \"8d04322a-aff6-455d-a538-a567e82de0db\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"
May 28 16:14:00.135048 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:00.135007    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"
May 28 16:14:00.291107 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:00.290993    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"]
May 28 16:14:00.293473 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:14:00.293440    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d04322a_aff6_455d_a538_a567e82de0db.slice/crio-7ee64af24a283acde670081c3d48405fbdd08ff4e71ba4d6c6ddc7363a624647 WatchSource:0}: Error finding container 7ee64af24a283acde670081c3d48405fbdd08ff4e71ba4d6c6ddc7363a624647: Status 404 returned error can't find the container with id 7ee64af24a283acde670081c3d48405fbdd08ff4e71ba4d6c6ddc7363a624647
May 28 16:14:00.871651 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:00.871610    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-sptlh" event={"ID":"1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76","Type":"ContainerStarted","Data":"131b8b7ef4329fcdf628ffca654abe84e0f10b4c03f6f311d22607c46597af22"}
May 28 16:14:00.872082 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:00.871728    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-sptlh"
May 28 16:14:00.873041 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:00.873019    2556 generic.go:358] "Generic (PLEG): container finished" podID="8d04322a-aff6-455d-a538-a567e82de0db" containerID="15040c5719abf2fb6d7e8fe4fbcd50c01a920292cf1a6fc3b25a2129bb65f385" exitCode=0
May 28 16:14:00.873149 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:00.873100    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7" event={"ID":"8d04322a-aff6-455d-a538-a567e82de0db","Type":"ContainerDied","Data":"15040c5719abf2fb6d7e8fe4fbcd50c01a920292cf1a6fc3b25a2129bb65f385"}
May 28 16:14:00.873149 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:00.873127    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7" event={"ID":"8d04322a-aff6-455d-a538-a567e82de0db","Type":"ContainerStarted","Data":"7ee64af24a283acde670081c3d48405fbdd08ff4e71ba4d6c6ddc7363a624647"}
May 28 16:14:00.893318 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:00.893273    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-sptlh" podStartSLOduration=2.338765847 podStartE2EDuration="5.893258912s" podCreationTimestamp="2026-05-28 16:13:55 +0000 UTC" firstStartedPulling="2026-05-28 16:13:56.437606685 +0000 UTC m=+382.446987266" lastFinishedPulling="2026-05-28 16:13:59.992099735 +0000 UTC m=+386.001480331" observedRunningTime="2026-05-28 16:14:00.892697372 +0000 UTC m=+386.902077978" watchObservedRunningTime="2026-05-28 16:14:00.893258912 +0000 UTC m=+386.902639512"
May 28 16:14:01.055463 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.055423    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx"]
May 28 16:14:01.058954 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.058937    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx"
May 28 16:14:01.066890 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.066871    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 28 16:14:01.067251 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.067232    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-2wmsr\""
May 28 16:14:01.067339 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.067259    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 28 16:14:01.082362 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.082338    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx"]
May 28 16:14:01.174747 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.174645    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9c36ef59-2e84-42cf-8bae-d0b816fc1767-operator-config\") pod \"servicemesh-operator3-55f49c5f94-b6zvx\" (UID: \"9c36ef59-2e84-42cf-8bae-d0b816fc1767\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx"
May 28 16:14:01.174747 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.174710    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj5vb\" (UniqueName: \"kubernetes.io/projected/9c36ef59-2e84-42cf-8bae-d0b816fc1767-kube-api-access-xj5vb\") pod \"servicemesh-operator3-55f49c5f94-b6zvx\" (UID: \"9c36ef59-2e84-42cf-8bae-d0b816fc1767\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx"
May 28 16:14:01.276041 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.276001    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xj5vb\" (UniqueName: \"kubernetes.io/projected/9c36ef59-2e84-42cf-8bae-d0b816fc1767-kube-api-access-xj5vb\") pod \"servicemesh-operator3-55f49c5f94-b6zvx\" (UID: \"9c36ef59-2e84-42cf-8bae-d0b816fc1767\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx"
May 28 16:14:01.276247 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.276112    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9c36ef59-2e84-42cf-8bae-d0b816fc1767-operator-config\") pod \"servicemesh-operator3-55f49c5f94-b6zvx\" (UID: \"9c36ef59-2e84-42cf-8bae-d0b816fc1767\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx"
May 28 16:14:01.278656 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.278630    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/9c36ef59-2e84-42cf-8bae-d0b816fc1767-operator-config\") pod \"servicemesh-operator3-55f49c5f94-b6zvx\" (UID: \"9c36ef59-2e84-42cf-8bae-d0b816fc1767\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx"
May 28 16:14:01.283914 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.283892    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj5vb\" (UniqueName: \"kubernetes.io/projected/9c36ef59-2e84-42cf-8bae-d0b816fc1767-kube-api-access-xj5vb\") pod \"servicemesh-operator3-55f49c5f94-b6zvx\" (UID: \"9c36ef59-2e84-42cf-8bae-d0b816fc1767\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx"
May 28 16:14:01.368011 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.367974    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx"
May 28 16:14:01.530099 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.530063    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx"]
May 28 16:14:01.564086 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:14:01.564044    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c36ef59_2e84_42cf_8bae_d0b816fc1767.slice/crio-3e23f132f734f66390bff21019b10938268297f07cea93bfd05ac67744a15a13 WatchSource:0}: Error finding container 3e23f132f734f66390bff21019b10938268297f07cea93bfd05ac67744a15a13: Status 404 returned error can't find the container with id 3e23f132f734f66390bff21019b10938268297f07cea93bfd05ac67744a15a13
May 28 16:14:01.878796 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.878759    2556 generic.go:358] "Generic (PLEG): container finished" podID="8d04322a-aff6-455d-a538-a567e82de0db" containerID="ff0941b0c8b390734a97240925b6de858bb623e4b0c7ed11241dec98bee17d39" exitCode=0
May 28 16:14:01.879218 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.878840    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7" event={"ID":"8d04322a-aff6-455d-a538-a567e82de0db","Type":"ContainerDied","Data":"ff0941b0c8b390734a97240925b6de858bb623e4b0c7ed11241dec98bee17d39"}
May 28 16:14:01.880248 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:01.880226    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx" event={"ID":"9c36ef59-2e84-42cf-8bae-d0b816fc1767","Type":"ContainerStarted","Data":"3e23f132f734f66390bff21019b10938268297f07cea93bfd05ac67744a15a13"}
May 28 16:14:02.890537 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:02.890501    2556 generic.go:358] "Generic (PLEG): container finished" podID="8d04322a-aff6-455d-a538-a567e82de0db" containerID="8128f86b832c074476c5a194a424f9d3b5dbdc1b9121dcc17aa1687d3980e151" exitCode=0
May 28 16:14:02.891070 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:02.890658    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7" event={"ID":"8d04322a-aff6-455d-a538-a567e82de0db","Type":"ContainerDied","Data":"8128f86b832c074476c5a194a424f9d3b5dbdc1b9121dcc17aa1687d3980e151"}
May 28 16:14:04.019952 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:04.019929    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"
May 28 16:14:04.100480 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:04.100456    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d04322a-aff6-455d-a538-a567e82de0db-util\") pod \"8d04322a-aff6-455d-a538-a567e82de0db\" (UID: \"8d04322a-aff6-455d-a538-a567e82de0db\") "
May 28 16:14:04.100623 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:04.100517    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv8wm\" (UniqueName: \"kubernetes.io/projected/8d04322a-aff6-455d-a538-a567e82de0db-kube-api-access-wv8wm\") pod \"8d04322a-aff6-455d-a538-a567e82de0db\" (UID: \"8d04322a-aff6-455d-a538-a567e82de0db\") "
May 28 16:14:04.100623 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:04.100542    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d04322a-aff6-455d-a538-a567e82de0db-bundle\") pod \"8d04322a-aff6-455d-a538-a567e82de0db\" (UID: \"8d04322a-aff6-455d-a538-a567e82de0db\") "
May 28 16:14:04.101447 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:04.101418    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d04322a-aff6-455d-a538-a567e82de0db-bundle" (OuterVolumeSpecName: "bundle") pod "8d04322a-aff6-455d-a538-a567e82de0db" (UID: "8d04322a-aff6-455d-a538-a567e82de0db"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:14:04.102592 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:04.102564    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d04322a-aff6-455d-a538-a567e82de0db-kube-api-access-wv8wm" (OuterVolumeSpecName: "kube-api-access-wv8wm") pod "8d04322a-aff6-455d-a538-a567e82de0db" (UID: "8d04322a-aff6-455d-a538-a567e82de0db"). InnerVolumeSpecName "kube-api-access-wv8wm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:14:04.106071 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:04.106040    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d04322a-aff6-455d-a538-a567e82de0db-util" (OuterVolumeSpecName: "util") pod "8d04322a-aff6-455d-a538-a567e82de0db" (UID: "8d04322a-aff6-455d-a538-a567e82de0db"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:14:04.201882 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:04.201814    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d04322a-aff6-455d-a538-a567e82de0db-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:14:04.201882 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:04.201837    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv8wm\" (UniqueName: \"kubernetes.io/projected/8d04322a-aff6-455d-a538-a567e82de0db-kube-api-access-wv8wm\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:14:04.201882 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:04.201850    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d04322a-aff6-455d-a538-a567e82de0db-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:14:04.899503 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:04.899473    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7"
May 28 16:14:04.899698 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:04.899474    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2h4l7" event={"ID":"8d04322a-aff6-455d-a538-a567e82de0db","Type":"ContainerDied","Data":"7ee64af24a283acde670081c3d48405fbdd08ff4e71ba4d6c6ddc7363a624647"}
May 28 16:14:04.899698 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:04.899578    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ee64af24a283acde670081c3d48405fbdd08ff4e71ba4d6c6ddc7363a624647"
May 28 16:14:06.908709 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:06.908661    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx" event={"ID":"9c36ef59-2e84-42cf-8bae-d0b816fc1767","Type":"ContainerStarted","Data":"c99bae73c9e49ffd2dca93936a914064b544c4b46f6868aa728b06968e824af6"}
May 28 16:14:06.909097 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:06.908797    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx"
May 28 16:14:06.931065 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:06.931023    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx" podStartSLOduration=0.930449494 podStartE2EDuration="5.93101032s" podCreationTimestamp="2026-05-28 16:14:01 +0000 UTC" firstStartedPulling="2026-05-28 16:14:01.566722942 +0000 UTC m=+387.576103526" lastFinishedPulling="2026-05-28 16:14:06.567283769 +0000 UTC m=+392.576664352" observedRunningTime="2026-05-28 16:14:06.929814648 +0000 UTC m=+392.939195250" watchObservedRunningTime="2026-05-28 16:14:06.93101032 +0000 UTC m=+392.940390922"
May 28 16:14:07.573785 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.573750    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"]
May 28 16:14:07.574136 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.574122    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d04322a-aff6-455d-a538-a567e82de0db" containerName="pull"
May 28 16:14:07.574136 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.574137    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d04322a-aff6-455d-a538-a567e82de0db" containerName="pull"
May 28 16:14:07.574265 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.574148    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d04322a-aff6-455d-a538-a567e82de0db" containerName="extract"
May 28 16:14:07.574265 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.574158    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d04322a-aff6-455d-a538-a567e82de0db" containerName="extract"
May 28 16:14:07.574265 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.574177    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d04322a-aff6-455d-a538-a567e82de0db" containerName="util"
May 28 16:14:07.574265 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.574182    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d04322a-aff6-455d-a538-a567e82de0db" containerName="util"
May 28 16:14:07.574265 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.574255    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8d04322a-aff6-455d-a538-a567e82de0db" containerName="extract"
May 28 16:14:07.577301 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.577282    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.579586 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.579563    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qchvk\""
May 28 16:14:07.579899 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.579883    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 28 16:14:07.579972 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.579924    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 28 16:14:07.579972 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.579940    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 28 16:14:07.579972 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.579946    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 28 16:14:07.587321 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.587280    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"]
May 28 16:14:07.639583 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.639547    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcb69123-fdd2-4770-a517-af777f9a03bc-istio-token\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.639583 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.639586    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fcb69123-fdd2-4770-a517-af777f9a03bc-cacerts\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.639798 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.639607    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcznh\" (UniqueName: \"kubernetes.io/projected/fcb69123-fdd2-4770-a517-af777f9a03bc-kube-api-access-hcznh\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.639798 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.639727    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fcb69123-fdd2-4770-a517-af777f9a03bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.639798 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.639785    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcb69123-fdd2-4770-a517-af777f9a03bc-local-certs\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.639934 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.639817    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fcb69123-fdd2-4770-a517-af777f9a03bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.639934 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.639837    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fcb69123-fdd2-4770-a517-af777f9a03bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.740605 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.740571    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fcb69123-fdd2-4770-a517-af777f9a03bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.740805 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.740626    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcb69123-fdd2-4770-a517-af777f9a03bc-local-certs\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.740805 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.740662    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fcb69123-fdd2-4770-a517-af777f9a03bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.740805 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.740722    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fcb69123-fdd2-4770-a517-af777f9a03bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.740805 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.740786    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcb69123-fdd2-4770-a517-af777f9a03bc-istio-token\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.741019 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.740822    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fcb69123-fdd2-4770-a517-af777f9a03bc-cacerts\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.741019 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.740848    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hcznh\" (UniqueName: \"kubernetes.io/projected/fcb69123-fdd2-4770-a517-af777f9a03bc-kube-api-access-hcznh\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.741435 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.741409    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fcb69123-fdd2-4770-a517-af777f9a03bc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.743099 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.743075    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcb69123-fdd2-4770-a517-af777f9a03bc-local-certs\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.743230 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.743212    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fcb69123-fdd2-4770-a517-af777f9a03bc-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.743456 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.743435    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fcb69123-fdd2-4770-a517-af777f9a03bc-cacerts\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.743498 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.743470    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fcb69123-fdd2-4770-a517-af777f9a03bc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.756190 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.756162    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcb69123-fdd2-4770-a517-af777f9a03bc-istio-token\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.756424 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.756405    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcznh\" (UniqueName: \"kubernetes.io/projected/fcb69123-fdd2-4770-a517-af777f9a03bc-kube-api-access-hcznh\") pod \"istiod-openshift-gateway-798958bb55-gjl89\" (UID: \"fcb69123-fdd2-4770-a517-af777f9a03bc\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:07.862473 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.862373    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-fblnw"
May 28 16:14:07.889179 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:07.889141    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:08.047788 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:08.047573    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"]
May 28 16:14:08.050163 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:14:08.050128    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb69123_fdd2_4770_a517_af777f9a03bc.slice/crio-10cbaaefa923735ac40a2e4797784a984d8f1db2e6963523e90b88c637e3715c WatchSource:0}: Error finding container 10cbaaefa923735ac40a2e4797784a984d8f1db2e6963523e90b88c637e3715c: Status 404 returned error can't find the container with id 10cbaaefa923735ac40a2e4797784a984d8f1db2e6963523e90b88c637e3715c
May 28 16:14:08.923102 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:08.923058    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89" event={"ID":"fcb69123-fdd2-4770-a517-af777f9a03bc","Type":"ContainerStarted","Data":"10cbaaefa923735ac40a2e4797784a984d8f1db2e6963523e90b88c637e3715c"}
May 28 16:14:10.600291 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:10.600241    2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 28 16:14:10.600564 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:10.600334    2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 28 16:14:10.932601 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:10.932566    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89" event={"ID":"fcb69123-fdd2-4770-a517-af777f9a03bc","Type":"ContainerStarted","Data":"77896b33b80e58b832c6ed13a1c480cb6e0fc07c1ab289ba02a98193a19a2403"}
May 28 16:14:10.932952 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:10.932662    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:10.959617 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:10.959556    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89" podStartSLOduration=1.4120165359999999 podStartE2EDuration="3.959538387s" podCreationTimestamp="2026-05-28 16:14:07 +0000 UTC" firstStartedPulling="2026-05-28 16:14:08.052414969 +0000 UTC m=+394.061795554" lastFinishedPulling="2026-05-28 16:14:10.599936817 +0000 UTC m=+396.609317405" observedRunningTime="2026-05-28 16:14:10.956365026 +0000 UTC m=+396.965745631" watchObservedRunningTime="2026-05-28 16:14:10.959538387 +0000 UTC m=+396.968918991"
May 28 16:14:11.939301 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:11.939276    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-gjl89"
May 28 16:14:17.919559 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:17.919530    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-b6zvx"
May 28 16:14:31.885634 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:14:31.885601    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-sptlh"
May 28 16:15:02.176915 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.176837    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"]
May 28 16:15:02.179468 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.179451    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"
May 28 16:15:02.181687 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.181641    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 16:15:02.181805 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.181719    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 16:15:02.182387 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.182370    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2lxkv\""
May 28 16:15:02.186870 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.186844    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"]
May 28 16:15:02.341827 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.341793    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6199777-2b4f-4fde-8e11-4f064b6b7167-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm\" (UID: \"b6199777-2b4f-4fde-8e11-4f064b6b7167\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"
May 28 16:15:02.341992 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.341839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94562\" (UniqueName: \"kubernetes.io/projected/b6199777-2b4f-4fde-8e11-4f064b6b7167-kube-api-access-94562\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm\" (UID: \"b6199777-2b4f-4fde-8e11-4f064b6b7167\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"
May 28 16:15:02.341992 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.341946    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6199777-2b4f-4fde-8e11-4f064b6b7167-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm\" (UID: \"b6199777-2b4f-4fde-8e11-4f064b6b7167\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"
May 28 16:15:02.442936 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.442848    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-94562\" (UniqueName: \"kubernetes.io/projected/b6199777-2b4f-4fde-8e11-4f064b6b7167-kube-api-access-94562\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm\" (UID: \"b6199777-2b4f-4fde-8e11-4f064b6b7167\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"
May 28 16:15:02.442936 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.442928    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6199777-2b4f-4fde-8e11-4f064b6b7167-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm\" (UID: \"b6199777-2b4f-4fde-8e11-4f064b6b7167\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"
May 28 16:15:02.443179 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.443023    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6199777-2b4f-4fde-8e11-4f064b6b7167-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm\" (UID: \"b6199777-2b4f-4fde-8e11-4f064b6b7167\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"
May 28 16:15:02.443297 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.443276    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6199777-2b4f-4fde-8e11-4f064b6b7167-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm\" (UID: \"b6199777-2b4f-4fde-8e11-4f064b6b7167\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"
May 28 16:15:02.443390 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.443372    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6199777-2b4f-4fde-8e11-4f064b6b7167-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm\" (UID: \"b6199777-2b4f-4fde-8e11-4f064b6b7167\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"
May 28 16:15:02.450797 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.450769    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94562\" (UniqueName: \"kubernetes.io/projected/b6199777-2b4f-4fde-8e11-4f064b6b7167-kube-api-access-94562\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm\" (UID: \"b6199777-2b4f-4fde-8e11-4f064b6b7167\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"
May 28 16:15:02.489594 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.489562    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"
May 28 16:15:02.580809 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.580779    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"]
May 28 16:15:02.589197 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.589175    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"
May 28 16:15:02.591370 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.591342    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"]
May 28 16:15:02.621899 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.621858    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"]
May 28 16:15:02.624100 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:15:02.624074    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6199777_2b4f_4fde_8e11_4f064b6b7167.slice/crio-3fb9bbc224b3911016fa824ef7f0f16a0ad6f65cf7a6a6e8975ed78b4052dd61 WatchSource:0}: Error finding container 3fb9bbc224b3911016fa824ef7f0f16a0ad6f65cf7a6a6e8975ed78b4052dd61: Status 404 returned error can't find the container with id 3fb9bbc224b3911016fa824ef7f0f16a0ad6f65cf7a6a6e8975ed78b4052dd61
May 28 16:15:02.746044 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.746010    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czvgq\" (UniqueName: \"kubernetes.io/projected/624a47c8-fa88-4ae1-8404-228401e9563b-kube-api-access-czvgq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d\" (UID: \"624a47c8-fa88-4ae1-8404-228401e9563b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"
May 28 16:15:02.746186 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.746107    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/624a47c8-fa88-4ae1-8404-228401e9563b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d\" (UID: \"624a47c8-fa88-4ae1-8404-228401e9563b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"
May 28 16:15:02.746228 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.746180    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/624a47c8-fa88-4ae1-8404-228401e9563b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d\" (UID: \"624a47c8-fa88-4ae1-8404-228401e9563b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"
May 28 16:15:02.847076 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.847041    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/624a47c8-fa88-4ae1-8404-228401e9563b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d\" (UID: \"624a47c8-fa88-4ae1-8404-228401e9563b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"
May 28 16:15:02.847237 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.847092    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-czvgq\" (UniqueName: \"kubernetes.io/projected/624a47c8-fa88-4ae1-8404-228401e9563b-kube-api-access-czvgq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d\" (UID: \"624a47c8-fa88-4ae1-8404-228401e9563b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"
May 28 16:15:02.847237 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.847150    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/624a47c8-fa88-4ae1-8404-228401e9563b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d\" (UID: \"624a47c8-fa88-4ae1-8404-228401e9563b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"
May 28 16:15:02.847432 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.847407    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/624a47c8-fa88-4ae1-8404-228401e9563b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d\" (UID: \"624a47c8-fa88-4ae1-8404-228401e9563b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"
May 28 16:15:02.847468 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.847442    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/624a47c8-fa88-4ae1-8404-228401e9563b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d\" (UID: \"624a47c8-fa88-4ae1-8404-228401e9563b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"
May 28 16:15:02.854942 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.854922    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czvgq\" (UniqueName: \"kubernetes.io/projected/624a47c8-fa88-4ae1-8404-228401e9563b-kube-api-access-czvgq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d\" (UID: \"624a47c8-fa88-4ae1-8404-228401e9563b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"
May 28 16:15:02.900935 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.900902    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"
May 28 16:15:02.994965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.994939    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"]
May 28 16:15:02.998823 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:02.998801    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"
May 28 16:15:03.007191 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.007165    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"]
May 28 16:15:03.030965 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.030943    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"]
May 28 16:15:03.032513 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:15:03.032492    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624a47c8_fa88_4ae1_8404_228401e9563b.slice/crio-7b741f930a8c0365afcfad6cc0b912ebd957fe49ff473bf2a90ca6facff53989 WatchSource:0}: Error finding container 7b741f930a8c0365afcfad6cc0b912ebd957fe49ff473bf2a90ca6facff53989: Status 404 returned error can't find the container with id 7b741f930a8c0365afcfad6cc0b912ebd957fe49ff473bf2a90ca6facff53989
May 28 16:15:03.121577 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.121543    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d" event={"ID":"624a47c8-fa88-4ae1-8404-228401e9563b","Type":"ContainerStarted","Data":"657bf0a1f56d30c9a10ec5a3d82873cd2ad9ea4c8f945ec3b9605097360a46af"}
May 28 16:15:03.121719 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.121586    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d" event={"ID":"624a47c8-fa88-4ae1-8404-228401e9563b","Type":"ContainerStarted","Data":"7b741f930a8c0365afcfad6cc0b912ebd957fe49ff473bf2a90ca6facff53989"}
May 28 16:15:03.123047 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.123025    2556 generic.go:358] "Generic (PLEG): container finished" podID="b6199777-2b4f-4fde-8e11-4f064b6b7167" containerID="049f141d761054920dc7250133abf7a0a2bb6a3d595aae9857098ec86455726c" exitCode=0
May 28 16:15:03.123151 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.123107    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm" event={"ID":"b6199777-2b4f-4fde-8e11-4f064b6b7167","Type":"ContainerDied","Data":"049f141d761054920dc7250133abf7a0a2bb6a3d595aae9857098ec86455726c"}
May 28 16:15:03.123151 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.123134    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm" event={"ID":"b6199777-2b4f-4fde-8e11-4f064b6b7167","Type":"ContainerStarted","Data":"3fb9bbc224b3911016fa824ef7f0f16a0ad6f65cf7a6a6e8975ed78b4052dd61"}
May 28 16:15:03.150800 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.150776    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5s8l\" (UniqueName: \"kubernetes.io/projected/33f2503c-a705-4e16-a257-7cc1aae6c1bb-kube-api-access-w5s8l\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l\" (UID: \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"
May 28 16:15:03.150914 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.150845    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33f2503c-a705-4e16-a257-7cc1aae6c1bb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l\" (UID: \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"
May 28 16:15:03.150971 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.150949    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33f2503c-a705-4e16-a257-7cc1aae6c1bb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l\" (UID: \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"
May 28 16:15:03.252462 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.252381    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33f2503c-a705-4e16-a257-7cc1aae6c1bb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l\" (UID: \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"
May 28 16:15:03.252462 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.252419    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33f2503c-a705-4e16-a257-7cc1aae6c1bb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l\" (UID: \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"
May 28 16:15:03.252978 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.252512    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5s8l\" (UniqueName: \"kubernetes.io/projected/33f2503c-a705-4e16-a257-7cc1aae6c1bb-kube-api-access-w5s8l\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l\" (UID: \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"
May 28 16:15:03.252978 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.252849    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33f2503c-a705-4e16-a257-7cc1aae6c1bb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l\" (UID: \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"
May 28 16:15:03.252978 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.252884    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33f2503c-a705-4e16-a257-7cc1aae6c1bb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l\" (UID: \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"
May 28 16:15:03.260647 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.260630    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5s8l\" (UniqueName: \"kubernetes.io/projected/33f2503c-a705-4e16-a257-7cc1aae6c1bb-kube-api-access-w5s8l\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l\" (UID: \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"
May 28 16:15:03.311199 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.311178    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"
May 28 16:15:03.378521 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.378494    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"]
May 28 16:15:03.382219 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.382197    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"
May 28 16:15:03.390473 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.390452    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"]
May 28 16:15:03.448131 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.448110    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"]
May 28 16:15:03.449410 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:15:03.449382    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f2503c_a705_4e16_a257_7cc1aae6c1bb.slice/crio-cb23eb3c11a6b1465d1fd4032e89d5f31597862edd17d8f6c11c78ca912e2ea4 WatchSource:0}: Error finding container cb23eb3c11a6b1465d1fd4032e89d5f31597862edd17d8f6c11c78ca912e2ea4: Status 404 returned error can't find the container with id cb23eb3c11a6b1465d1fd4032e89d5f31597862edd17d8f6c11c78ca912e2ea4
May 28 16:15:03.556149 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.556114    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca32ffd-6a55-4c8b-ab80-0a9979961081-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69\" (UID: \"cca32ffd-6a55-4c8b-ab80-0a9979961081\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"
May 28 16:15:03.556295 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.556152    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpmr6\" (UniqueName: \"kubernetes.io/projected/cca32ffd-6a55-4c8b-ab80-0a9979961081-kube-api-access-mpmr6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69\" (UID: \"cca32ffd-6a55-4c8b-ab80-0a9979961081\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"
May 28 16:15:03.556295 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.556205    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca32ffd-6a55-4c8b-ab80-0a9979961081-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69\" (UID: \"cca32ffd-6a55-4c8b-ab80-0a9979961081\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"
May 28 16:15:03.657005 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.656974    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca32ffd-6a55-4c8b-ab80-0a9979961081-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69\" (UID: \"cca32ffd-6a55-4c8b-ab80-0a9979961081\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"
May 28 16:15:03.657142 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.657010    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mpmr6\" (UniqueName: \"kubernetes.io/projected/cca32ffd-6a55-4c8b-ab80-0a9979961081-kube-api-access-mpmr6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69\" (UID: \"cca32ffd-6a55-4c8b-ab80-0a9979961081\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"
May 28 16:15:03.657142 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.657040    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca32ffd-6a55-4c8b-ab80-0a9979961081-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69\" (UID: \"cca32ffd-6a55-4c8b-ab80-0a9979961081\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"
May 28 16:15:03.657400 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.657376    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca32ffd-6a55-4c8b-ab80-0a9979961081-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69\" (UID: \"cca32ffd-6a55-4c8b-ab80-0a9979961081\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"
May 28 16:15:03.657464 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.657417    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca32ffd-6a55-4c8b-ab80-0a9979961081-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69\" (UID: \"cca32ffd-6a55-4c8b-ab80-0a9979961081\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"
May 28 16:15:03.665327 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.665305    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpmr6\" (UniqueName: \"kubernetes.io/projected/cca32ffd-6a55-4c8b-ab80-0a9979961081-kube-api-access-mpmr6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69\" (UID: \"cca32ffd-6a55-4c8b-ab80-0a9979961081\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"
May 28 16:15:03.692685 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.692650    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"
May 28 16:15:03.818630 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:03.818605    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"]
May 28 16:15:03.878290 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:15:03.878251    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca32ffd_6a55_4c8b_ab80_0a9979961081.slice/crio-be33be52d24a8a63cd3f6f0ac82b68a3dd073d0bacd43afe37966de97aa56366 WatchSource:0}: Error finding container be33be52d24a8a63cd3f6f0ac82b68a3dd073d0bacd43afe37966de97aa56366: Status 404 returned error can't find the container with id be33be52d24a8a63cd3f6f0ac82b68a3dd073d0bacd43afe37966de97aa56366
May 28 16:15:04.128243 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:04.128207    2556 generic.go:358] "Generic (PLEG): container finished" podID="33f2503c-a705-4e16-a257-7cc1aae6c1bb" containerID="899dd593da0c39151629ebbabeae3860733424a89fd69ce52a86983982d6b75f" exitCode=0
May 28 16:15:04.128383 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:04.128292    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l" event={"ID":"33f2503c-a705-4e16-a257-7cc1aae6c1bb","Type":"ContainerDied","Data":"899dd593da0c39151629ebbabeae3860733424a89fd69ce52a86983982d6b75f"}
May 28 16:15:04.128383 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:04.128332    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l" event={"ID":"33f2503c-a705-4e16-a257-7cc1aae6c1bb","Type":"ContainerStarted","Data":"cb23eb3c11a6b1465d1fd4032e89d5f31597862edd17d8f6c11c78ca912e2ea4"}
May 28 16:15:04.129775 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:04.129754    2556 generic.go:358] "Generic (PLEG): container finished" podID="624a47c8-fa88-4ae1-8404-228401e9563b" containerID="657bf0a1f56d30c9a10ec5a3d82873cd2ad9ea4c8f945ec3b9605097360a46af" exitCode=0
May 28 16:15:04.129854 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:04.129817    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d" event={"ID":"624a47c8-fa88-4ae1-8404-228401e9563b","Type":"ContainerDied","Data":"657bf0a1f56d30c9a10ec5a3d82873cd2ad9ea4c8f945ec3b9605097360a46af"}
May 28 16:15:04.131408 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:04.131385    2556 generic.go:358] "Generic (PLEG): container finished" podID="b6199777-2b4f-4fde-8e11-4f064b6b7167" containerID="60cf0aac98daabf37d49b7f64040e9df8e7f7b8aa572bf73fb40a88c9d711e42" exitCode=0
May 28 16:15:04.131513 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:04.131470    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm" event={"ID":"b6199777-2b4f-4fde-8e11-4f064b6b7167","Type":"ContainerDied","Data":"60cf0aac98daabf37d49b7f64040e9df8e7f7b8aa572bf73fb40a88c9d711e42"}
May 28 16:15:04.133028 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:04.133004    2556 generic.go:358] "Generic (PLEG): container finished" podID="cca32ffd-6a55-4c8b-ab80-0a9979961081" containerID="1428449a31428a6e370732d1813c83188eefcbbfee9e18b99d284a9e33c917b8" exitCode=0
May 28 16:15:04.133097 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:04.133031    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69" event={"ID":"cca32ffd-6a55-4c8b-ab80-0a9979961081","Type":"ContainerDied","Data":"1428449a31428a6e370732d1813c83188eefcbbfee9e18b99d284a9e33c917b8"}
May 28 16:15:04.133097 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:04.133047    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69" event={"ID":"cca32ffd-6a55-4c8b-ab80-0a9979961081","Type":"ContainerStarted","Data":"be33be52d24a8a63cd3f6f0ac82b68a3dd073d0bacd43afe37966de97aa56366"}
May 28 16:15:05.138540 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:05.138514    2556 generic.go:358] "Generic (PLEG): container finished" podID="cca32ffd-6a55-4c8b-ab80-0a9979961081" containerID="4e114a2dbfb68e10ab6f3b07329081f29bd2eafd39a8052653178e3773bc4e63" exitCode=0
May 28 16:15:05.138953 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:05.138577    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69" event={"ID":"cca32ffd-6a55-4c8b-ab80-0a9979961081","Type":"ContainerDied","Data":"4e114a2dbfb68e10ab6f3b07329081f29bd2eafd39a8052653178e3773bc4e63"}
May 28 16:15:05.140537 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:05.140513    2556 generic.go:358] "Generic (PLEG): container finished" podID="33f2503c-a705-4e16-a257-7cc1aae6c1bb" containerID="0b12fb54ca14cbf00e3e51175aa882416cecb37df0d23b6b42a5f9345617d1f7" exitCode=0
May 28 16:15:05.140634 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:05.140604    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l" event={"ID":"33f2503c-a705-4e16-a257-7cc1aae6c1bb","Type":"ContainerDied","Data":"0b12fb54ca14cbf00e3e51175aa882416cecb37df0d23b6b42a5f9345617d1f7"}
May 28 16:15:05.142483 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:05.142464    2556 generic.go:358] "Generic (PLEG): container finished" podID="624a47c8-fa88-4ae1-8404-228401e9563b" containerID="d19bc972e4ec23d67ab4e33c7ba43b3f48620b712f93abeb722da585c7fca188" exitCode=0
May 28 16:15:05.142570 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:05.142529    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d" event={"ID":"624a47c8-fa88-4ae1-8404-228401e9563b","Type":"ContainerDied","Data":"d19bc972e4ec23d67ab4e33c7ba43b3f48620b712f93abeb722da585c7fca188"}
May 28 16:15:05.148107 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:05.148084    2556 generic.go:358] "Generic (PLEG): container finished" podID="b6199777-2b4f-4fde-8e11-4f064b6b7167" containerID="0d110fd805bdc3f831e27d923047f3e8c4087db646314f0852ded4d2fa46f760" exitCode=0
May 28 16:15:05.148198 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:05.148161    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm" event={"ID":"b6199777-2b4f-4fde-8e11-4f064b6b7167","Type":"ContainerDied","Data":"0d110fd805bdc3f831e27d923047f3e8c4087db646314f0852ded4d2fa46f760"}
May 28 16:15:06.154428 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.154389    2556 generic.go:358] "Generic (PLEG): container finished" podID="cca32ffd-6a55-4c8b-ab80-0a9979961081" containerID="0a8adfc49c6f43a2802b1b7564b3def67cb59c82b046301e80cd9c2995b856b4" exitCode=0
May 28 16:15:06.154824 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.154473    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69" event={"ID":"cca32ffd-6a55-4c8b-ab80-0a9979961081","Type":"ContainerDied","Data":"0a8adfc49c6f43a2802b1b7564b3def67cb59c82b046301e80cd9c2995b856b4"}
May 28 16:15:06.156181 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.156163    2556 generic.go:358] "Generic (PLEG): container finished" podID="33f2503c-a705-4e16-a257-7cc1aae6c1bb" containerID="37fd917fbb2ee5dab06d4371852d1cfbaaa3c09a7cbf1ffac0d2afb63f24ea97" exitCode=0
May 28 16:15:06.156276 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.156256    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l" event={"ID":"33f2503c-a705-4e16-a257-7cc1aae6c1bb","Type":"ContainerDied","Data":"37fd917fbb2ee5dab06d4371852d1cfbaaa3c09a7cbf1ffac0d2afb63f24ea97"}
May 28 16:15:06.158053 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.158029    2556 generic.go:358] "Generic (PLEG): container finished" podID="624a47c8-fa88-4ae1-8404-228401e9563b" containerID="b47abbb004742b221224fa357d556c45327fa5e0ae0553a3263f4257529e580d" exitCode=0
May 28 16:15:06.158165 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.158110    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d" event={"ID":"624a47c8-fa88-4ae1-8404-228401e9563b","Type":"ContainerDied","Data":"b47abbb004742b221224fa357d556c45327fa5e0ae0553a3263f4257529e580d"}
May 28 16:15:06.300279 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.300255    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"
May 28 16:15:06.481019 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.480938    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94562\" (UniqueName: \"kubernetes.io/projected/b6199777-2b4f-4fde-8e11-4f064b6b7167-kube-api-access-94562\") pod \"b6199777-2b4f-4fde-8e11-4f064b6b7167\" (UID: \"b6199777-2b4f-4fde-8e11-4f064b6b7167\") "
May 28 16:15:06.481167 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.481114    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6199777-2b4f-4fde-8e11-4f064b6b7167-bundle\") pod \"b6199777-2b4f-4fde-8e11-4f064b6b7167\" (UID: \"b6199777-2b4f-4fde-8e11-4f064b6b7167\") "
May 28 16:15:06.481167 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.481134    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6199777-2b4f-4fde-8e11-4f064b6b7167-util\") pod \"b6199777-2b4f-4fde-8e11-4f064b6b7167\" (UID: \"b6199777-2b4f-4fde-8e11-4f064b6b7167\") "
May 28 16:15:06.481625 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.481598    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6199777-2b4f-4fde-8e11-4f064b6b7167-bundle" (OuterVolumeSpecName: "bundle") pod "b6199777-2b4f-4fde-8e11-4f064b6b7167" (UID: "b6199777-2b4f-4fde-8e11-4f064b6b7167"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:15:06.483087 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.483062    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6199777-2b4f-4fde-8e11-4f064b6b7167-kube-api-access-94562" (OuterVolumeSpecName: "kube-api-access-94562") pod "b6199777-2b4f-4fde-8e11-4f064b6b7167" (UID: "b6199777-2b4f-4fde-8e11-4f064b6b7167"). InnerVolumeSpecName "kube-api-access-94562". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:15:06.486344 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.486319    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6199777-2b4f-4fde-8e11-4f064b6b7167-util" (OuterVolumeSpecName: "util") pod "b6199777-2b4f-4fde-8e11-4f064b6b7167" (UID: "b6199777-2b4f-4fde-8e11-4f064b6b7167"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:15:06.582032 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.582005    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b6199777-2b4f-4fde-8e11-4f064b6b7167-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:06.582032 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.582029    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b6199777-2b4f-4fde-8e11-4f064b6b7167-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:06.582157 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:06.582039    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94562\" (UniqueName: \"kubernetes.io/projected/b6199777-2b4f-4fde-8e11-4f064b6b7167-kube-api-access-94562\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:07.164258 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.164226    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm"
May 28 16:15:07.164601 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.164255    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm" event={"ID":"b6199777-2b4f-4fde-8e11-4f064b6b7167","Type":"ContainerDied","Data":"3fb9bbc224b3911016fa824ef7f0f16a0ad6f65cf7a6a6e8975ed78b4052dd61"}
May 28 16:15:07.164601 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.164295    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fb9bbc224b3911016fa824ef7f0f16a0ad6f65cf7a6a6e8975ed78b4052dd61"
May 28 16:15:07.317173 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.317152    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"
May 28 16:15:07.359897 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.359873    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"
May 28 16:15:07.363148 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.363129    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"
May 28 16:15:07.493349 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.493283    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca32ffd-6a55-4c8b-ab80-0a9979961081-util\") pod \"cca32ffd-6a55-4c8b-ab80-0a9979961081\" (UID: \"cca32ffd-6a55-4c8b-ab80-0a9979961081\") "
May 28 16:15:07.493349 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.493313    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/624a47c8-fa88-4ae1-8404-228401e9563b-bundle\") pod \"624a47c8-fa88-4ae1-8404-228401e9563b\" (UID: \"624a47c8-fa88-4ae1-8404-228401e9563b\") "
May 28 16:15:07.493349 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.493341    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33f2503c-a705-4e16-a257-7cc1aae6c1bb-util\") pod \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\" (UID: \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\") "
May 28 16:15:07.493590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.493375    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5s8l\" (UniqueName: \"kubernetes.io/projected/33f2503c-a705-4e16-a257-7cc1aae6c1bb-kube-api-access-w5s8l\") pod \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\" (UID: \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\") "
May 28 16:15:07.493590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.493407    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpmr6\" (UniqueName: \"kubernetes.io/projected/cca32ffd-6a55-4c8b-ab80-0a9979961081-kube-api-access-mpmr6\") pod \"cca32ffd-6a55-4c8b-ab80-0a9979961081\" (UID: \"cca32ffd-6a55-4c8b-ab80-0a9979961081\") "
May 28 16:15:07.493590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.493461    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czvgq\" (UniqueName: \"kubernetes.io/projected/624a47c8-fa88-4ae1-8404-228401e9563b-kube-api-access-czvgq\") pod \"624a47c8-fa88-4ae1-8404-228401e9563b\" (UID: \"624a47c8-fa88-4ae1-8404-228401e9563b\") "
May 28 16:15:07.493590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.493495    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca32ffd-6a55-4c8b-ab80-0a9979961081-bundle\") pod \"cca32ffd-6a55-4c8b-ab80-0a9979961081\" (UID: \"cca32ffd-6a55-4c8b-ab80-0a9979961081\") "
May 28 16:15:07.493590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.493526    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/624a47c8-fa88-4ae1-8404-228401e9563b-util\") pod \"624a47c8-fa88-4ae1-8404-228401e9563b\" (UID: \"624a47c8-fa88-4ae1-8404-228401e9563b\") "
May 28 16:15:07.493590 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.493549    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33f2503c-a705-4e16-a257-7cc1aae6c1bb-bundle\") pod \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\" (UID: \"33f2503c-a705-4e16-a257-7cc1aae6c1bb\") "
May 28 16:15:07.494331 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.494178    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cca32ffd-6a55-4c8b-ab80-0a9979961081-bundle" (OuterVolumeSpecName: "bundle") pod "cca32ffd-6a55-4c8b-ab80-0a9979961081" (UID: "cca32ffd-6a55-4c8b-ab80-0a9979961081"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:15:07.494544 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.494513    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f2503c-a705-4e16-a257-7cc1aae6c1bb-bundle" (OuterVolumeSpecName: "bundle") pod "33f2503c-a705-4e16-a257-7cc1aae6c1bb" (UID: "33f2503c-a705-4e16-a257-7cc1aae6c1bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:15:07.494894 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.494871    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/624a47c8-fa88-4ae1-8404-228401e9563b-bundle" (OuterVolumeSpecName: "bundle") pod "624a47c8-fa88-4ae1-8404-228401e9563b" (UID: "624a47c8-fa88-4ae1-8404-228401e9563b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:15:07.495890 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.495861    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33f2503c-a705-4e16-a257-7cc1aae6c1bb-kube-api-access-w5s8l" (OuterVolumeSpecName: "kube-api-access-w5s8l") pod "33f2503c-a705-4e16-a257-7cc1aae6c1bb" (UID: "33f2503c-a705-4e16-a257-7cc1aae6c1bb"). InnerVolumeSpecName "kube-api-access-w5s8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:15:07.495986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.495937    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cca32ffd-6a55-4c8b-ab80-0a9979961081-kube-api-access-mpmr6" (OuterVolumeSpecName: "kube-api-access-mpmr6") pod "cca32ffd-6a55-4c8b-ab80-0a9979961081" (UID: "cca32ffd-6a55-4c8b-ab80-0a9979961081"). InnerVolumeSpecName "kube-api-access-mpmr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:15:07.496626 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.496605    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/624a47c8-fa88-4ae1-8404-228401e9563b-kube-api-access-czvgq" (OuterVolumeSpecName: "kube-api-access-czvgq") pod "624a47c8-fa88-4ae1-8404-228401e9563b" (UID: "624a47c8-fa88-4ae1-8404-228401e9563b"). InnerVolumeSpecName "kube-api-access-czvgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:15:07.499969 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.499935    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f2503c-a705-4e16-a257-7cc1aae6c1bb-util" (OuterVolumeSpecName: "util") pod "33f2503c-a705-4e16-a257-7cc1aae6c1bb" (UID: "33f2503c-a705-4e16-a257-7cc1aae6c1bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:15:07.501815 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.501773    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/624a47c8-fa88-4ae1-8404-228401e9563b-util" (OuterVolumeSpecName: "util") pod "624a47c8-fa88-4ae1-8404-228401e9563b" (UID: "624a47c8-fa88-4ae1-8404-228401e9563b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:15:07.502134 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.502113    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cca32ffd-6a55-4c8b-ab80-0a9979961081-util" (OuterVolumeSpecName: "util") pod "cca32ffd-6a55-4c8b-ab80-0a9979961081" (UID: "cca32ffd-6a55-4c8b-ab80-0a9979961081"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:15:07.594549 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.594525    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5s8l\" (UniqueName: \"kubernetes.io/projected/33f2503c-a705-4e16-a257-7cc1aae6c1bb-kube-api-access-w5s8l\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:07.594549 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.594547    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpmr6\" (UniqueName: \"kubernetes.io/projected/cca32ffd-6a55-4c8b-ab80-0a9979961081-kube-api-access-mpmr6\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:07.594718 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.594562    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czvgq\" (UniqueName: \"kubernetes.io/projected/624a47c8-fa88-4ae1-8404-228401e9563b-kube-api-access-czvgq\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:07.594718 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.594574    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cca32ffd-6a55-4c8b-ab80-0a9979961081-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:07.594718 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.594588    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/624a47c8-fa88-4ae1-8404-228401e9563b-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:07.594718 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.594600    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33f2503c-a705-4e16-a257-7cc1aae6c1bb-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:07.594718 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.594612    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cca32ffd-6a55-4c8b-ab80-0a9979961081-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:07.594718 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.594625    2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/624a47c8-fa88-4ae1-8404-228401e9563b-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:07.594718 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:07.594639    2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33f2503c-a705-4e16-a257-7cc1aae6c1bb-util\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:08.170080 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:08.170038    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69" event={"ID":"cca32ffd-6a55-4c8b-ab80-0a9979961081","Type":"ContainerDied","Data":"be33be52d24a8a63cd3f6f0ac82b68a3dd073d0bacd43afe37966de97aa56366"}
May 28 16:15:08.170080 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:08.170071    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69"
May 28 16:15:08.170080 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:08.170082    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be33be52d24a8a63cd3f6f0ac82b68a3dd073d0bacd43afe37966de97aa56366"
May 28 16:15:08.171829 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:08.171807    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l" event={"ID":"33f2503c-a705-4e16-a257-7cc1aae6c1bb","Type":"ContainerDied","Data":"cb23eb3c11a6b1465d1fd4032e89d5f31597862edd17d8f6c11c78ca912e2ea4"}
May 28 16:15:08.171829 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:08.171831    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb23eb3c11a6b1465d1fd4032e89d5f31597862edd17d8f6c11c78ca912e2ea4"
May 28 16:15:08.172009 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:08.171813    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l"
May 28 16:15:08.173541 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:08.173521    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d" event={"ID":"624a47c8-fa88-4ae1-8404-228401e9563b","Type":"ContainerDied","Data":"7b741f930a8c0365afcfad6cc0b912ebd957fe49ff473bf2a90ca6facff53989"}
May 28 16:15:08.173541 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:08.173542    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b741f930a8c0365afcfad6cc0b912ebd957fe49ff473bf2a90ca6facff53989"
May 28 16:15:08.173690 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:08.173551    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d"
May 28 16:15:16.501130 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501094    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-g87qh"]
May 28 16:15:16.501494 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501478    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6199777-2b4f-4fde-8e11-4f064b6b7167" containerName="util"
May 28 16:15:16.501494 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501489    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6199777-2b4f-4fde-8e11-4f064b6b7167" containerName="util"
May 28 16:15:16.501557 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501499    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca32ffd-6a55-4c8b-ab80-0a9979961081" containerName="pull"
May 28 16:15:16.501557 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501505    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca32ffd-6a55-4c8b-ab80-0a9979961081" containerName="pull"
May 28 16:15:16.501557 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501513    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f2503c-a705-4e16-a257-7cc1aae6c1bb" containerName="extract"
May 28 16:15:16.501557 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501518    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f2503c-a705-4e16-a257-7cc1aae6c1bb" containerName="extract"
May 28 16:15:16.501557 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501527    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6199777-2b4f-4fde-8e11-4f064b6b7167" containerName="pull"
May 28 16:15:16.501557 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501532    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6199777-2b4f-4fde-8e11-4f064b6b7167" containerName="pull"
May 28 16:15:16.501557 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501537    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f2503c-a705-4e16-a257-7cc1aae6c1bb" containerName="pull"
May 28 16:15:16.501557 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501541    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f2503c-a705-4e16-a257-7cc1aae6c1bb" containerName="pull"
May 28 16:15:16.501557 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501547    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="624a47c8-fa88-4ae1-8404-228401e9563b" containerName="pull"
May 28 16:15:16.501557 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501553    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="624a47c8-fa88-4ae1-8404-228401e9563b" containerName="pull"
May 28 16:15:16.501557 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501560    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="624a47c8-fa88-4ae1-8404-228401e9563b" containerName="extract"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501565    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="624a47c8-fa88-4ae1-8404-228401e9563b" containerName="extract"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501574    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6199777-2b4f-4fde-8e11-4f064b6b7167" containerName="extract"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501579    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6199777-2b4f-4fde-8e11-4f064b6b7167" containerName="extract"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501588    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca32ffd-6a55-4c8b-ab80-0a9979961081" containerName="extract"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501593    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca32ffd-6a55-4c8b-ab80-0a9979961081" containerName="extract"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501600    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca32ffd-6a55-4c8b-ab80-0a9979961081" containerName="util"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501605    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca32ffd-6a55-4c8b-ab80-0a9979961081" containerName="util"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501621    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f2503c-a705-4e16-a257-7cc1aae6c1bb" containerName="util"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501634    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f2503c-a705-4e16-a257-7cc1aae6c1bb" containerName="util"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501642    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="624a47c8-fa88-4ae1-8404-228401e9563b" containerName="util"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501646    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="624a47c8-fa88-4ae1-8404-228401e9563b" containerName="util"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501716    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="33f2503c-a705-4e16-a257-7cc1aae6c1bb" containerName="extract"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501727    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6199777-2b4f-4fde-8e11-4f064b6b7167" containerName="extract"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501733    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="624a47c8-fa88-4ae1-8404-228401e9563b" containerName="extract"
May 28 16:15:16.501986 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.501740    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="cca32ffd-6a55-4c8b-ab80-0a9979961081" containerName="extract"
May 28 16:15:16.505069 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.505044    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-g87qh"
May 28 16:15:16.507478 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.507458    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 16:15:16.507578 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.507522    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 16:15:16.508246 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.508230    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-sc7fh\""
May 28 16:15:16.520824 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.520796    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-g87qh"]
May 28 16:15:16.664662 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.664606    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-594bd\" (UniqueName: \"kubernetes.io/projected/4cd579a8-7974-44ae-88ea-bbe356c18053-kube-api-access-594bd\") pod \"authorino-operator-657f44b778-g87qh\" (UID: \"4cd579a8-7974-44ae-88ea-bbe356c18053\") " pod="kuadrant-system/authorino-operator-657f44b778-g87qh"
May 28 16:15:16.766070 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.765987    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-594bd\" (UniqueName: \"kubernetes.io/projected/4cd579a8-7974-44ae-88ea-bbe356c18053-kube-api-access-594bd\") pod \"authorino-operator-657f44b778-g87qh\" (UID: \"4cd579a8-7974-44ae-88ea-bbe356c18053\") " pod="kuadrant-system/authorino-operator-657f44b778-g87qh"
May 28 16:15:16.773974 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.773952    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-594bd\" (UniqueName: \"kubernetes.io/projected/4cd579a8-7974-44ae-88ea-bbe356c18053-kube-api-access-594bd\") pod \"authorino-operator-657f44b778-g87qh\" (UID: \"4cd579a8-7974-44ae-88ea-bbe356c18053\") " pod="kuadrant-system/authorino-operator-657f44b778-g87qh"
May 28 16:15:16.815809 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.815762    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-g87qh"
May 28 16:15:16.949009 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:16.948982    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-g87qh"]
May 28 16:15:16.951290 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:15:16.951252    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd579a8_7974_44ae_88ea_bbe356c18053.slice/crio-16b8c86d7de4f68361bcb6cee93343678203fcca9e35bc119b0337a7aaa822e1 WatchSource:0}: Error finding container 16b8c86d7de4f68361bcb6cee93343678203fcca9e35bc119b0337a7aaa822e1: Status 404 returned error can't find the container with id 16b8c86d7de4f68361bcb6cee93343678203fcca9e35bc119b0337a7aaa822e1
May 28 16:15:17.212184 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:17.212151    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-g87qh" event={"ID":"4cd579a8-7974-44ae-88ea-bbe356c18053","Type":"ContainerStarted","Data":"16b8c86d7de4f68361bcb6cee93343678203fcca9e35bc119b0337a7aaa822e1"}
May 28 16:15:20.225607 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:20.225521    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-g87qh" event={"ID":"4cd579a8-7974-44ae-88ea-bbe356c18053","Type":"ContainerStarted","Data":"5c8e1379832127a4bf1b449105ee2bf2846b77f3662a1e2ce50437e9d1634634"}
May 28 16:15:20.225607 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:20.225575    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-g87qh"
May 28 16:15:20.252727 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:20.252658    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-g87qh" podStartSLOduration=1.26231095 podStartE2EDuration="4.252644435s" podCreationTimestamp="2026-05-28 16:15:16 +0000 UTC" firstStartedPulling="2026-05-28 16:15:16.953264465 +0000 UTC m=+462.962645046" lastFinishedPulling="2026-05-28 16:15:19.943597947 +0000 UTC m=+465.952978531" observedRunningTime="2026-05-28 16:15:20.248952317 +0000 UTC m=+466.258332920" watchObservedRunningTime="2026-05-28 16:15:20.252644435 +0000 UTC m=+466.262025038"
May 28 16:15:30.851790 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:30.851754    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-847974dd68-hkpjr"]
May 28 16:15:31.231041 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:31.231011    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-g87qh"
May 28 16:15:44.656999 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:44.656964    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4cdnq"]
May 28 16:15:44.662886 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:44.662866    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4cdnq"
May 28 16:15:44.665458 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:44.665435    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zmsv4\""
May 28 16:15:44.676226 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:44.676205    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4cdnq"]
May 28 16:15:44.816061 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:44.816013    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f5bc\" (UniqueName: \"kubernetes.io/projected/dcb76a37-f8a3-45ac-a3a7-d518523c74c5-kube-api-access-8f5bc\") pod \"limitador-operator-controller-manager-85c4996f8c-4cdnq\" (UID: \"dcb76a37-f8a3-45ac-a3a7-d518523c74c5\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4cdnq"
May 28 16:15:44.917207 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:44.917113    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8f5bc\" (UniqueName: \"kubernetes.io/projected/dcb76a37-f8a3-45ac-a3a7-d518523c74c5-kube-api-access-8f5bc\") pod \"limitador-operator-controller-manager-85c4996f8c-4cdnq\" (UID: \"dcb76a37-f8a3-45ac-a3a7-d518523c74c5\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4cdnq"
May 28 16:15:44.925937 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:44.925908    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f5bc\" (UniqueName: \"kubernetes.io/projected/dcb76a37-f8a3-45ac-a3a7-d518523c74c5-kube-api-access-8f5bc\") pod \"limitador-operator-controller-manager-85c4996f8c-4cdnq\" (UID: \"dcb76a37-f8a3-45ac-a3a7-d518523c74c5\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4cdnq"
May 28 16:15:44.974569 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:44.974532    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4cdnq"
May 28 16:15:45.110161 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:45.110134    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4cdnq"]
May 28 16:15:45.112091 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:15:45.112065    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcb76a37_f8a3_45ac_a3a7_d518523c74c5.slice/crio-f3c94de6a29a2c263c6ac7f5e00e92e20357cc3bc9678545aeceb03c75891a73 WatchSource:0}: Error finding container f3c94de6a29a2c263c6ac7f5e00e92e20357cc3bc9678545aeceb03c75891a73: Status 404 returned error can't find the container with id f3c94de6a29a2c263c6ac7f5e00e92e20357cc3bc9678545aeceb03c75891a73
May 28 16:15:45.324937 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:45.324855    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4cdnq" event={"ID":"dcb76a37-f8a3-45ac-a3a7-d518523c74c5","Type":"ContainerStarted","Data":"f3c94de6a29a2c263c6ac7f5e00e92e20357cc3bc9678545aeceb03c75891a73"}
May 28 16:15:47.336575 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:47.336537    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4cdnq" event={"ID":"dcb76a37-f8a3-45ac-a3a7-d518523c74c5","Type":"ContainerStarted","Data":"1ef4776cf5673beef275e3c0c0f2d945d4c3ad087c37a2ab1d1785d9f15dd4d5"}
May 28 16:15:47.337045 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:47.336630    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4cdnq"
May 28 16:15:47.353407 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:47.353361    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4cdnq" podStartSLOduration=1.6148502169999999 podStartE2EDuration="3.353349441s" podCreationTimestamp="2026-05-28 16:15:44 +0000 UTC" firstStartedPulling="2026-05-28 16:15:45.114131101 +0000 UTC m=+491.123511681" lastFinishedPulling="2026-05-28 16:15:46.852630321 +0000 UTC m=+492.862010905" observedRunningTime="2026-05-28 16:15:47.350932035 +0000 UTC m=+493.360312640" watchObservedRunningTime="2026-05-28 16:15:47.353349441 +0000 UTC m=+493.362730043"
May 28 16:15:55.873089 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:55.873023    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-847974dd68-hkpjr" podUID="e8a3674a-3042-4611-a088-d951bde892a9" containerName="console" containerID="cri-o://032464fb9955682f2c7d812f43fc892be893a5e3cad7aab5067d85a0cf2afe34" gracePeriod=15
May 28 16:15:56.111065 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.111045    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-847974dd68-hkpjr_e8a3674a-3042-4611-a088-d951bde892a9/console/0.log"
May 28 16:15:56.111169 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.111105    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:15:56.222722 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.222613    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-trusted-ca-bundle\") pod \"e8a3674a-3042-4611-a088-d951bde892a9\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") "
May 28 16:15:56.222722 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.222657    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmhtn\" (UniqueName: \"kubernetes.io/projected/e8a3674a-3042-4611-a088-d951bde892a9-kube-api-access-dmhtn\") pod \"e8a3674a-3042-4611-a088-d951bde892a9\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") "
May 28 16:15:56.222722 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.222708    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-oauth-serving-cert\") pod \"e8a3674a-3042-4611-a088-d951bde892a9\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") "
May 28 16:15:56.222997 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.222745    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-console-config\") pod \"e8a3674a-3042-4611-a088-d951bde892a9\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") "
May 28 16:15:56.222997 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.222764    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a3674a-3042-4611-a088-d951bde892a9-console-oauth-config\") pod \"e8a3674a-3042-4611-a088-d951bde892a9\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") "
May 28 16:15:56.222997 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.222807    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a3674a-3042-4611-a088-d951bde892a9-console-serving-cert\") pod \"e8a3674a-3042-4611-a088-d951bde892a9\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") "
May 28 16:15:56.222997 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.222840    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-service-ca\") pod \"e8a3674a-3042-4611-a088-d951bde892a9\" (UID: \"e8a3674a-3042-4611-a088-d951bde892a9\") "
May 28 16:15:56.223215 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.223114    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8a3674a-3042-4611-a088-d951bde892a9" (UID: "e8a3674a-3042-4611-a088-d951bde892a9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:15:56.223215 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.223144    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8a3674a-3042-4611-a088-d951bde892a9" (UID: "e8a3674a-3042-4611-a088-d951bde892a9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:15:56.223215 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.223174    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-console-config" (OuterVolumeSpecName: "console-config") pod "e8a3674a-3042-4611-a088-d951bde892a9" (UID: "e8a3674a-3042-4611-a088-d951bde892a9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:15:56.223443 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.223417    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8a3674a-3042-4611-a088-d951bde892a9" (UID: "e8a3674a-3042-4611-a088-d951bde892a9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:15:56.224880 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.224853    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8a3674a-3042-4611-a088-d951bde892a9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8a3674a-3042-4611-a088-d951bde892a9" (UID: "e8a3674a-3042-4611-a088-d951bde892a9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:15:56.225044 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.225009    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8a3674a-3042-4611-a088-d951bde892a9-kube-api-access-dmhtn" (OuterVolumeSpecName: "kube-api-access-dmhtn") pod "e8a3674a-3042-4611-a088-d951bde892a9" (UID: "e8a3674a-3042-4611-a088-d951bde892a9"). InnerVolumeSpecName "kube-api-access-dmhtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:15:56.225117 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.225036    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8a3674a-3042-4611-a088-d951bde892a9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8a3674a-3042-4611-a088-d951bde892a9" (UID: "e8a3674a-3042-4611-a088-d951bde892a9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:15:56.324101 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.324069    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmhtn\" (UniqueName: \"kubernetes.io/projected/e8a3674a-3042-4611-a088-d951bde892a9-kube-api-access-dmhtn\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:56.324101 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.324094    2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-oauth-serving-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:56.324101 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.324104    2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-console-config\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:56.324332 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.324114    2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8a3674a-3042-4611-a088-d951bde892a9-console-oauth-config\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:56.324332 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.324123    2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8a3674a-3042-4611-a088-d951bde892a9-console-serving-cert\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:56.324332 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.324131    2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-service-ca\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:56.324332 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.324141    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8a3674a-3042-4611-a088-d951bde892a9-trusted-ca-bundle\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:15:56.373854 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.373827    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-847974dd68-hkpjr_e8a3674a-3042-4611-a088-d951bde892a9/console/0.log"
May 28 16:15:56.374020 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.373866    2556 generic.go:358] "Generic (PLEG): container finished" podID="e8a3674a-3042-4611-a088-d951bde892a9" containerID="032464fb9955682f2c7d812f43fc892be893a5e3cad7aab5067d85a0cf2afe34" exitCode=2
May 28 16:15:56.374020 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.373895    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847974dd68-hkpjr" event={"ID":"e8a3674a-3042-4611-a088-d951bde892a9","Type":"ContainerDied","Data":"032464fb9955682f2c7d812f43fc892be893a5e3cad7aab5067d85a0cf2afe34"}
May 28 16:15:56.374020 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.373928    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847974dd68-hkpjr"
May 28 16:15:56.374020 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.373943    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847974dd68-hkpjr" event={"ID":"e8a3674a-3042-4611-a088-d951bde892a9","Type":"ContainerDied","Data":"59b52073ab7f1032037c7eed501235a8a4ccd721c317246f5a048d280f28569e"}
May 28 16:15:56.374020 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.373959    2556 scope.go:117] "RemoveContainer" containerID="032464fb9955682f2c7d812f43fc892be893a5e3cad7aab5067d85a0cf2afe34"
May 28 16:15:56.383681 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.383651    2556 scope.go:117] "RemoveContainer" containerID="032464fb9955682f2c7d812f43fc892be893a5e3cad7aab5067d85a0cf2afe34"
May 28 16:15:56.383941 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:15:56.383923    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"032464fb9955682f2c7d812f43fc892be893a5e3cad7aab5067d85a0cf2afe34\": container with ID starting with 032464fb9955682f2c7d812f43fc892be893a5e3cad7aab5067d85a0cf2afe34 not found: ID does not exist" containerID="032464fb9955682f2c7d812f43fc892be893a5e3cad7aab5067d85a0cf2afe34"
May 28 16:15:56.384001 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.383949    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"032464fb9955682f2c7d812f43fc892be893a5e3cad7aab5067d85a0cf2afe34"} err="failed to get container status \"032464fb9955682f2c7d812f43fc892be893a5e3cad7aab5067d85a0cf2afe34\": rpc error: code = NotFound desc = could not find container \"032464fb9955682f2c7d812f43fc892be893a5e3cad7aab5067d85a0cf2afe34\": container with ID starting with 032464fb9955682f2c7d812f43fc892be893a5e3cad7aab5067d85a0cf2afe34 not found: ID does not exist"
May 28 16:15:56.395095 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.395071    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-847974dd68-hkpjr"]
May 28 16:15:56.399124 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.399102    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-847974dd68-hkpjr"]
May 28 16:15:56.565565 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:56.565486    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8a3674a-3042-4611-a088-d951bde892a9" path="/var/lib/kubelet/pods/e8a3674a-3042-4611-a088-d951bde892a9/volumes"
May 28 16:15:58.342006 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:15:58.341978    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-4cdnq"
May 28 16:16:25.835222 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:25.835143    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-xbs5w"]
May 28 16:16:25.835618 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:25.835569    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8a3674a-3042-4611-a088-d951bde892a9" containerName="console"
May 28 16:16:25.835618 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:25.835583    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8a3674a-3042-4611-a088-d951bde892a9" containerName="console"
May 28 16:16:25.835752 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:25.835655    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="e8a3674a-3042-4611-a088-d951bde892a9" containerName="console"
May 28 16:16:25.838633 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:25.838615    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-xbs5w"
May 28 16:16:25.840809 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:25.840788    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kdsdw\""
May 28 16:16:25.844267 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:25.844234    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-xbs5w"]
May 28 16:16:25.993096 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:25.993058    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b8sh\" (UniqueName: \"kubernetes.io/projected/d14d4998-ae2c-4502-afce-8bfed524503c-kube-api-access-2b8sh\") pod \"authorino-7498df8756-xbs5w\" (UID: \"d14d4998-ae2c-4502-afce-8bfed524503c\") " pod="kuadrant-system/authorino-7498df8756-xbs5w"
May 28 16:16:26.094093 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:26.094011    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2b8sh\" (UniqueName: \"kubernetes.io/projected/d14d4998-ae2c-4502-afce-8bfed524503c-kube-api-access-2b8sh\") pod \"authorino-7498df8756-xbs5w\" (UID: \"d14d4998-ae2c-4502-afce-8bfed524503c\") " pod="kuadrant-system/authorino-7498df8756-xbs5w"
May 28 16:16:26.101112 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:26.101087    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b8sh\" (UniqueName: \"kubernetes.io/projected/d14d4998-ae2c-4502-afce-8bfed524503c-kube-api-access-2b8sh\") pod \"authorino-7498df8756-xbs5w\" (UID: \"d14d4998-ae2c-4502-afce-8bfed524503c\") " pod="kuadrant-system/authorino-7498df8756-xbs5w"
May 28 16:16:26.148886 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:26.148861    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-xbs5w"
May 28 16:16:26.281284 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:26.281260    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-xbs5w"]
May 28 16:16:26.492156 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:26.492124    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-xbs5w" event={"ID":"d14d4998-ae2c-4502-afce-8bfed524503c","Type":"ContainerStarted","Data":"7a5e3c7b5e2bad7025a18634f3db7b731481c538e8598d8d308d46c8c2ed5611"}
May 28 16:16:29.506329 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:29.506217    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-xbs5w" event={"ID":"d14d4998-ae2c-4502-afce-8bfed524503c","Type":"ContainerStarted","Data":"25a1d7047902ddc0b03adaee6b6252b55a657e3302595361adc955cb80f4ea66"}
May 28 16:16:29.522536 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:29.522474    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-xbs5w" podStartSLOduration=1.643918137 podStartE2EDuration="4.522458034s" podCreationTimestamp="2026-05-28 16:16:25 +0000 UTC" firstStartedPulling="2026-05-28 16:16:26.286540442 +0000 UTC m=+532.295921023" lastFinishedPulling="2026-05-28 16:16:29.165080336 +0000 UTC m=+535.174460920" observedRunningTime="2026-05-28 16:16:29.520970614 +0000 UTC m=+535.530351220" watchObservedRunningTime="2026-05-28 16:16:29.522458034 +0000 UTC m=+535.531838637"
May 28 16:16:57.199007 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.198960    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-xbs5w"]
May 28 16:16:57.199576 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.199219    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-xbs5w" podUID="d14d4998-ae2c-4502-afce-8bfed524503c" containerName="authorino" containerID="cri-o://25a1d7047902ddc0b03adaee6b6252b55a657e3302595361adc955cb80f4ea66" gracePeriod=30
May 28 16:16:57.443242 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.443218    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-xbs5w"
May 28 16:16:57.470071 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.469985    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b8sh\" (UniqueName: \"kubernetes.io/projected/d14d4998-ae2c-4502-afce-8bfed524503c-kube-api-access-2b8sh\") pod \"d14d4998-ae2c-4502-afce-8bfed524503c\" (UID: \"d14d4998-ae2c-4502-afce-8bfed524503c\") "
May 28 16:16:57.471997 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.471965    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d14d4998-ae2c-4502-afce-8bfed524503c-kube-api-access-2b8sh" (OuterVolumeSpecName: "kube-api-access-2b8sh") pod "d14d4998-ae2c-4502-afce-8bfed524503c" (UID: "d14d4998-ae2c-4502-afce-8bfed524503c"). InnerVolumeSpecName "kube-api-access-2b8sh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:16:57.570811 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.570779    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b8sh\" (UniqueName: \"kubernetes.io/projected/d14d4998-ae2c-4502-afce-8bfed524503c-kube-api-access-2b8sh\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:16:57.621461 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.621426    2556 generic.go:358] "Generic (PLEG): container finished" podID="d14d4998-ae2c-4502-afce-8bfed524503c" containerID="25a1d7047902ddc0b03adaee6b6252b55a657e3302595361adc955cb80f4ea66" exitCode=0
May 28 16:16:57.621660 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.621479    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-xbs5w"
May 28 16:16:57.621660 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.621506    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-xbs5w" event={"ID":"d14d4998-ae2c-4502-afce-8bfed524503c","Type":"ContainerDied","Data":"25a1d7047902ddc0b03adaee6b6252b55a657e3302595361adc955cb80f4ea66"}
May 28 16:16:57.621660 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.621541    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-xbs5w" event={"ID":"d14d4998-ae2c-4502-afce-8bfed524503c","Type":"ContainerDied","Data":"7a5e3c7b5e2bad7025a18634f3db7b731481c538e8598d8d308d46c8c2ed5611"}
May 28 16:16:57.621660 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.621560    2556 scope.go:117] "RemoveContainer" containerID="25a1d7047902ddc0b03adaee6b6252b55a657e3302595361adc955cb80f4ea66"
May 28 16:16:57.630231 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.630216    2556 scope.go:117] "RemoveContainer" containerID="25a1d7047902ddc0b03adaee6b6252b55a657e3302595361adc955cb80f4ea66"
May 28 16:16:57.630463 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:16:57.630444    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a1d7047902ddc0b03adaee6b6252b55a657e3302595361adc955cb80f4ea66\": container with ID starting with 25a1d7047902ddc0b03adaee6b6252b55a657e3302595361adc955cb80f4ea66 not found: ID does not exist" containerID="25a1d7047902ddc0b03adaee6b6252b55a657e3302595361adc955cb80f4ea66"
May 28 16:16:57.630533 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.630469    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a1d7047902ddc0b03adaee6b6252b55a657e3302595361adc955cb80f4ea66"} err="failed to get container status \"25a1d7047902ddc0b03adaee6b6252b55a657e3302595361adc955cb80f4ea66\": rpc error: code = NotFound desc = could not find container \"25a1d7047902ddc0b03adaee6b6252b55a657e3302595361adc955cb80f4ea66\": container with ID starting with 25a1d7047902ddc0b03adaee6b6252b55a657e3302595361adc955cb80f4ea66 not found: ID does not exist"
May 28 16:16:57.643148 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.643126    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-xbs5w"]
May 28 16:16:57.648120 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:57.648099    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-xbs5w"]
May 28 16:16:58.561799 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:16:58.561769    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d14d4998-ae2c-4502-afce-8bfed524503c" path="/var/lib/kubelet/pods/d14d4998-ae2c-4502-afce-8bfed524503c/volumes"
May 28 16:17:00.503974 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.503922    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c9d4859b-qqcvt"]
May 28 16:17:00.504492 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.504474    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d14d4998-ae2c-4502-afce-8bfed524503c" containerName="authorino"
May 28 16:17:00.504554 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.504497    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14d4998-ae2c-4502-afce-8bfed524503c" containerName="authorino"
May 28 16:17:00.504621 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.504607    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="d14d4998-ae2c-4502-afce-8bfed524503c" containerName="authorino"
May 28 16:17:00.509166 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.509139    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9d4859b-qqcvt"
May 28 16:17:00.511456 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.511434    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 16:17:00.511781 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.511666    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vw4fm\""
May 28 16:17:00.514155 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.514128    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c9d4859b-qqcvt"]
May 28 16:17:00.600038 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.600002    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h55c\" (UniqueName: \"kubernetes.io/projected/6a2103b7-bd66-4190-b218-a559084bacb6-kube-api-access-5h55c\") pod \"maas-controller-5c9d4859b-qqcvt\" (UID: \"6a2103b7-bd66-4190-b218-a559084bacb6\") " pod="opendatahub/maas-controller-5c9d4859b-qqcvt"
May 28 16:17:00.660318 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.660284    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cb96995d7-mjg26"]
May 28 16:17:00.663890 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.663871    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cb96995d7-mjg26"
May 28 16:17:00.669873 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.669845    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cb96995d7-mjg26"]
May 28 16:17:00.701501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.701464    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5h55c\" (UniqueName: \"kubernetes.io/projected/6a2103b7-bd66-4190-b218-a559084bacb6-kube-api-access-5h55c\") pod \"maas-controller-5c9d4859b-qqcvt\" (UID: \"6a2103b7-bd66-4190-b218-a559084bacb6\") " pod="opendatahub/maas-controller-5c9d4859b-qqcvt"
May 28 16:17:00.701683 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.701549    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl25r\" (UniqueName: \"kubernetes.io/projected/cc2495b6-348a-416d-bbfb-38794d0499c4-kube-api-access-nl25r\") pod \"maas-controller-6cb96995d7-mjg26\" (UID: \"cc2495b6-348a-416d-bbfb-38794d0499c4\") " pod="opendatahub/maas-controller-6cb96995d7-mjg26"
May 28 16:17:00.708933 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.708905    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h55c\" (UniqueName: \"kubernetes.io/projected/6a2103b7-bd66-4190-b218-a559084bacb6-kube-api-access-5h55c\") pod \"maas-controller-5c9d4859b-qqcvt\" (UID: \"6a2103b7-bd66-4190-b218-a559084bacb6\") " pod="opendatahub/maas-controller-5c9d4859b-qqcvt"
May 28 16:17:00.803048 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.802970    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nl25r\" (UniqueName: \"kubernetes.io/projected/cc2495b6-348a-416d-bbfb-38794d0499c4-kube-api-access-nl25r\") pod \"maas-controller-6cb96995d7-mjg26\" (UID: \"cc2495b6-348a-416d-bbfb-38794d0499c4\") " pod="opendatahub/maas-controller-6cb96995d7-mjg26"
May 28 16:17:00.810939 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.810913    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl25r\" (UniqueName: \"kubernetes.io/projected/cc2495b6-348a-416d-bbfb-38794d0499c4-kube-api-access-nl25r\") pod \"maas-controller-6cb96995d7-mjg26\" (UID: \"cc2495b6-348a-416d-bbfb-38794d0499c4\") " pod="opendatahub/maas-controller-6cb96995d7-mjg26"
May 28 16:17:00.822821 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.822799    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9d4859b-qqcvt"
May 28 16:17:00.953121 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.953095    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c9d4859b-qqcvt"]
May 28 16:17:00.954608 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:17:00.954581    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2103b7_bd66_4190_b218_a559084bacb6.slice/crio-0e872e0cc075c0aed324741edacdd358d00b9a7d1d19302e13220d518e5a4ad9 WatchSource:0}: Error finding container 0e872e0cc075c0aed324741edacdd358d00b9a7d1d19302e13220d518e5a4ad9: Status 404 returned error can't find the container with id 0e872e0cc075c0aed324741edacdd358d00b9a7d1d19302e13220d518e5a4ad9
May 28 16:17:00.978541 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:00.978518    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cb96995d7-mjg26"
May 28 16:17:01.104016 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:01.103991    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cb96995d7-mjg26"]
May 28 16:17:01.106109 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:17:01.106082    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2495b6_348a_416d_bbfb_38794d0499c4.slice/crio-c8f8ddfeeb0fa8d30695c4bd7592cff6ee2f21b2c06969cbc4f05f2fb9109f42 WatchSource:0}: Error finding container c8f8ddfeeb0fa8d30695c4bd7592cff6ee2f21b2c06969cbc4f05f2fb9109f42: Status 404 returned error can't find the container with id c8f8ddfeeb0fa8d30695c4bd7592cff6ee2f21b2c06969cbc4f05f2fb9109f42
May 28 16:17:01.643253 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:01.643215    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cb96995d7-mjg26" event={"ID":"cc2495b6-348a-416d-bbfb-38794d0499c4","Type":"ContainerStarted","Data":"c8f8ddfeeb0fa8d30695c4bd7592cff6ee2f21b2c06969cbc4f05f2fb9109f42"}
May 28 16:17:01.646044 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:01.646015    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9d4859b-qqcvt" event={"ID":"6a2103b7-bd66-4190-b218-a559084bacb6","Type":"ContainerStarted","Data":"0e872e0cc075c0aed324741edacdd358d00b9a7d1d19302e13220d518e5a4ad9"}
May 28 16:17:04.661700 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:04.661643    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cb96995d7-mjg26" event={"ID":"cc2495b6-348a-416d-bbfb-38794d0499c4","Type":"ContainerStarted","Data":"3715995313b1f26f3def74dac148fcd0d6881b0223fc58f8effc21f047dcfafc"}
May 28 16:17:04.662193 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:04.661813    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cb96995d7-mjg26"
May 28 16:17:04.663178 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:04.663154    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9d4859b-qqcvt" event={"ID":"6a2103b7-bd66-4190-b218-a559084bacb6","Type":"ContainerStarted","Data":"1dacfceefca59cbe7762a5da18c62e7a4617a3f4902ca3c36d5e74ec9333e747"}
May 28 16:17:04.663307 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:04.663242    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c9d4859b-qqcvt"
May 28 16:17:04.679082 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:04.679039    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6cb96995d7-mjg26" podStartSLOduration=1.973494828 podStartE2EDuration="4.679025821s" podCreationTimestamp="2026-05-28 16:17:00 +0000 UTC" firstStartedPulling="2026-05-28 16:17:01.107511934 +0000 UTC m=+567.116892514" lastFinishedPulling="2026-05-28 16:17:03.813042922 +0000 UTC m=+569.822423507" observedRunningTime="2026-05-28 16:17:04.676382396 +0000 UTC m=+570.685762999" watchObservedRunningTime="2026-05-28 16:17:04.679025821 +0000 UTC m=+570.688406424"
May 28 16:17:04.695170 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:04.695129    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5c9d4859b-qqcvt" podStartSLOduration=1.849092387 podStartE2EDuration="4.695117354s" podCreationTimestamp="2026-05-28 16:17:00 +0000 UTC" firstStartedPulling="2026-05-28 16:17:00.956043081 +0000 UTC m=+566.965423663" lastFinishedPulling="2026-05-28 16:17:03.802068045 +0000 UTC m=+569.811448630" observedRunningTime="2026-05-28 16:17:04.692585431 +0000 UTC m=+570.701966033" watchObservedRunningTime="2026-05-28 16:17:04.695117354 +0000 UTC m=+570.704497957"
May 28 16:17:15.672786 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:15.672748    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cb96995d7-mjg26"
May 28 16:17:15.673203 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:15.673113    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c9d4859b-qqcvt"
May 28 16:17:15.734210 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:15.734173    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c9d4859b-qqcvt"]
May 28 16:17:15.734442 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:15.734414    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5c9d4859b-qqcvt" podUID="6a2103b7-bd66-4190-b218-a559084bacb6" containerName="manager" containerID="cri-o://1dacfceefca59cbe7762a5da18c62e7a4617a3f4902ca3c36d5e74ec9333e747" gracePeriod=30
May 28 16:17:16.004495 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:16.004473    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9d4859b-qqcvt"
May 28 16:17:16.146979 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:16.146936    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5h55c\" (UniqueName: \"kubernetes.io/projected/6a2103b7-bd66-4190-b218-a559084bacb6-kube-api-access-5h55c\") pod \"6a2103b7-bd66-4190-b218-a559084bacb6\" (UID: \"6a2103b7-bd66-4190-b218-a559084bacb6\") "
May 28 16:17:16.149105 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:16.149078    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a2103b7-bd66-4190-b218-a559084bacb6-kube-api-access-5h55c" (OuterVolumeSpecName: "kube-api-access-5h55c") pod "6a2103b7-bd66-4190-b218-a559084bacb6" (UID: "6a2103b7-bd66-4190-b218-a559084bacb6"). InnerVolumeSpecName "kube-api-access-5h55c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:17:16.248319 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:16.248232    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5h55c\" (UniqueName: \"kubernetes.io/projected/6a2103b7-bd66-4190-b218-a559084bacb6-kube-api-access-5h55c\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:17:16.713539 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:16.713503    2556 generic.go:358] "Generic (PLEG): container finished" podID="6a2103b7-bd66-4190-b218-a559084bacb6" containerID="1dacfceefca59cbe7762a5da18c62e7a4617a3f4902ca3c36d5e74ec9333e747" exitCode=0
May 28 16:17:16.714028 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:16.713550    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9d4859b-qqcvt" event={"ID":"6a2103b7-bd66-4190-b218-a559084bacb6","Type":"ContainerDied","Data":"1dacfceefca59cbe7762a5da18c62e7a4617a3f4902ca3c36d5e74ec9333e747"}
May 28 16:17:16.714028 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:16.713570    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c9d4859b-qqcvt"
May 28 16:17:16.714028 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:16.713596    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c9d4859b-qqcvt" event={"ID":"6a2103b7-bd66-4190-b218-a559084bacb6","Type":"ContainerDied","Data":"0e872e0cc075c0aed324741edacdd358d00b9a7d1d19302e13220d518e5a4ad9"}
May 28 16:17:16.714028 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:16.713618    2556 scope.go:117] "RemoveContainer" containerID="1dacfceefca59cbe7762a5da18c62e7a4617a3f4902ca3c36d5e74ec9333e747"
May 28 16:17:16.722115 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:16.722103    2556 scope.go:117] "RemoveContainer" containerID="1dacfceefca59cbe7762a5da18c62e7a4617a3f4902ca3c36d5e74ec9333e747"
May 28 16:17:16.722367 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:17:16.722349    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dacfceefca59cbe7762a5da18c62e7a4617a3f4902ca3c36d5e74ec9333e747\": container with ID starting with 1dacfceefca59cbe7762a5da18c62e7a4617a3f4902ca3c36d5e74ec9333e747 not found: ID does not exist" containerID="1dacfceefca59cbe7762a5da18c62e7a4617a3f4902ca3c36d5e74ec9333e747"
May 28 16:17:16.722431 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:16.722378    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dacfceefca59cbe7762a5da18c62e7a4617a3f4902ca3c36d5e74ec9333e747"} err="failed to get container status \"1dacfceefca59cbe7762a5da18c62e7a4617a3f4902ca3c36d5e74ec9333e747\": rpc error: code = NotFound desc = could not find container \"1dacfceefca59cbe7762a5da18c62e7a4617a3f4902ca3c36d5e74ec9333e747\": container with ID starting with 1dacfceefca59cbe7762a5da18c62e7a4617a3f4902ca3c36d5e74ec9333e747 not found: ID does not exist"
May 28 16:17:16.730345 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:16.730327    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c9d4859b-qqcvt"]
May 28 16:17:16.732747 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:16.732720    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c9d4859b-qqcvt"]
May 28 16:17:18.560427 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:18.560391    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a2103b7-bd66-4190-b218-a559084bacb6" path="/var/lib/kubelet/pods/6a2103b7-bd66-4190-b218-a559084bacb6/volumes"
May 28 16:17:33.812573 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:33.812540    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-64cb5dc64b-pz2th"]
May 28 16:17:33.813056 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:33.812935    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a2103b7-bd66-4190-b218-a559084bacb6" containerName="manager"
May 28 16:17:33.813056 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:33.812949    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a2103b7-bd66-4190-b218-a559084bacb6" containerName="manager"
May 28 16:17:33.813056 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:33.813020    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="6a2103b7-bd66-4190-b218-a559084bacb6" containerName="manager"
May 28 16:17:33.815075 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:33.815049    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-64cb5dc64b-pz2th"
May 28 16:17:33.817895 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:33.817870    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 28 16:17:33.818004 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:33.817943    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ffzxh\""
May 28 16:17:33.825222 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:33.825195    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-64cb5dc64b-pz2th"]
May 28 16:17:33.907926 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:33.907894    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5549d43-c605-4a7c-af0e-a105bbb8e7d3-maas-api-tls\") pod \"maas-api-64cb5dc64b-pz2th\" (UID: \"d5549d43-c605-4a7c-af0e-a105bbb8e7d3\") " pod="opendatahub/maas-api-64cb5dc64b-pz2th"
May 28 16:17:33.908111 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:33.907946    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clkbn\" (UniqueName: \"kubernetes.io/projected/d5549d43-c605-4a7c-af0e-a105bbb8e7d3-kube-api-access-clkbn\") pod \"maas-api-64cb5dc64b-pz2th\" (UID: \"d5549d43-c605-4a7c-af0e-a105bbb8e7d3\") " pod="opendatahub/maas-api-64cb5dc64b-pz2th"
May 28 16:17:34.008506 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.008475    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5549d43-c605-4a7c-af0e-a105bbb8e7d3-maas-api-tls\") pod \"maas-api-64cb5dc64b-pz2th\" (UID: \"d5549d43-c605-4a7c-af0e-a105bbb8e7d3\") " pod="opendatahub/maas-api-64cb5dc64b-pz2th"
May 28 16:17:34.008710 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.008521    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clkbn\" (UniqueName: \"kubernetes.io/projected/d5549d43-c605-4a7c-af0e-a105bbb8e7d3-kube-api-access-clkbn\") pod \"maas-api-64cb5dc64b-pz2th\" (UID: \"d5549d43-c605-4a7c-af0e-a105bbb8e7d3\") " pod="opendatahub/maas-api-64cb5dc64b-pz2th"
May 28 16:17:34.008710 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:17:34.008638    2556 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 28 16:17:34.008817 ip-10-0-134-100 kubenswrapper[2556]: E0528 16:17:34.008742    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5549d43-c605-4a7c-af0e-a105bbb8e7d3-maas-api-tls podName:d5549d43-c605-4a7c-af0e-a105bbb8e7d3 nodeName:}" failed. No retries permitted until 2026-05-28 16:17:34.50872079 +0000 UTC m=+600.518101386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d5549d43-c605-4a7c-af0e-a105bbb8e7d3-maas-api-tls") pod "maas-api-64cb5dc64b-pz2th" (UID: "d5549d43-c605-4a7c-af0e-a105bbb8e7d3") : secret "maas-api-serving-cert" not found
May 28 16:17:34.018168 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.018139    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clkbn\" (UniqueName: \"kubernetes.io/projected/d5549d43-c605-4a7c-af0e-a105bbb8e7d3-kube-api-access-clkbn\") pod \"maas-api-64cb5dc64b-pz2th\" (UID: \"d5549d43-c605-4a7c-af0e-a105bbb8e7d3\") " pod="opendatahub/maas-api-64cb5dc64b-pz2th"
May 28 16:17:34.147735 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.147701    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-2mjc8"]
May 28 16:17:34.150596 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.150577    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-2mjc8"
May 28 16:17:34.152793 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.152772    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ptk2r\""
May 28 16:17:34.152878 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.152773    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 28 16:17:34.158443 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.158336    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-2mjc8"]
May 28 16:17:34.210686 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.210645    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnzrw\" (UniqueName: \"kubernetes.io/projected/fdb0dc76-4c08-411c-b01f-642046f857ca-kube-api-access-xnzrw\") pod \"payload-processing-58b6c8fdc7-2mjc8\" (UID: \"fdb0dc76-4c08-411c-b01f-642046f857ca\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-2mjc8"
May 28 16:17:34.311362 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.311325    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xnzrw\" (UniqueName: \"kubernetes.io/projected/fdb0dc76-4c08-411c-b01f-642046f857ca-kube-api-access-xnzrw\") pod \"payload-processing-58b6c8fdc7-2mjc8\" (UID: \"fdb0dc76-4c08-411c-b01f-642046f857ca\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-2mjc8"
May 28 16:17:34.319597 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.319563    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnzrw\" (UniqueName: \"kubernetes.io/projected/fdb0dc76-4c08-411c-b01f-642046f857ca-kube-api-access-xnzrw\") pod \"payload-processing-58b6c8fdc7-2mjc8\" (UID: \"fdb0dc76-4c08-411c-b01f-642046f857ca\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-2mjc8"
May 28 16:17:34.463990 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.463895    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ptk2r\""
May 28 16:17:34.469108 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.469078    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:17:34.469877 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.469851    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:17:34.475645 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.475621    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-2mjc8"
May 28 16:17:34.478464 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.478445    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:17:34.479482 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.479463    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:17:34.513262 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.513219    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5549d43-c605-4a7c-af0e-a105bbb8e7d3-maas-api-tls\") pod \"maas-api-64cb5dc64b-pz2th\" (UID: \"d5549d43-c605-4a7c-af0e-a105bbb8e7d3\") " pod="opendatahub/maas-api-64cb5dc64b-pz2th"
May 28 16:17:34.515614 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.515589    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5549d43-c605-4a7c-af0e-a105bbb8e7d3-maas-api-tls\") pod \"maas-api-64cb5dc64b-pz2th\" (UID: \"d5549d43-c605-4a7c-af0e-a105bbb8e7d3\") " pod="opendatahub/maas-api-64cb5dc64b-pz2th"
May 28 16:17:34.626597 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.626573    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-2mjc8"]
May 28 16:17:34.628561 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:17:34.628538    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb0dc76_4c08_411c_b01f_642046f857ca.slice/crio-849c4c7a076885f84018412ff28911db364a7d7984878e483dd11427dac000e0 WatchSource:0}: Error finding container 849c4c7a076885f84018412ff28911db364a7d7984878e483dd11427dac000e0: Status 404 returned error can't find the container with id 849c4c7a076885f84018412ff28911db364a7d7984878e483dd11427dac000e0
May 28 16:17:34.729518 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.729449    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ffzxh\""
May 28 16:17:34.738265 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.738242    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-64cb5dc64b-pz2th"
May 28 16:17:34.793433 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.793392    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-2mjc8" event={"ID":"fdb0dc76-4c08-411c-b01f-642046f857ca","Type":"ContainerStarted","Data":"849c4c7a076885f84018412ff28911db364a7d7984878e483dd11427dac000e0"}
May 28 16:17:34.867012 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:34.866985    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-64cb5dc64b-pz2th"]
May 28 16:17:34.869127 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:17:34.869101    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5549d43_c605_4a7c_af0e_a105bbb8e7d3.slice/crio-29138c83e4e860300b3d398ad9f1db3ee2587bd65071eb1d4b40222156de3707 WatchSource:0}: Error finding container 29138c83e4e860300b3d398ad9f1db3ee2587bd65071eb1d4b40222156de3707: Status 404 returned error can't find the container with id 29138c83e4e860300b3d398ad9f1db3ee2587bd65071eb1d4b40222156de3707
May 28 16:17:35.799749 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:35.799636    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-64cb5dc64b-pz2th" event={"ID":"d5549d43-c605-4a7c-af0e-a105bbb8e7d3","Type":"ContainerStarted","Data":"29138c83e4e860300b3d398ad9f1db3ee2587bd65071eb1d4b40222156de3707"}
May 28 16:17:36.345780 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:36.345760    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 28 16:17:36.805268 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:36.805235    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-64cb5dc64b-pz2th" event={"ID":"d5549d43-c605-4a7c-af0e-a105bbb8e7d3","Type":"ContainerStarted","Data":"5c35b529c457849d2158990f4c6ecbc54ee4f84455b52192f1efda1763d68580"}
May 28 16:17:36.805444 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:36.805307    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-64cb5dc64b-pz2th"
May 28 16:17:36.806739 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:36.806710    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-2mjc8" event={"ID":"fdb0dc76-4c08-411c-b01f-642046f857ca","Type":"ContainerStarted","Data":"b28a9f51990988666e67a44f6a976e0bd4f12910641280d66bc668416718e79f"}
May 28 16:17:36.806878 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:36.806864    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-2mjc8"
May 28 16:17:36.823191 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:36.823144    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-64cb5dc64b-pz2th" podStartSLOduration=2.348383457 podStartE2EDuration="3.823131484s" podCreationTimestamp="2026-05-28 16:17:33 +0000 UTC" firstStartedPulling="2026-05-28 16:17:34.870769478 +0000 UTC m=+600.880150059" lastFinishedPulling="2026-05-28 16:17:36.345517501 +0000 UTC m=+602.354898086" observedRunningTime="2026-05-28 16:17:36.821107841 +0000 UTC m=+602.830488490" watchObservedRunningTime="2026-05-28 16:17:36.823131484 +0000 UTC m=+602.832512087"
May 28 16:17:36.835468 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:36.835414    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-2mjc8" podStartSLOduration=1.122918853 podStartE2EDuration="2.835383497s" podCreationTimestamp="2026-05-28 16:17:34 +0000 UTC" firstStartedPulling="2026-05-28 16:17:34.630869009 +0000 UTC m=+600.640249590" lastFinishedPulling="2026-05-28 16:17:36.343333646 +0000 UTC m=+602.352714234" observedRunningTime="2026-05-28 16:17:36.834624139 +0000 UTC m=+602.844004744" watchObservedRunningTime="2026-05-28 16:17:36.835383497 +0000 UTC m=+602.844764102"
May 28 16:17:42.816355 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:42.816322    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-64cb5dc64b-pz2th"
May 28 16:17:47.812868 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:17:47.812837    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-2mjc8"
May 28 16:18:04.247368 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.247292    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"]
May 28 16:18:04.250645 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.250628    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.252857 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.252838    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 28 16:18:04.252973 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.252841    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fqmhw\""
May 28 16:18:04.252973 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.252909    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 28 16:18:04.253652 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.253639    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 28 16:18:04.258530 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.258511    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"]
May 28 16:18:04.374975 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.374944    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59a4d6f4-229d-41d8-9504-fe920f49cc24-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.375130 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.374982    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59a4d6f4-229d-41d8-9504-fe920f49cc24-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.375130 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.375069    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59a4d6f4-229d-41d8-9504-fe920f49cc24-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.375130 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.375113    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59a4d6f4-229d-41d8-9504-fe920f49cc24-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.375298 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.375220    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59a4d6f4-229d-41d8-9504-fe920f49cc24-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.375298 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.375257    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jdf2\" (UniqueName: \"kubernetes.io/projected/59a4d6f4-229d-41d8-9504-fe920f49cc24-kube-api-access-8jdf2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.476089 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.476064    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59a4d6f4-229d-41d8-9504-fe920f49cc24-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.476257 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.476113    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59a4d6f4-229d-41d8-9504-fe920f49cc24-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.476257 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.476133    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jdf2\" (UniqueName: \"kubernetes.io/projected/59a4d6f4-229d-41d8-9504-fe920f49cc24-kube-api-access-8jdf2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.476257 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.476163    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59a4d6f4-229d-41d8-9504-fe920f49cc24-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.476257 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.476184    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59a4d6f4-229d-41d8-9504-fe920f49cc24-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.476257 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.476227    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59a4d6f4-229d-41d8-9504-fe920f49cc24-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.476613 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.476591    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59a4d6f4-229d-41d8-9504-fe920f49cc24-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.476796 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.476637    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59a4d6f4-229d-41d8-9504-fe920f49cc24-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.476796 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.476664    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59a4d6f4-229d-41d8-9504-fe920f49cc24-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.478416 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.478396    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59a4d6f4-229d-41d8-9504-fe920f49cc24-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.478517 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.478501    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59a4d6f4-229d-41d8-9504-fe920f49cc24-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.483215 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.483190    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jdf2\" (UniqueName: \"kubernetes.io/projected/59a4d6f4-229d-41d8-9504-fe920f49cc24-kube-api-access-8jdf2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4\" (UID: \"59a4d6f4-229d-41d8-9504-fe920f49cc24\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.561689 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.561598    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:04.700328 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.700296    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"]
May 28 16:18:04.701025 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:18:04.700992    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59a4d6f4_229d_41d8_9504_fe920f49cc24.slice/crio-7a84f4ceb19526402053272dd2427bb43bb7473890e0daa504f6cd564ea14f8c WatchSource:0}: Error finding container 7a84f4ceb19526402053272dd2427bb43bb7473890e0daa504f6cd564ea14f8c: Status 404 returned error can't find the container with id 7a84f4ceb19526402053272dd2427bb43bb7473890e0daa504f6cd564ea14f8c
May 28 16:18:04.702786 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.702772    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 16:18:04.921884 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:04.921842    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4" event={"ID":"59a4d6f4-229d-41d8-9504-fe920f49cc24","Type":"ContainerStarted","Data":"7a84f4ceb19526402053272dd2427bb43bb7473890e0daa504f6cd564ea14f8c"}
May 28 16:18:10.954094 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:10.954046    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4" event={"ID":"59a4d6f4-229d-41d8-9504-fe920f49cc24","Type":"ContainerStarted","Data":"38c53e7635c2e4737aeb11875c7d4898d4e67cfa1331925072692cf6017cac0b"}
May 28 16:18:16.979692 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:16.979642    2556 generic.go:358] "Generic (PLEG): container finished" podID="59a4d6f4-229d-41d8-9504-fe920f49cc24" containerID="38c53e7635c2e4737aeb11875c7d4898d4e67cfa1331925072692cf6017cac0b" exitCode=0
May 28 16:18:16.980144 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:16.979725    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4" event={"ID":"59a4d6f4-229d-41d8-9504-fe920f49cc24","Type":"ContainerDied","Data":"38c53e7635c2e4737aeb11875c7d4898d4e67cfa1331925072692cf6017cac0b"}
May 28 16:18:18.989470 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:18.989438    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4" event={"ID":"59a4d6f4-229d-41d8-9504-fe920f49cc24","Type":"ContainerStarted","Data":"1e9e3f5aba68eb97e11774752c6e4105d2cafa20fac470e70dccaaae68aacc01"}
May 28 16:18:18.989906 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:18.989650    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:18:19.009201 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:19.009151    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4" podStartSLOduration=1.385961143 podStartE2EDuration="15.009134303s" podCreationTimestamp="2026-05-28 16:18:04 +0000 UTC" firstStartedPulling="2026-05-28 16:18:04.702899519 +0000 UTC m=+630.712280100" lastFinishedPulling="2026-05-28 16:18:18.326072664 +0000 UTC m=+644.335453260" observedRunningTime="2026-05-28 16:18:19.007371443 +0000 UTC m=+645.016752046" watchObservedRunningTime="2026-05-28 16:18:19.009134303 +0000 UTC m=+645.018514909"
May 28 16:18:30.008239 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:18:30.008207    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4"
May 28 16:19:32.049345 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:32.049306    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-544586fd6d-5cpsc"]
May 28 16:19:32.052180 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:32.052156    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-544586fd6d-5cpsc"
May 28 16:19:32.055008 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:32.054985    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 28 16:19:32.055144 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:32.055006    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kdsdw\""
May 28 16:19:32.058343 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:32.058319    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-544586fd6d-5cpsc"]
May 28 16:19:32.173269 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:32.173236    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9c0014c-717a-445a-9133-f9f6cb5cfe8c-tls-cert\") pod \"authorino-544586fd6d-5cpsc\" (UID: \"a9c0014c-717a-445a-9133-f9f6cb5cfe8c\") " pod="kuadrant-system/authorino-544586fd6d-5cpsc"
May 28 16:19:32.173455 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:32.173308    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlr9p\" (UniqueName: \"kubernetes.io/projected/a9c0014c-717a-445a-9133-f9f6cb5cfe8c-kube-api-access-hlr9p\") pod \"authorino-544586fd6d-5cpsc\" (UID: \"a9c0014c-717a-445a-9133-f9f6cb5cfe8c\") " pod="kuadrant-system/authorino-544586fd6d-5cpsc"
May 28 16:19:32.274561 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:32.274520    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hlr9p\" (UniqueName: \"kubernetes.io/projected/a9c0014c-717a-445a-9133-f9f6cb5cfe8c-kube-api-access-hlr9p\") pod \"authorino-544586fd6d-5cpsc\" (UID: \"a9c0014c-717a-445a-9133-f9f6cb5cfe8c\") " pod="kuadrant-system/authorino-544586fd6d-5cpsc"
May 28 16:19:32.274768 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:32.274602    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9c0014c-717a-445a-9133-f9f6cb5cfe8c-tls-cert\") pod \"authorino-544586fd6d-5cpsc\" (UID: \"a9c0014c-717a-445a-9133-f9f6cb5cfe8c\") " pod="kuadrant-system/authorino-544586fd6d-5cpsc"
May 28 16:19:32.277176 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:32.277144    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a9c0014c-717a-445a-9133-f9f6cb5cfe8c-tls-cert\") pod \"authorino-544586fd6d-5cpsc\" (UID: \"a9c0014c-717a-445a-9133-f9f6cb5cfe8c\") " pod="kuadrant-system/authorino-544586fd6d-5cpsc"
May 28 16:19:32.281761 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:32.281738    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlr9p\" (UniqueName: \"kubernetes.io/projected/a9c0014c-717a-445a-9133-f9f6cb5cfe8c-kube-api-access-hlr9p\") pod \"authorino-544586fd6d-5cpsc\" (UID: \"a9c0014c-717a-445a-9133-f9f6cb5cfe8c\") " pod="kuadrant-system/authorino-544586fd6d-5cpsc"
May 28 16:19:32.363098 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:32.363014    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-544586fd6d-5cpsc"
May 28 16:19:32.495228 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:32.495203    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-544586fd6d-5cpsc"]
May 28 16:19:32.497249 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:19:32.497218    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9c0014c_717a_445a_9133_f9f6cb5cfe8c.slice/crio-f70339486ce49650022b115f2d5e8af453fb3b5b4f3fb0b5c2820bd5890f3762 WatchSource:0}: Error finding container f70339486ce49650022b115f2d5e8af453fb3b5b4f3fb0b5c2820bd5890f3762: Status 404 returned error can't find the container with id f70339486ce49650022b115f2d5e8af453fb3b5b4f3fb0b5c2820bd5890f3762
May 28 16:19:33.299366 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:33.299285    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-544586fd6d-5cpsc" event={"ID":"a9c0014c-717a-445a-9133-f9f6cb5cfe8c","Type":"ContainerStarted","Data":"71a71ed0abffa65b2527a3016eac6fa8a8df97981aa609679ae724356cd0d943"}
May 28 16:19:33.299366 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:33.299322    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-544586fd6d-5cpsc" event={"ID":"a9c0014c-717a-445a-9133-f9f6cb5cfe8c","Type":"ContainerStarted","Data":"f70339486ce49650022b115f2d5e8af453fb3b5b4f3fb0b5c2820bd5890f3762"}
May 28 16:19:33.316354 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:19:33.316296    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-544586fd6d-5cpsc" podStartSLOduration=0.942650499 podStartE2EDuration="1.316281158s" podCreationTimestamp="2026-05-28 16:19:32 +0000 UTC" firstStartedPulling="2026-05-28 16:19:32.498452495 +0000 UTC m=+718.507833080" lastFinishedPulling="2026-05-28 16:19:32.872083147 +0000 UTC m=+718.881463739" observedRunningTime="2026-05-28 16:19:33.3139475 +0000 UTC m=+719.323328108" watchObservedRunningTime="2026-05-28 16:19:33.316281158 +0000 UTC m=+719.325661800"
May 28 16:20:57.456077 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:57.455994    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cb96995d7-mjg26"]
May 28 16:20:57.456563 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:57.456261    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6cb96995d7-mjg26" podUID="cc2495b6-348a-416d-bbfb-38794d0499c4" containerName="manager" containerID="cri-o://3715995313b1f26f3def74dac148fcd0d6881b0223fc58f8effc21f047dcfafc" gracePeriod=30
May 28 16:20:57.643840 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:57.643809    2556 generic.go:358] "Generic (PLEG): container finished" podID="cc2495b6-348a-416d-bbfb-38794d0499c4" containerID="3715995313b1f26f3def74dac148fcd0d6881b0223fc58f8effc21f047dcfafc" exitCode=0
May 28 16:20:57.644027 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:57.643878    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cb96995d7-mjg26" event={"ID":"cc2495b6-348a-416d-bbfb-38794d0499c4","Type":"ContainerDied","Data":"3715995313b1f26f3def74dac148fcd0d6881b0223fc58f8effc21f047dcfafc"}
May 28 16:20:57.702341 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:57.702318    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cb96995d7-mjg26"
May 28 16:20:57.759289 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:57.759224    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl25r\" (UniqueName: \"kubernetes.io/projected/cc2495b6-348a-416d-bbfb-38794d0499c4-kube-api-access-nl25r\") pod \"cc2495b6-348a-416d-bbfb-38794d0499c4\" (UID: \"cc2495b6-348a-416d-bbfb-38794d0499c4\") "
May 28 16:20:57.761228 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:57.761199    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc2495b6-348a-416d-bbfb-38794d0499c4-kube-api-access-nl25r" (OuterVolumeSpecName: "kube-api-access-nl25r") pod "cc2495b6-348a-416d-bbfb-38794d0499c4" (UID: "cc2495b6-348a-416d-bbfb-38794d0499c4"). InnerVolumeSpecName "kube-api-access-nl25r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:20:57.860862 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:57.860830    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl25r\" (UniqueName: \"kubernetes.io/projected/cc2495b6-348a-416d-bbfb-38794d0499c4-kube-api-access-nl25r\") on node \"ip-10-0-134-100.ec2.internal\" DevicePath \"\""
May 28 16:20:58.648862 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:58.648821    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cb96995d7-mjg26" event={"ID":"cc2495b6-348a-416d-bbfb-38794d0499c4","Type":"ContainerDied","Data":"c8f8ddfeeb0fa8d30695c4bd7592cff6ee2f21b2c06969cbc4f05f2fb9109f42"}
May 28 16:20:58.649291 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:58.648881    2556 scope.go:117] "RemoveContainer" containerID="3715995313b1f26f3def74dac148fcd0d6881b0223fc58f8effc21f047dcfafc"
May 28 16:20:58.649291 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:58.648831    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cb96995d7-mjg26"
May 28 16:20:58.666367 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:58.666340    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6cb96995d7-mjg26"]
May 28 16:20:58.668798 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:58.668778    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6cb96995d7-mjg26"]
May 28 16:20:59.451644 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:59.451614    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cb96995d7-d89qg"]
May 28 16:20:59.452232 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:59.452205    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc2495b6-348a-416d-bbfb-38794d0499c4" containerName="manager"
May 28 16:20:59.452232 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:59.452229    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc2495b6-348a-416d-bbfb-38794d0499c4" containerName="manager"
May 28 16:20:59.452397 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:59.452296    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="cc2495b6-348a-416d-bbfb-38794d0499c4" containerName="manager"
May 28 16:20:59.454975 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:59.454958    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cb96995d7-d89qg"
May 28 16:20:59.456985 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:59.456968    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 16:20:59.457110 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:59.456970    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vw4fm\""
May 28 16:20:59.463417 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:59.463394    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cb96995d7-d89qg"]
May 28 16:20:59.575908 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:59.575884    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bblkc\" (UniqueName: \"kubernetes.io/projected/ca4792be-1e1a-4430-8a33-ec9abd4da6eb-kube-api-access-bblkc\") pod \"maas-controller-6cb96995d7-d89qg\" (UID: \"ca4792be-1e1a-4430-8a33-ec9abd4da6eb\") " pod="opendatahub/maas-controller-6cb96995d7-d89qg"
May 28 16:20:59.676823 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:59.676789    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bblkc\" (UniqueName: \"kubernetes.io/projected/ca4792be-1e1a-4430-8a33-ec9abd4da6eb-kube-api-access-bblkc\") pod \"maas-controller-6cb96995d7-d89qg\" (UID: \"ca4792be-1e1a-4430-8a33-ec9abd4da6eb\") " pod="opendatahub/maas-controller-6cb96995d7-d89qg"
May 28 16:20:59.684440 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:59.684413    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bblkc\" (UniqueName: \"kubernetes.io/projected/ca4792be-1e1a-4430-8a33-ec9abd4da6eb-kube-api-access-bblkc\") pod \"maas-controller-6cb96995d7-d89qg\" (UID: \"ca4792be-1e1a-4430-8a33-ec9abd4da6eb\") " pod="opendatahub/maas-controller-6cb96995d7-d89qg"
May 28 16:20:59.766216 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:59.766139    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cb96995d7-d89qg"
May 28 16:20:59.889221 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:20:59.889187    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cb96995d7-d89qg"]
May 28 16:20:59.890446 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:20:59.890421    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4792be_1e1a_4430_8a33_ec9abd4da6eb.slice/crio-15c231b968fe08b108a6144eac4078bca40a6455527b847dfbff7c8cc5e5aeab WatchSource:0}: Error finding container 15c231b968fe08b108a6144eac4078bca40a6455527b847dfbff7c8cc5e5aeab: Status 404 returned error can't find the container with id 15c231b968fe08b108a6144eac4078bca40a6455527b847dfbff7c8cc5e5aeab
May 28 16:21:00.560652 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:21:00.560614    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc2495b6-348a-416d-bbfb-38794d0499c4" path="/var/lib/kubelet/pods/cc2495b6-348a-416d-bbfb-38794d0499c4/volumes"
May 28 16:21:00.658710 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:21:00.658648    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cb96995d7-d89qg" event={"ID":"ca4792be-1e1a-4430-8a33-ec9abd4da6eb","Type":"ContainerStarted","Data":"6623581f5e3c1eacef14da2b069891272a2c134619286a5754d9f2d3812af4b0"}
May 28 16:21:00.658710 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:21:00.658712    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cb96995d7-d89qg" event={"ID":"ca4792be-1e1a-4430-8a33-ec9abd4da6eb","Type":"ContainerStarted","Data":"15c231b968fe08b108a6144eac4078bca40a6455527b847dfbff7c8cc5e5aeab"}
May 28 16:21:00.658934 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:21:00.658753    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cb96995d7-d89qg"
May 28 16:21:00.674612 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:21:00.674564    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6cb96995d7-d89qg" podStartSLOduration=1.223765233 podStartE2EDuration="1.674548763s" podCreationTimestamp="2026-05-28 16:20:59 +0000 UTC" firstStartedPulling="2026-05-28 16:20:59.891783319 +0000 UTC m=+805.901163901" lastFinishedPulling="2026-05-28 16:21:00.342566848 +0000 UTC m=+806.351947431" observedRunningTime="2026-05-28 16:21:00.671916364 +0000 UTC m=+806.681296967" watchObservedRunningTime="2026-05-28 16:21:00.674548763 +0000 UTC m=+806.683929368"
May 28 16:21:11.669132 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:21:11.669104    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cb96995d7-d89qg"
May 28 16:22:34.511524 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:22:34.511499    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:22:34.518201 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:22:34.518176    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:22:34.519743 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:22:34.519719    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:22:34.523188 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:22:34.523167    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:27:34.550531 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:27:34.550503    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:27:34.553450 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:27:34.553430    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:27:34.557418 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:27:34.557395    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:27:34.561133 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:27:34.561115    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:32:34.583492 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:32:34.583463    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:32:34.586319 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:32:34.586296    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:32:34.597354 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:32:34.597329    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:32:34.600523 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:32:34.600507    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:37:34.617286 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:37:34.617253    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:37:34.620251 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:37:34.620232    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:37:34.634134 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:37:34.634115    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:37:34.636843 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:37:34.636825    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:42:05.831092 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:05.831013    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-544586fd6d-5cpsc_a9c0014c-717a-445a-9133-f9f6cb5cfe8c/authorino/0.log"
May 28 16:42:10.567442 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:10.567413    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-sptlh_1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76/manager/0.log"
May 28 16:42:10.690186 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:10.690148    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-64cb5dc64b-pz2th_d5549d43-c605-4a7c-af0e-a105bbb8e7d3/maas-api/0.log"
May 28 16:42:10.934375 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:10.934342    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cb96995d7-d89qg_ca4792be-1e1a-4430-8a33-ec9abd4da6eb/manager/0.log"
May 28 16:42:11.057016 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:11.056984    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-fblnw_9c4ca407-2438-4b50-bc71-340a1b3801bb/manager/1.log"
May 28 16:42:11.426243 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:11.426217    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-95cfdd646-xnhlx_733c5827-40c7-4d43-98af-ca57290ae164/manager/0.log"
May 28 16:42:12.309523 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.309493    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d_624a47c8-fa88-4ae1-8404-228401e9563b/util/0.log"
May 28 16:42:12.315977 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.315952    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d_624a47c8-fa88-4ae1-8404-228401e9563b/pull/0.log"
May 28 16:42:12.321575 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.321555    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d_624a47c8-fa88-4ae1-8404-228401e9563b/extract/0.log"
May 28 16:42:12.433070 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.433045    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69_cca32ffd-6a55-4c8b-ab80-0a9979961081/util/0.log"
May 28 16:42:12.439007 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.438983    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69_cca32ffd-6a55-4c8b-ab80-0a9979961081/pull/0.log"
May 28 16:42:12.444737 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.444721    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69_cca32ffd-6a55-4c8b-ab80-0a9979961081/extract/0.log"
May 28 16:42:12.561367 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.561296    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l_33f2503c-a705-4e16-a257-7cc1aae6c1bb/util/0.log"
May 28 16:42:12.567569 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.567550    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l_33f2503c-a705-4e16-a257-7cc1aae6c1bb/pull/0.log"
May 28 16:42:12.573473 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.573455    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l_33f2503c-a705-4e16-a257-7cc1aae6c1bb/extract/0.log"
May 28 16:42:12.697902 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.697876    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm_b6199777-2b4f-4fde-8e11-4f064b6b7167/util/0.log"
May 28 16:42:12.703712 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.703666    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm_b6199777-2b4f-4fde-8e11-4f064b6b7167/pull/0.log"
May 28 16:42:12.709250 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.709234    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm_b6199777-2b4f-4fde-8e11-4f064b6b7167/extract/0.log"
May 28 16:42:12.830661 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.830595    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-544586fd6d-5cpsc_a9c0014c-717a-445a-9133-f9f6cb5cfe8c/authorino/0.log"
May 28 16:42:12.957292 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:12.957262    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-g87qh_4cd579a8-7974-44ae-88ea-bbe356c18053/manager/0.log"
May 28 16:42:13.716428 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:13.716401    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-4cdnq_dcb76a37-f8a3-45ac-a3a7-d518523c74c5/manager/0.log"
May 28 16:42:14.203084 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:14.203052    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-gjl89_fcb69123-fdd2-4770-a517-af777f9a03bc/discovery/0.log"
May 28 16:42:14.437841 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:14.437807    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6949b9c5f6-h6sw4_023c7ff7-6c2d-4411-93ac-da24693206a3/kube-auth-proxy/0.log"
May 28 16:42:14.691685 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:14.691635    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-2mjc8_fdb0dc76-4c08-411c-b01f-642046f857ca/payload-processing/0.log"
May 28 16:42:14.808834 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:14.808801    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-856d89658d-wfcxn_a8f87799-8eac-43d5-b7d2-488970f9c798/router/0.log"
May 28 16:42:15.564376 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:15.564347    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4_59a4d6f4-229d-41d8-9504-fe920f49cc24/storage-initializer/0.log"
May 28 16:42:15.571205 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:15.571178    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccn2rq4_59a4d6f4-229d-41d8-9504-fe920f49cc24/main/0.log"
May 28 16:42:22.689586 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:22.689555    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cgwbl_7c44d78c-1adc-4837-8b08-187acc745ae7/global-pull-secret-syncer/0.log"
May 28 16:42:22.881205 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:22.881174    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-glx8v_d327d37e-c1bb-49ce-bbed-0f16c6888fa0/konnectivity-agent/0.log"
May 28 16:42:22.957847 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:22.957772    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-100.ec2.internal_beb36003581f08eee5b4252c35cbfa45/haproxy/0.log"
May 28 16:42:26.941715 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:26.941666    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d_624a47c8-fa88-4ae1-8404-228401e9563b/extract/0.log"
May 28 16:42:26.960026 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:26.960003    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d_624a47c8-fa88-4ae1-8404-228401e9563b/util/0.log"
May 28 16:42:26.978504 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:26.978477    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vrm9d_624a47c8-fa88-4ae1-8404-228401e9563b/pull/0.log"
May 28 16:42:27.003488 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:27.003466    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69_cca32ffd-6a55-4c8b-ab80-0a9979961081/extract/0.log"
May 28 16:42:27.026376 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:27.026350    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69_cca32ffd-6a55-4c8b-ab80-0a9979961081/util/0.log"
May 28 16:42:27.047452 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:27.047429    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nvw69_cca32ffd-6a55-4c8b-ab80-0a9979961081/pull/0.log"
May 28 16:42:27.070462 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:27.070435    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l_33f2503c-a705-4e16-a257-7cc1aae6c1bb/extract/0.log"
May 28 16:42:27.087849 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:27.087814    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l_33f2503c-a705-4e16-a257-7cc1aae6c1bb/util/0.log"
May 28 16:42:27.108568 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:27.108543    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73kzw4l_33f2503c-a705-4e16-a257-7cc1aae6c1bb/pull/0.log"
May 28 16:42:27.133952 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:27.133925    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm_b6199777-2b4f-4fde-8e11-4f064b6b7167/extract/0.log"
May 28 16:42:27.163184 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:27.163157    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm_b6199777-2b4f-4fde-8e11-4f064b6b7167/util/0.log"
May 28 16:42:27.184727 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:27.184694    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef15dznm_b6199777-2b4f-4fde-8e11-4f064b6b7167/pull/0.log"
May 28 16:42:27.376208 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:27.376170    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-544586fd6d-5cpsc_a9c0014c-717a-445a-9133-f9f6cb5cfe8c/authorino/0.log"
May 28 16:42:27.400255 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:27.400231    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-g87qh_4cd579a8-7974-44ae-88ea-bbe356c18053/manager/0.log"
May 28 16:42:27.663755 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:27.663653    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-4cdnq_dcb76a37-f8a3-45ac-a3a7-d518523c74c5/manager/0.log"
May 28 16:42:29.030501 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.030476    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35043e24-0f16-4535-b768-6710f4d82d31/alertmanager/0.log"
May 28 16:42:29.053768 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.053737    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35043e24-0f16-4535-b768-6710f4d82d31/config-reloader/0.log"
May 28 16:42:29.074652 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.074624    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35043e24-0f16-4535-b768-6710f4d82d31/kube-rbac-proxy-web/0.log"
May 28 16:42:29.093325 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.093302    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35043e24-0f16-4535-b768-6710f4d82d31/kube-rbac-proxy/0.log"
May 28 16:42:29.112841 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.112815    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35043e24-0f16-4535-b768-6710f4d82d31/kube-rbac-proxy-metric/0.log"
May 28 16:42:29.131851 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.131827    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35043e24-0f16-4535-b768-6710f4d82d31/prom-label-proxy/0.log"
May 28 16:42:29.151098 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.151075    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_35043e24-0f16-4535-b768-6710f4d82d31/init-config-reloader/0.log"
May 28 16:42:29.183545 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.183523    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-t5299_d3d0e71d-f6bc-43ae-8058-99036cfa080a/cluster-monitoring-operator/0.log"
May 28 16:42:29.206046 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.206025    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-f6rpl_4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb/kube-state-metrics/0.log"
May 28 16:42:29.222123 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.222101    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-f6rpl_4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb/kube-rbac-proxy-main/0.log"
May 28 16:42:29.244567 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.244547    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-f6rpl_4583b4cf-aa79-42b0-a5f0-cebf3e9bc1bb/kube-rbac-proxy-self/0.log"
May 28 16:42:29.267462 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.267437    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-658fbd4858-zlwwn_b8ca5ed4-0800-4f86-8c6c-4d2045e21af8/metrics-server/0.log"
May 28 16:42:29.377558 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.377534    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r9dd6_deeda6be-4ce7-47d2-b8c4-7afcfe104c36/node-exporter/0.log"
May 28 16:42:29.394909 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.394887    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r9dd6_deeda6be-4ce7-47d2-b8c4-7afcfe104c36/kube-rbac-proxy/0.log"
May 28 16:42:29.413005 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.412980    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r9dd6_deeda6be-4ce7-47d2-b8c4-7afcfe104c36/init-textfile/0.log"
May 28 16:42:29.726119 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.726045    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-7nlb9_9655f758-5185-4968-8ab3-95f68684212a/prometheus-operator/0.log"
May 28 16:42:29.742076 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.742050    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-7nlb9_9655f758-5185-4968-8ab3-95f68684212a/kube-rbac-proxy/0.log"
May 28 16:42:29.761829 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:29.761807    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-rj7bl_a873deb5-30f8-4880-9d59-1ae75ff3d242/prometheus-operator-admission-webhook/0.log"
May 28 16:42:30.846368 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:30.846333    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"]
May 28 16:42:30.849861 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:30.849838    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:30.851907 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:30.851885    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ds4l8\"/\"openshift-service-ca.crt\""
May 28 16:42:30.852080 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:30.851927    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ds4l8\"/\"default-dockercfg-9xvg7\""
May 28 16:42:30.852783 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:30.852760    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ds4l8\"/\"kube-root-ca.crt\""
May 28 16:42:30.856334 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:30.856315    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"]
May 28 16:42:30.994459 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:30.994424    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-h825c_82f8d4e9-3580-470b-aad5-93ba5afa4984/networking-console-plugin/0.log"
May 28 16:42:30.998983 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:30.998959    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ea74674d-ceb3-432e-96e1-0d329af34c6e-proc\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:30.999132 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:30.999009    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ea74674d-ceb3-432e-96e1-0d329af34c6e-podres\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:30.999132 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:30.999033    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvrdk\" (UniqueName: \"kubernetes.io/projected/ea74674d-ceb3-432e-96e1-0d329af34c6e-kube-api-access-dvrdk\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:30.999132 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:30.999115    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea74674d-ceb3-432e-96e1-0d329af34c6e-lib-modules\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:30.999295 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:30.999196    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea74674d-ceb3-432e-96e1-0d329af34c6e-sys\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:31.100259 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.100174    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ea74674d-ceb3-432e-96e1-0d329af34c6e-proc\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:31.100259 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.100240    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ea74674d-ceb3-432e-96e1-0d329af34c6e-podres\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:31.100479 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.100266    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dvrdk\" (UniqueName: \"kubernetes.io/projected/ea74674d-ceb3-432e-96e1-0d329af34c6e-kube-api-access-dvrdk\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:31.100479 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.100308    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ea74674d-ceb3-432e-96e1-0d329af34c6e-proc\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:31.100479 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.100315    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea74674d-ceb3-432e-96e1-0d329af34c6e-lib-modules\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:31.100479 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.100408    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ea74674d-ceb3-432e-96e1-0d329af34c6e-podres\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:31.100479 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.100415    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea74674d-ceb3-432e-96e1-0d329af34c6e-lib-modules\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:31.100479 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.100429    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea74674d-ceb3-432e-96e1-0d329af34c6e-sys\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:31.100479 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.100471    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea74674d-ceb3-432e-96e1-0d329af34c6e-sys\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:31.107429 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.107403    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvrdk\" (UniqueName: \"kubernetes.io/projected/ea74674d-ceb3-432e-96e1-0d329af34c6e-kube-api-access-dvrdk\") pod \"perf-node-gather-daemonset-nw5pq\" (UID: \"ea74674d-ceb3-432e-96e1-0d329af34c6e\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:31.161729 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.161698    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:31.293055 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.293004    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"]
May 28 16:42:31.294499 ip-10-0-134-100 kubenswrapper[2556]: W0528 16:42:31.294472    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podea74674d_ceb3_432e_96e1_0d329af34c6e.slice/crio-c58674676578cf3b2a25086a3cd3457bd4cff67040f25f5e89b9e84bfb4f98cf WatchSource:0}: Error finding container c58674676578cf3b2a25086a3cd3457bd4cff67040f25f5e89b9e84bfb4f98cf: Status 404 returned error can't find the container with id c58674676578cf3b2a25086a3cd3457bd4cff67040f25f5e89b9e84bfb4f98cf
May 28 16:42:31.296117 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.296096    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 16:42:31.503012 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.502987    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:42:31.507877 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.507859    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/3.log"
May 28 16:42:31.855313 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.855224    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq" event={"ID":"ea74674d-ceb3-432e-96e1-0d329af34c6e","Type":"ContainerStarted","Data":"c2652def7ada9d9e85c8df9b9ae2cd602ee318fee4c93e3be2f98cde68c34fc7"}
May 28 16:42:31.855313 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.855261    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq" event={"ID":"ea74674d-ceb3-432e-96e1-0d329af34c6e","Type":"ContainerStarted","Data":"c58674676578cf3b2a25086a3cd3457bd4cff67040f25f5e89b9e84bfb4f98cf"}
May 28 16:42:31.855817 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.855318    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:31.869058 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.869015    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq" podStartSLOduration=1.869002153 podStartE2EDuration="1.869002153s" podCreationTimestamp="2026-05-28 16:42:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:42:31.86752693 +0000 UTC m=+2097.876907524" watchObservedRunningTime="2026-05-28 16:42:31.869002153 +0000 UTC m=+2097.878382756"
May 28 16:42:31.951588 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:31.951563    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-klknq_7af758c6-0d06-4c58-8df5-4d22adb32fa3/download-server/0.log"
May 28 16:42:32.453586 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:32.453556    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-fm7gk_1c5d206c-686d-4c75-976f-9e3605fea7c9/volume-data-source-validator/0.log"
May 28 16:42:33.152538 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:33.152509    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8vnhr_f0016d8a-4dbe-4f30-82c2-30508031581f/dns/0.log"
May 28 16:42:33.170753 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:33.170729    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8vnhr_f0016d8a-4dbe-4f30-82c2-30508031581f/kube-rbac-proxy/0.log"
May 28 16:42:33.312783 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:33.312760    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rp6qf_b03f6d14-4e8f-48cd-95ae-92ad1fda1692/dns-node-resolver/0.log"
May 28 16:42:33.816912 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:33.816882    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zk27v_7a61c0f7-38c8-4403-a285-28885c28bf6e/node-ca/0.log"
May 28 16:42:34.653246 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:34.653223    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-gjl89_fcb69123-fdd2-4770-a517-af777f9a03bc/discovery/0.log"
May 28 16:42:34.656603 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:34.656570    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:42:34.659723 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:34.659690    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:42:34.673543 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:34.673524    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-nf4ql_a8b391da-56e4-4ac4-b40a-39aef2e34b9a/console-operator/2.log"
May 28 16:42:34.676393 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:34.676374    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:42:34.690547 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:34.690527    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6949b9c5f6-h6sw4_023c7ff7-6c2d-4411-93ac-da24693206a3/kube-auth-proxy/0.log"
May 28 16:42:34.825536 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:34.825508    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-2mjc8_fdb0dc76-4c08-411c-b01f-642046f857ca/payload-processing/0.log"
May 28 16:42:34.842623 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:34.842597    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-856d89658d-wfcxn_a8f87799-8eac-43d5-b7d2-488970f9c798/router/0.log"
May 28 16:42:35.305345 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:35.305316    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c7b4h_a854eb33-ccd9-437b-beec-3a4a3bdbf9c1/serve-healthcheck-canary/0.log"
May 28 16:42:35.757921 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:35.757894    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-gq7tm_f4e434f4-b121-4fb0-898f-edc4eb1840e5/insights-operator/0.log"
May 28 16:42:35.758462 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:35.758445    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-gq7tm_f4e434f4-b121-4fb0-898f-edc4eb1840e5/insights-operator/1.log"
May 28 16:42:35.903214 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:35.903180    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m587s_87eaea8d-f1c6-4517-a859-4b5dc7c90e7d/kube-rbac-proxy/0.log"
May 28 16:42:35.921374 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:35.921355    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m587s_87eaea8d-f1c6-4517-a859-4b5dc7c90e7d/exporter/0.log"
May 28 16:42:35.939891 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:35.939868    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m587s_87eaea8d-f1c6-4517-a859-4b5dc7c90e7d/extractor/0.log"
May 28 16:42:37.678692 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:37.678646    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-sptlh_1b5443a0-f7ba-45eb-9a9d-fb791eb0ca76/manager/0.log"
May 28 16:42:37.708412 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:37.708372    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-64cb5dc64b-pz2th_d5549d43-c605-4a7c-af0e-a105bbb8e7d3/maas-api/0.log"
May 28 16:42:37.788439 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:37.788404    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cb96995d7-d89qg_ca4792be-1e1a-4430-8a33-ec9abd4da6eb/manager/0.log"
May 28 16:42:37.807822 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:37.807795    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-fblnw_9c4ca407-2438-4b50-bc71-340a1b3801bb/manager/0.log"
May 28 16:42:37.820800 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:37.820780    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-fblnw_9c4ca407-2438-4b50-bc71-340a1b3801bb/manager/1.log"
May 28 16:42:37.872067 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:37.872044    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-nw5pq"
May 28 16:42:37.904132 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:37.904109    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-95cfdd646-xnhlx_733c5827-40c7-4d43-98af-ca57290ae164/manager/0.log"
May 28 16:42:38.969019 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:38.968992    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-8h9pz_cac529a7-70f9-4537-a88a-800beb240e2d/openshift-lws-operator/0.log"
May 28 16:42:44.481760 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:44.481728    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbtzl_4639d4a1-39b6-4f80-8fef-f00a2e76635e/kube-multus-additional-cni-plugins/0.log"
May 28 16:42:44.500518 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:44.500490    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbtzl_4639d4a1-39b6-4f80-8fef-f00a2e76635e/egress-router-binary-copy/0.log"
May 28 16:42:44.520800 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:44.520782    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbtzl_4639d4a1-39b6-4f80-8fef-f00a2e76635e/cni-plugins/0.log"
May 28 16:42:44.538338 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:44.538319    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbtzl_4639d4a1-39b6-4f80-8fef-f00a2e76635e/bond-cni-plugin/0.log"
May 28 16:42:44.558936 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:44.558911    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbtzl_4639d4a1-39b6-4f80-8fef-f00a2e76635e/routeoverride-cni/0.log"
May 28 16:42:44.576168 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:44.576149    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbtzl_4639d4a1-39b6-4f80-8fef-f00a2e76635e/whereabouts-cni-bincopy/0.log"
May 28 16:42:44.593224 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:44.593205    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rbtzl_4639d4a1-39b6-4f80-8fef-f00a2e76635e/whereabouts-cni/0.log"
May 28 16:42:44.679660 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:44.679621    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s2wrk_6fce69c7-892d-4de8-88d5-b45473ca35d6/kube-multus/0.log"
May 28 16:42:44.738692 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:44.738599    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hkxh8_37b01b62-805e-4475-bdeb-48b56af1211b/network-metrics-daemon/0.log"
May 28 16:42:44.755811 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:44.755790    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hkxh8_37b01b62-805e-4475-bdeb-48b56af1211b/kube-rbac-proxy/0.log"
May 28 16:42:45.533301 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:45.533273    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-controller/0.log"
May 28 16:42:45.548913 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:45.548891    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/0.log"
May 28 16:42:45.558271 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:45.558253    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovn-acl-logging/1.log"
May 28 16:42:45.574239 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:45.574218    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/kube-rbac-proxy-node/0.log"
May 28 16:42:45.592060 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:45.592037    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/kube-rbac-proxy-ovn-metrics/0.log"
May 28 16:42:45.608873 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:45.608852    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/northd/0.log"
May 28 16:42:45.629572 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:45.629531    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/nbdb/0.log"
May 28 16:42:45.647745 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:45.647725    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/sbdb/0.log"
May 28 16:42:45.745224 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:45.745195    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-28pqt_694b5e5d-b14c-4c97-bd4a-d6d5d31ef1e7/ovnkube-controller/0.log"
May 28 16:42:47.425107 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:47.425076    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-d987z_c6150d23-7376-434d-a87e-93833ab4acf2/check-endpoints/0.log"
May 28 16:42:47.479355 ip-10-0-134-100 kubenswrapper[2556]: I0528 16:42:47.479332    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-4dnsf_ddd3a1ae-ac71-4312-8e01-cdd65f3cf383/network-check-target-container/0.log"