May 21 21:18:37.854791 ip-10-0-135-166 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 21 21:18:37.854803 ip-10-0-135-166 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 21 21:18:37.854811 ip-10-0-135-166 systemd[1]: kubelet.service: Failed with result 'resources'.
May 21 21:18:37.855049 ip-10-0-135-166 systemd[1]: Failed to start Kubernetes Kubelet.
May 21 21:18:48.070326 ip-10-0-135-166 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 21 21:18:48.070350 ip-10-0-135-166 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ea5392268e8743bda1968137763b2a4a --
May 21 21:21:14.208287 ip-10-0-135-166 systemd[1]: Starting Kubernetes Kubelet...
May 21 21:21:14.578307 ip-10-0-135-166 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 21:21:14.578307 ip-10-0-135-166 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 21:21:14.578307 ip-10-0-135-166 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 21:21:14.578307 ip-10-0-135-166 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 21:21:14.578307 ip-10-0-135-166 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 21:21:14.581094 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.580925    2576 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 21:21:14.586308 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586283    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 21:21:14.586308 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586305    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 21:21:14.586308 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586308    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 21:21:14.586308 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586312    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 21:21:14.586308 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586315    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586318    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586321    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586324    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586327    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586329    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586332    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586334    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586338    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586341    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586343    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586346    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586348    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586351    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586354    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586357    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586359    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586362    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586364    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586367    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 21:21:14.586524 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586370    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586373    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586376    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586378    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586381    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586383    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586386    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586395    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586398    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586401    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586403    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586406    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586409    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586411    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586414    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586417    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586419    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586422    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586425    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586427    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 21:21:14.587033 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586430    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586433    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586435    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586438    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586440    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586442    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586445    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586448    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586450    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586453    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586455    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586458    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586460    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586463    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586465    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586468    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586470    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586473    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586475    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586478    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 21:21:14.587556 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586480    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586487    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586490    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586493    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586502    2576 feature_gate.go:328] unrecognized feature gate: Example
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586506    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586508    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586511    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586514    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586516    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586519    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586521    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586524    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586527    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586531    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586535    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586540    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586543    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586546    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 21:21:14.588057 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586548    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586553    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586557    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586955    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586959    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586963    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586966    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586969    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586972    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586975    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.586996    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587000    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587003    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587022    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587026    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587030    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587033    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587036    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587039    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 21:21:14.588519 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587042    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587045    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587048    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587051    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587053    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587056    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587060    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587062    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587065    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587068    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587071    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587073    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587075    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587078    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587080    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587083    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587086    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587088    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587090    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587093    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 21:21:14.588989 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587095    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587098    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587101    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587103    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587106    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587109    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587111    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587114    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587117    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587120    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587122    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587126    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587129    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587132    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587135    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587138    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587141    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587143    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587146    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587149    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 21:21:14.589496 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587151    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587154    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587157    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587159    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587163    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587165    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587167    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587170    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587172    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587175    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587177    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587180    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587182    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587185    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587188    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587190    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587193    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587195    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587197    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 21:21:14.589995 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587201    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587203    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587206    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587208    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587211    2576 feature_gate.go:328] unrecognized feature gate: Example
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587213    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587215    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587218    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587220    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587223    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.587226    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588329    2576 flags.go:64] FLAG: --address="0.0.0.0"
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588339    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588347    2576 flags.go:64] FLAG: --anonymous-auth="true"
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588352    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588357    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588360    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588365    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588369    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588372    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588375    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 21:21:14.590485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588379    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588382    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588385    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588388    2576 flags.go:64] FLAG: --cgroup-root=""
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588391    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588395    2576 flags.go:64] FLAG: --client-ca-file=""
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588398    2576 flags.go:64] FLAG: --cloud-config=""
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588401    2576 flags.go:64] FLAG: --cloud-provider="external"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588404    2576 flags.go:64] FLAG: --cluster-dns="[]"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588408    2576 flags.go:64] FLAG: --cluster-domain=""
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588411    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588415    2576 flags.go:64] FLAG: --config-dir=""
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588418    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588421    2576 flags.go:64] FLAG: --container-log-max-files="5"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588425    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588428    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588432    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588435    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588438    2576 flags.go:64] FLAG: --contention-profiling="false"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588441    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588444    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588447    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588450    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588454    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588457    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 21:21:14.591003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588460    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588463    2576 flags.go:64] FLAG: --enable-load-reader="false"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588467    2576 flags.go:64] FLAG: --enable-server="true"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588470    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588476    2576 flags.go:64] FLAG: --event-burst="100"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588479    2576 flags.go:64] FLAG: --event-qps="50"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588482    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588485    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588488    2576 flags.go:64] FLAG: --eviction-hard=""
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588492    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588494    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588498    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588501    2576 flags.go:64] FLAG: --eviction-soft=""
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588504    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588507    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588510    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588513    2576 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588516    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588520    2576 flags.go:64] FLAG: --fail-swap-on="true"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588523    2576 flags.go:64] FLAG: --feature-gates=""
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588528    2576 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588531    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588535    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588538    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588541    2576 flags.go:64] FLAG: --healthz-port="10248"
May 21 21:21:14.591633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588544    2576 flags.go:64] FLAG: --help="false"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588547    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-135-166.ec2.internal"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588550    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588553    2576 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588556    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588559    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588563    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588566    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588568    2576 flags.go:64] FLAG: --image-service-endpoint=""
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588571    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588575    2576 flags.go:64] FLAG: --kube-api-burst="100"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588578    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588581    2576 flags.go:64] FLAG: --kube-api-qps="50"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588584    2576 flags.go:64] FLAG: --kube-reserved=""
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588587    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588590    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588593    2576 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588596    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588598    2576 flags.go:64] FLAG: --lock-file=""
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588602    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588605    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588608    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588613    2576 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 21:21:14.592272 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588616    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588619    2576 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588622    2576 flags.go:64] FLAG: --logging-format="text"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588624    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588628    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588631    2576 flags.go:64] FLAG: --manifest-url=""
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588634    2576 flags.go:64] FLAG: --manifest-url-header=""
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588638    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588641    2576 flags.go:64] FLAG: --max-open-files="1000000"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588645    2576 flags.go:64] FLAG: --max-pods="110"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588648    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588651    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588654    2576 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588656    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588660    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588662    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588666    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588674    2576 flags.go:64] FLAG: --node-status-max-images="50"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588677    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588680    2576 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588684    2576 flags.go:64] FLAG: --pod-cidr=""
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588687    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588692    2576 flags.go:64] FLAG: --pod-manifest-path=""
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588694    2576 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 21:21:14.592868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588697    2576 flags.go:64] FLAG: --pods-per-core="0"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588700    2576 flags.go:64] FLAG: --port="10250"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588703    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588706    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00bf7af439df119a0"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588710    2576 flags.go:64] FLAG: --qos-reserved=""
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588713    2576 flags.go:64] FLAG: --read-only-port="10255"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588716    2576 flags.go:64] FLAG: --register-node="true"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588719    2576 flags.go:64] FLAG: --register-schedulable="true"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588721    2576 flags.go:64] FLAG: --register-with-taints=""
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588725    2576 flags.go:64] FLAG: --registry-burst="10"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588728    2576 flags.go:64] FLAG: --registry-qps="5"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588731    2576 flags.go:64] FLAG: --reserved-cpus=""
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588734    2576 flags.go:64] FLAG: --reserved-memory=""
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588737    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588740    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588743    2576 flags.go:64] FLAG: --rotate-certificates="false"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588746    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588749    2576 flags.go:64] FLAG: --runonce="false"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588751    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588754    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588757    2576 flags.go:64] FLAG: --seccomp-default="false"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588760    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588763    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588766    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588769    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588772    2576 flags.go:64] FLAG: --storage-driver-password="root"
May 21 21:21:14.593465 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588775    2576 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588777    2576 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588780    2576 flags.go:64] FLAG: --storage-driver-user="root"
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588783    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588786    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588789    2576 flags.go:64] FLAG: --system-cgroups=""
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588792    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588797    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588800    2576 flags.go:64] FLAG: --tls-cert-file=""
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588802    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588809    2576 flags.go:64] FLAG: --tls-min-version=""
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588812    2576 flags.go:64] FLAG: --tls-private-key-file=""
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588815    2576 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588818    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588821    2576 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588824    2576 flags.go:64] FLAG: --v="2"
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588828    2576 flags.go:64] FLAG: --version="false"
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588833    2576 flags.go:64] FLAG: --vmodule=""
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588837    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.588841    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588935    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588939    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588942    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588945    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 21:21:14.594134 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588948    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588951    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588953    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588956    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588958    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588961    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588963    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588966    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588969    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588972    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588974    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588977    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588994    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.588997    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589000    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589003    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589006    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589008    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589013    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589015    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 21:21:14.594723 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589021    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589024    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589026    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589029    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589032    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589034    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589037    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589040    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589042    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589045    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589047    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589051    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589053    2576 feature_gate.go:328] unrecognized feature gate: Example
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589056    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589059    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589061    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589064    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589066    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589069    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589071    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 21:21:14.595248 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589074    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589076    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589080    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589084    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589087    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589090    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589092    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589095    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589098    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589100    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589103    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589106    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589109    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589112    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589115    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589117    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589120    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589122    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589125    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 21:21:14.595735 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589127    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589130    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589133    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589135    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589137    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589140    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589143    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589145    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589148    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589150    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589153    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589155    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589158    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589160    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589163    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589165    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589168    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589170    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589173    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 21:21:14.596235 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589178    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589182    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589185    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.589188    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.589732    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.596099    2576 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.596118    2576 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596166    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596171    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596175    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596178    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596182    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596185    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596188    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596191    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596194    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 21:21:14.596705 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596197    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596200    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596203    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596205    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596208    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596211    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596213    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596216    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596219    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596221    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596224    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596227    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596229    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596232    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596234    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596237    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596240    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596242    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596245    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 21:21:14.597133 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596248    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596250    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596253    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596257    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596260    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596263    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596265    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596268    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596270    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596273    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596275    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596278    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596280    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596283    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596285    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596288    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596291    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596293    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596296    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596298    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 21:21:14.597628 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596301    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596304    2576 feature_gate.go:328] unrecognized feature gate: Example
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596306    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596308    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596311    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596315    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596319    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596322    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596325    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596328    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596330    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596333    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596336    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596338    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596341    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596345    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596348    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596351    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596353    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596356    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 21:21:14.598136 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596359    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596361    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596364    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596367    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596369    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596372    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596374    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596377    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596379    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596383    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596387    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596389    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596392    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596395    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596397    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596400    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596402    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 21:21:14.598646 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596405    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.596410    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596509    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596513    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596516    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596519    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596522    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596525    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596527    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596530    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596533    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596536    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596540    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596543    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596545    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 21:21:14.599083 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596548    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596550    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596553    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596555    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596558    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596560    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596563    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596565    2576 feature_gate.go:328] unrecognized feature gate: Example
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596568    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596571    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596573    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596575    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596578    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596581    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596584    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596586    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596588    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596591    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596595    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596598    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 21:21:14.599555 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596600    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596603    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596605    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596608    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596611    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596613    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596615    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596619    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596622    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596624    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596627    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596630    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596632    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596635    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596637    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596640    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596642    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596645    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596647    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596650    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 21:21:14.600068 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596652    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596655    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596657    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596659    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596662    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596664    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596667    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596669    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596673    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596676    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596679    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596682    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596685    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596688    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596690    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596693    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596695    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596698    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596700    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596703    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 21:21:14.600553 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596706    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596709    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596711    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596715    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596717    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596720    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596722    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596725    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596727    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596730    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596732    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596735    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:14.596737    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.596742    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.597643    2576 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 21:21:14.601095 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.600619    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 21:21:14.601472 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.601396    2576 server.go:1019] "Starting client certificate rotation"
May 21 21:21:14.601863 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.601846    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 21:21:14.601897 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.601880    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 21:21:14.623239 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.623217    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 21:21:14.625170 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.625154    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 21:21:14.634242 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.634223    2576 log.go:25] "Validated CRI v1 runtime API"
May 21 21:21:14.640529 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.640509    2576 log.go:25] "Validated CRI v1 image API"
May 21 21:21:14.642791 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.642772    2576 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 21:21:14.644901 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.644882    2576 fs.go:135] Filesystem UUIDs: map[24c74524-e488-4deb-8963-d64c1e88732e:/dev/nvme0n1p3 2a129234-e73d-4c4c-9179-e614d8302118:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
May 21 21:21:14.644973 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.644901    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 21:21:14.649692 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.649574    2576 manager.go:217] Machine: {Timestamp:2026-05-21 21:21:14.64906449 +0000 UTC m=+0.337439807 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099583 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec262f74b58d0f43a8634727711d6d25 SystemUUID:ec262f74-b58d-0f43-a863-4727711d6d25 BootID:ea539226-8e87-43bd-a196-8137763b2a4a Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:e5:7f:38:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:e5:7f:38:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:aa:95:70:7d:f0:45 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 21:21:14.649692 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.649691    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 21:21:14.649803 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.649771    2576 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 21:21:14.652098 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.652073    2576 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 21:21:14.652242 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.652100    2576 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-166.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 21:21:14.652285 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.652251    2576 topology_manager.go:138] "Creating topology manager with none policy"
May 21 21:21:14.652285 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.652260    2576 container_manager_linux.go:306] "Creating device plugin manager"
May 21 21:21:14.652285 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.652268    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 21:21:14.652285 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.652283    2576 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 21:21:14.653723 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.653710    2576 state_mem.go:36] "Initialized new in-memory state store"
May 21 21:21:14.653830 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.653821    2576 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 21:21:14.654453 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.654434    2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 21:21:14.655777 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.655766    2576 kubelet.go:491] "Attempting to sync node with API server"
May 21 21:21:14.655819 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.655782    2576 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 21:21:14.656311 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.656302    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 21:21:14.656343 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.656314    2576 kubelet.go:397] "Adding apiserver pod source"
May 21 21:21:14.656343 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.656322    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 21:21:14.657277 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.657264    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 21:21:14.657350 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.657282    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 21:21:14.659888 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.659874    2576 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 21:21:14.661660 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.661648    2576 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 21:21:14.663470 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.663456    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 21:21:14.663539 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.663474    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 21:21:14.663539 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.663481    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 21:21:14.663539 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.663487    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 21:21:14.663539 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.663495    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 21:21:14.663539 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.663507    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 21:21:14.663539 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.663513    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 21:21:14.663539 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.663518    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 21:21:14.663539 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.663525    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 21:21:14.663539 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.663530    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 21:21:14.663539 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.663538    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 21:21:14.663539 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.663544    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 21:21:14.664262 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.664252    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 21:21:14.664262 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.664263    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 21:21:14.667169 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.667152    2576 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-166.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 21:21:14.667383 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.667370    2576 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 21:21:14.667442 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.667405    2576 server.go:1295] "Started kubelet"
May 21 21:21:14.667511 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.667455    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 21:21:14.667561 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.667488    2576 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 21:21:14.667561 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.667541    2576 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 21:21:14.667772 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.667750    2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 21:21:14.667772 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.667748    2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-166.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 21:21:14.668198 ip-10-0-135-166 systemd[1]: Started Kubernetes Kubelet.
May 21 21:21:14.668775 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.668643    2576 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 21:21:14.670387 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.670373    2576 server.go:317] "Adding debug handlers to kubelet server"
May 21 21:21:14.672257 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.672242    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fp5vw"
May 21 21:21:14.674422 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.674403    2576 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 21:21:14.675642 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.675630    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 21:21:14.676063 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.676049    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 21:21:14.677900 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.677856    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-166.ec2.internal\" not found"
May 21 21:21:14.678280 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.678256    2576 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 21:21:14.678280 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.678279    2576 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 21:21:14.678403 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.678310    2576 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 21:21:14.678641 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.678624    2576 reconstruct.go:97] "Volume reconstruction finished"
May 21 21:21:14.678707 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.678643    2576 reconciler.go:26] "Reconciler: start to sync state"
May 21 21:21:14.679581 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.679558    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fp5vw"
May 21 21:21:14.679847 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.679830    2576 factory.go:55] Registering systemd factory
May 21 21:21:14.679924 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.679851    2576 factory.go:223] Registration of the systemd container factory successfully
May 21 21:21:14.680187 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.680173    2576 factory.go:153] Registering CRI-O factory
May 21 21:21:14.680276 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.680266    2576 factory.go:223] Registration of the crio container factory successfully
May 21 21:21:14.680399 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.680389    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 21:21:14.680488 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.680469    2576 factory.go:103] Registering Raw factory
May 21 21:21:14.680488 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.680492    2576 manager.go:1196] Started watching for new ooms in manager
May 21 21:21:14.681853 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.681825    2576 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 21 21:21:14.681967 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.681871    2576 manager.go:319] Starting recovery of all containers
May 21 21:21:14.682736 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.681892    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-166.ec2.internal.18b1b17c2c6bd949  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-166.ec2.internal,UID:ip-10-0-135-166.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-166.ec2.internal,},FirstTimestamp:2026-05-21 21:21:14.667383113 +0000 UTC m=+0.355758426,LastTimestamp:2026-05-21 21:21:14.667383113 +0000 UTC m=+0.355758426,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-166.ec2.internal,}"
May 21 21:21:14.690647 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.690519    2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-166.ec2.internal\" not found" node="ip-10-0-135-166.ec2.internal"
May 21 21:21:14.692472 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.692457    2576 manager.go:324] Recovery completed
May 21 21:21:14.696612 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.696600    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 21:21:14.698550 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.698534    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasSufficientMemory"
May 21 21:21:14.698610 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.698564    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasNoDiskPressure"
May 21 21:21:14.698610 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.698579    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasSufficientPID"
May 21 21:21:14.699156 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.699141    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 21:21:14.699218 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.699156    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 21:21:14.699218 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.699173    2576 state_mem.go:36] "Initialized new in-memory state store"
May 21 21:21:14.702283 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.702270    2576 policy_none.go:49] "None policy: Start"
May 21 21:21:14.702325 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.702287    2576 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 21:21:14.702325 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.702298    2576 state_mem.go:35] "Initializing new in-memory state store"
May 21 21:21:14.758882 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.743638    2576 manager.go:341] "Starting Device Plugin manager"
May 21 21:21:14.758882 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.743675    2576 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 21:21:14.758882 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.743689    2576 server.go:85] "Starting device plugin registration server"
May 21 21:21:14.758882 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.743998    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 21:21:14.758882 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.744012    2576 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 21:21:14.758882 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.744135    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 21:21:14.758882 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.744217    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 21:21:14.758882 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.744226    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 21:21:14.758882 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.744724    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 21:21:14.758882 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.744766    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-166.ec2.internal\" not found"
May 21 21:21:14.800022 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.799970    2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 21:21:14.801126 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.801099    2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 21:21:14.801126 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.801125    2576 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 21:21:14.801268 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.801150    2576 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 21:21:14.801268 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.801157    2576 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 21:21:14.801268 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.801192    2576 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 21:21:14.807388 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.807365    2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 21:21:14.845067 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.845044    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 21:21:14.846416 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.846401    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasSufficientMemory"
May 21 21:21:14.846485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.846432    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasNoDiskPressure"
May 21 21:21:14.846485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.846450    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasSufficientPID"
May 21 21:21:14.846485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.846479    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-166.ec2.internal"
May 21 21:21:14.854220 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.854204    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-166.ec2.internal"
May 21 21:21:14.854275 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.854229    2576 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-166.ec2.internal\": node \"ip-10-0-135-166.ec2.internal\" not found"
May 21 21:21:14.893892 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.893854    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-166.ec2.internal\" not found"
May 21 21:21:14.901947 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.901904    2576 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-166.ec2.internal"]
May 21 21:21:14.902018 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.902012    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 21:21:14.902977 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.902955    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasSufficientMemory"
May 21 21:21:14.903129 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.903005    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasNoDiskPressure"
May 21 21:21:14.903129 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.903021    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasSufficientPID"
May 21 21:21:14.905525 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.905510    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 21:21:14.905690 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.905675    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal"
May 21 21:21:14.905734 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.905705    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 21:21:14.906312 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.906290    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasSufficientMemory"
May 21 21:21:14.906312 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.906300    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasSufficientMemory"
May 21 21:21:14.906469 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.906319    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasNoDiskPressure"
May 21 21:21:14.906469 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.906324    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasNoDiskPressure"
May 21 21:21:14.906469 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.906330    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasSufficientPID"
May 21 21:21:14.906469 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.906338    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasSufficientPID"
May 21 21:21:14.908685 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.908668    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-166.ec2.internal"
May 21 21:21:14.908765 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.908697    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 21:21:14.909392 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.909374    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasSufficientMemory"
May 21 21:21:14.909474 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.909399    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasNoDiskPressure"
May 21 21:21:14.909474 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.909413    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeHasSufficientPID"
May 21 21:21:14.936702 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.936677    2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-166.ec2.internal\" not found" node="ip-10-0-135-166.ec2.internal"
May 21 21:21:14.941010 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.940975    2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-166.ec2.internal\" not found" node="ip-10-0-135-166.ec2.internal"
May 21 21:21:14.980303 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.980275    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fe6111d74f5d482969b74b3d8e3e3529-config\") pod \"kube-apiserver-proxy-ip-10-0-135-166.ec2.internal\" (UID: \"fe6111d74f5d482969b74b3d8e3e3529\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-166.ec2.internal"
May 21 21:21:14.980440 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.980308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e51a9e1b1b9713d1842ac77f04b71964-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal\" (UID: \"e51a9e1b1b9713d1842ac77f04b71964\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal"
May 21 21:21:14.980440 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:14.980334    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e51a9e1b1b9713d1842ac77f04b71964-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal\" (UID: \"e51a9e1b1b9713d1842ac77f04b71964\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal"
May 21 21:21:14.994184 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:14.994147    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-166.ec2.internal\" not found"
May 21 21:21:15.081246 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.081215    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fe6111d74f5d482969b74b3d8e3e3529-config\") pod \"kube-apiserver-proxy-ip-10-0-135-166.ec2.internal\" (UID: \"fe6111d74f5d482969b74b3d8e3e3529\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-166.ec2.internal"
May 21 21:21:15.081246 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.081247    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e51a9e1b1b9713d1842ac77f04b71964-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal\" (UID: \"e51a9e1b1b9713d1842ac77f04b71964\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal"
May 21 21:21:15.081431 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.081265    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e51a9e1b1b9713d1842ac77f04b71964-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal\" (UID: \"e51a9e1b1b9713d1842ac77f04b71964\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal"
May 21 21:21:15.081431 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.081314    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e51a9e1b1b9713d1842ac77f04b71964-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal\" (UID: \"e51a9e1b1b9713d1842ac77f04b71964\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal"
May 21 21:21:15.081431 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.081320    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e51a9e1b1b9713d1842ac77f04b71964-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal\" (UID: \"e51a9e1b1b9713d1842ac77f04b71964\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal"
May 21 21:21:15.081431 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.081364    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fe6111d74f5d482969b74b3d8e3e3529-config\") pod \"kube-apiserver-proxy-ip-10-0-135-166.ec2.internal\" (UID: \"fe6111d74f5d482969b74b3d8e3e3529\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-166.ec2.internal"
May 21 21:21:15.094337 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:15.094268    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-166.ec2.internal\" not found"
May 21 21:21:15.195208 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:15.195166    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-166.ec2.internal\" not found"
May 21 21:21:15.239382 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.239340    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal"
May 21 21:21:15.244054 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.244037    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-166.ec2.internal"
May 21 21:21:15.295994 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:15.295956    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-166.ec2.internal\" not found"
May 21 21:21:15.396624 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:15.396554    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-166.ec2.internal\" not found"
May 21 21:21:15.487968 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.487941    2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 21:21:15.496845 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:15.496821    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-166.ec2.internal\" not found"
May 21 21:21:15.597562 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:15.597533    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-166.ec2.internal\" not found"
May 21 21:21:15.601646 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.601632    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 21:21:15.601796 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.601780    2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 21:21:15.601846 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.601817    2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 21:21:15.676682 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.676618    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 21:21:15.681939 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.681905    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 21:16:14 +0000 UTC" deadline="2028-01-07 00:17:46.971173269 +0000 UTC"
May 21 21:21:15.681939 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.681935    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14282h56m31.28924212s"
May 21 21:21:15.687088 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.687064    2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 21:21:15.687637 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.687621    2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 21:21:15.707091 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.707068    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9v9c"
May 21 21:21:15.714179 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.714154    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9v9c"
May 21 21:21:15.750708 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:15.750681    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe6111d74f5d482969b74b3d8e3e3529.slice/crio-ce309aa3d8406444147ea461a54ec9f39fc58fcd6678fd928f9aa6302cebe1e7 WatchSource:0}: Error finding container ce309aa3d8406444147ea461a54ec9f39fc58fcd6678fd928f9aa6302cebe1e7: Status 404 returned error can't find the container with id ce309aa3d8406444147ea461a54ec9f39fc58fcd6678fd928f9aa6302cebe1e7
May 21 21:21:15.751707 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:15.751676    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode51a9e1b1b9713d1842ac77f04b71964.slice/crio-9ff4a55ce321e71f7640964447474806b7da799579aa514b00dda031de4b0fbb WatchSource:0}: Error finding container 9ff4a55ce321e71f7640964447474806b7da799579aa514b00dda031de4b0fbb: Status 404 returned error can't find the container with id 9ff4a55ce321e71f7640964447474806b7da799579aa514b00dda031de4b0fbb
May 21 21:21:15.755296 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.755281    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 21:21:15.777184 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.777158    2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal"
May 21 21:21:15.788460 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.788445    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 21:21:15.789832 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.789819    2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-166.ec2.internal"
May 21 21:21:15.797585 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.797572    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 21:21:15.804064 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.804018    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-166.ec2.internal" event={"ID":"fe6111d74f5d482969b74b3d8e3e3529","Type":"ContainerStarted","Data":"ce309aa3d8406444147ea461a54ec9f39fc58fcd6678fd928f9aa6302cebe1e7"}
May 21 21:21:15.804814 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:15.804795    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal" event={"ID":"e51a9e1b1b9713d1842ac77f04b71964","Type":"ContainerStarted","Data":"9ff4a55ce321e71f7640964447474806b7da799579aa514b00dda031de4b0fbb"}
May 21 21:21:16.032551 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.032514    2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 21:21:16.657570 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.657490    2576 apiserver.go:52] "Watching apiserver"
May 21 21:21:16.665750 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.665724    2576 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 21:21:16.666145 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.666121    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-r6zvj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal","openshift-multus/multus-additional-cni-plugins-xclmm","openshift-multus/multus-lx2l5","openshift-network-operator/iptables-alerter-9h7gb","openshift-ovn-kubernetes/ovnkube-node-x2klb","kube-system/kube-apiserver-proxy-ip-10-0-135-166.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8t67h","openshift-dns/node-resolver-k7cdj","openshift-image-registry/node-ca-4m8zj","openshift-multus/network-metrics-daemon-scfdw","openshift-network-diagnostics/network-check-target-wmrfp"]
May 21 21:21:16.668778 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.668749    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.671004 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.670964    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.672402 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.672209    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 21:21:16.672402 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.672250    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 21:21:16.672402 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.672305    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 21:21:16.672402 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.672259    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 21:21:16.673001 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.672776    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 21:21:16.673461 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.673303    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 21:21:16.673461 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.673317    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4xzfr\""
May 21 21:21:16.673871 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.673671    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 21:21:16.674650 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.674212    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 21:21:16.674650 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.674428    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 21:21:16.674650 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.674586    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6v8cd\""
May 21 21:21:16.675063 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.674962    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.678288 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.677708    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 21:21:16.678288 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.677820    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 21:21:16.678288 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.677923    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 21:21:16.678288 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.677970    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-h9vjt\""
May 21 21:21:16.678288 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.678058    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 21:21:16.678288 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.678139    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 21:21:16.680224 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.680204    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.680324 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.680297    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9h7gb"
May 21 21:21:16.682071 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.682050    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 21:21:16.682567 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.682546    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rzc8h\""
May 21 21:21:16.682672 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.682571    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r6zvj"
May 21 21:21:16.682733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.682677    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 21:21:16.682837 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.682787    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5rfxv\""
May 21 21:21:16.682930 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.682904    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 21:21:16.683040 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.683022    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 21:21:16.685122 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.684903    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 21:21:16.685122 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.685057    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n8n94\""
May 21 21:21:16.685285 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.685158    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 21:21:16.687320 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.687287    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.687420 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.687365    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k7cdj"
May 21 21:21:16.689687 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.689594    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 21:21:16.689687 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.689667    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 21:21:16.689904 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.689780    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4qhs9\""
May 21 21:21:16.689904 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.689865    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 21:21:16.690032 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.689997    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m5sh6\""
May 21 21:21:16.690086 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690056    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 21:21:16.690136 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-run-ovn-kubernetes\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.690187 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690129    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ee54fa9-ffda-46f3-a939-ea782030cb96-ovn-node-metrics-cert\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.690187 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690158    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.690292 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690207    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-run-multus-certs\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.690292 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690234    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-run-ovn\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.690292 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0ee54fa9-ffda-46f3-a939-ea782030cb96-env-overrides\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.690419 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690293    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-cnibin\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.690419 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-system-cni-dir\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.690419 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-multus-cni-dir\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.690419 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-var-lib-kubelet\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.690419 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-slash\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.690677 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-socket-dir\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.690677 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-os-release\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.690677 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.690677 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-var-lib-cni-multus\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.690677 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690588    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-run-openvswitch\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.690677 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-systemd-units\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.690677 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690636    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4xv5\" (UniqueName: \"kubernetes.io/projected/0ee54fa9-ffda-46f3-a939-ea782030cb96-kube-api-access-w4xv5\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.690677 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690663    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rntgw\" (UniqueName: \"kubernetes.io/projected/5c3f5490-5382-432f-9023-0e6c9caf639a-kube-api-access-rntgw\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-cni-binary-copy\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-multus-conf-dir\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04aea387-ec29-4e20-8c5b-321b7851dd82-iptables-alerter-script\") pod \"iptables-alerter-9h7gb\" (UID: \"04aea387-ec29-4e20-8c5b-321b7851dd82\") " pod="openshift-network-operator/iptables-alerter-9h7gb"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690773    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-etc-selinux\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-run-netns\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-cni-bin\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-os-release\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690935    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-cnibin\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-etc-kubernetes\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.690995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-run-systemd\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691019    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-etc-openvswitch\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691060    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-hostroot\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.691152 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691092    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-cni-netd\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691222    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691251    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-multus-socket-dir-parent\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691295    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-run-netns\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-registration-dir\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691334    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-device-dir\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691384    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0ee54fa9-ffda-46f3-a939-ea782030cb96-ovnkube-script-lib\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691437    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691463    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-multus-daemon-config\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691491    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04aea387-ec29-4e20-8c5b-321b7851dd82-host-slash\") pod \"iptables-alerter-9h7gb\" (UID: \"04aea387-ec29-4e20-8c5b-321b7851dd82\") " pod="openshift-network-operator/iptables-alerter-9h7gb"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691518    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-node-log\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691542    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-log-socket\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691597    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-sys-fs\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691639    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-var-lib-openvswitch\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691712    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-system-cni-dir\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.691809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l72l2\" (UniqueName: \"kubernetes.io/projected/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-kube-api-access-l72l2\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.692646 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-kubelet\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.692646 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-run-k8s-cni-cncf-io\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.692646 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691849    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-var-lib-cni-bin\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.692646 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691872    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0ee54fa9-ffda-46f3-a939-ea782030cb96-ovnkube-config\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.692646 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvs28\" (UniqueName: \"kubernetes.io/projected/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-kube-api-access-hvs28\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.692646 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.691914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgvtc\" (UniqueName: \"kubernetes.io/projected/04aea387-ec29-4e20-8c5b-321b7851dd82-kube-api-access-kgvtc\") pod \"iptables-alerter-9h7gb\" (UID: \"04aea387-ec29-4e20-8c5b-321b7851dd82\") " pod="openshift-network-operator/iptables-alerter-9h7gb"
May 21 21:21:16.692646 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.692122    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4m8zj"
May 21 21:21:16.692646 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.692222    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:16.692646 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:16.692298    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:16.694868 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.694848    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:16.694999 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:16.694916    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:16.696002 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.695966    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 21:21:16.696097 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.696039    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 21:21:16.696097 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.696045    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 21:21:16.696097 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.696042    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m5gns\""
May 21 21:21:16.714879 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.714850    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 21:16:15 +0000 UTC" deadline="2027-11-03 14:09:40.150598452 +0000 UTC"
May 21 21:21:16.714879 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.714876    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12736h48m23.435726314s"
May 21 21:21:16.773087 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.773054    2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 21:21:16.779513 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.779480    2576 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 21:21:16.792204 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792174    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-kubernetes\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.792377 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792209    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tw52\" (UniqueName: \"kubernetes.io/projected/abd86fab-2669-4fe7-b5f0-25d4b3311ca1-kube-api-access-2tw52\") pod \"node-resolver-k7cdj\" (UID: \"abd86fab-2669-4fe7-b5f0-25d4b3311ca1\") " pod="openshift-dns/node-resolver-k7cdj"
May 21 21:21:16.792377 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792241    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-var-lib-openvswitch\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.792377 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792267    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-system-cni-dir\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.792377 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792293    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l72l2\" (UniqueName: \"kubernetes.io/projected/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-kube-api-access-l72l2\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.792377 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792318    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-kubelet\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.792377 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792342    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-run-k8s-cni-cncf-io\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.792377 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792366    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-var-lib-cni-bin\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.792651 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-lib-modules\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.792651 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792411    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0ee54fa9-ffda-46f3-a939-ea782030cb96-ovnkube-config\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.792651 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792437    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvs28\" (UniqueName: \"kubernetes.io/projected/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-kube-api-access-hvs28\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.792651 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792458    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kgvtc\" (UniqueName: \"kubernetes.io/projected/04aea387-ec29-4e20-8c5b-321b7851dd82-kube-api-access-kgvtc\") pod \"iptables-alerter-9h7gb\" (UID: \"04aea387-ec29-4e20-8c5b-321b7851dd82\") " pod="openshift-network-operator/iptables-alerter-9h7gb"
May 21 21:21:16.792651 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rz7k\" (UniqueName: \"kubernetes.io/projected/8959993d-94c0-4577-a84b-345a567afd85-kube-api-access-4rz7k\") pod \"node-ca-4m8zj\" (UID: \"8959993d-94c0-4577-a84b-345a567afd85\") " pod="openshift-image-registry/node-ca-4m8zj"
May 21 21:21:16.792651 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-modprobe-d\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.792651 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abd86fab-2669-4fe7-b5f0-25d4b3311ca1-hosts-file\") pod \"node-resolver-k7cdj\" (UID: \"abd86fab-2669-4fe7-b5f0-25d4b3311ca1\") " pod="openshift-dns/node-resolver-k7cdj"
May 21 21:21:16.792651 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792553    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-run-ovn-kubernetes\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.792651 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792569    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ee54fa9-ffda-46f3-a939-ea782030cb96-ovn-node-metrics-cert\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.792651 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792594    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.792651 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792617    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-run-multus-certs\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.792651 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792640    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-sysctl-conf\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-tuned\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792684    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zggs\" (UniqueName: \"kubernetes.io/projected/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-kube-api-access-4zggs\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792701    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-run-ovn\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792718    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0ee54fa9-ffda-46f3-a939-ea782030cb96-env-overrides\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792745    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-cnibin\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792768    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-sys\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792793    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-system-cni-dir\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792863    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-run-ovn\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792871    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-multus-cni-dir\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792901    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-var-lib-cni-bin\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792902    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-var-lib-openvswitch\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792928    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-run-k8s-cni-cncf-io\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792928    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-var-lib-kubelet\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792964    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-var-lib-kubelet\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793001    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-system-cni-dir\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.792967    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-cnibin\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.793153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793074    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-run\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793120    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-slash\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793149    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-socket-dir\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793173    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-os-release\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793217    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793274    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-var-lib-cni-multus\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-tmp\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793343    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-run-openvswitch\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793372    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-systemd-units\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793376    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-system-cni-dir\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793398    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4xv5\" (UniqueName: \"kubernetes.io/projected/0ee54fa9-ffda-46f3-a939-ea782030cb96-kube-api-access-w4xv5\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793425    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rntgw\" (UniqueName: \"kubernetes.io/projected/5c3f5490-5382-432f-9023-0e6c9caf639a-kube-api-access-rntgw\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793482    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0ee54fa9-ffda-46f3-a939-ea782030cb96-env-overrides\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793488    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-socket-dir\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793502    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-cni-binary-copy\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.793733 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793532    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-multus-conf-dir\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793562    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04aea387-ec29-4e20-8c5b-321b7851dd82-iptables-alerter-script\") pod \"iptables-alerter-9h7gb\" (UID: \"04aea387-ec29-4e20-8c5b-321b7851dd82\") " pod="openshift-network-operator/iptables-alerter-9h7gb"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793575    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-multus-cni-dir\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793579    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793582    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0ee54fa9-ffda-46f3-a939-ea782030cb96-ovnkube-config\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8959993d-94c0-4577-a84b-345a567afd85-serviceca\") pod \"node-ca-4m8zj\" (UID: \"8959993d-94c0-4577-a84b-345a567afd85\") " pod="openshift-image-registry/node-ca-4m8zj"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793590    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793611    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-run-ovn-kubernetes\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793627    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-systemd-units\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793640    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-run-multus-certs\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793647    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-etc-selinux\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793654    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-var-lib-cni-multus\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793659    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-run-openvswitch\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793674    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-slash\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793692    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-host\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793687    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-multus-conf-dir\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793733    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-os-release\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.794518 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793805    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-run-netns\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793838    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-cni-bin\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793862    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-os-release\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793902    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-run-netns\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793899    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-etc-selinux\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-sysctl-d\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793939    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-cni-bin\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793953    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-os-release\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.793956    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-var-lib-kubelet\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794021    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-kubelet\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794094    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794129    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-cnibin\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794149    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-cni-binary-copy\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794213    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-cnibin\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794249    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-etc-kubernetes\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794273    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-run-systemd\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794288    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-etc-openvswitch\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794304    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-hostroot\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.795295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794333    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4v7n\" (UniqueName: \"kubernetes.io/projected/9f8199a0-fb92-4453-82c2-a9613c455612-kube-api-access-g4v7n\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794349    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-run-systemd\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-systemd\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794386    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-etc-kubernetes\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abd86fab-2669-4fe7-b5f0-25d4b3311ca1-tmp-dir\") pod \"node-resolver-k7cdj\" (UID: \"abd86fab-2669-4fe7-b5f0-25d4b3311ca1\") " pod="openshift-dns/node-resolver-k7cdj"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794423    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-etc-openvswitch\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794455    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-hostroot\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794468    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04aea387-ec29-4e20-8c5b-321b7851dd82-iptables-alerter-script\") pod \"iptables-alerter-9h7gb\" (UID: \"04aea387-ec29-4e20-8c5b-321b7851dd82\") " pod="openshift-network-operator/iptables-alerter-9h7gb"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794487    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-cni-netd\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794511    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794539    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794538    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-cni-netd\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794588    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794620    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-multus-socket-dir-parent\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794646    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-run-netns\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794650    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794698    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-multus-socket-dir-parent\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.795903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794732    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-host-run-netns\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-sysconfig\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794806    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-446rt\" (UniqueName: \"kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt\") pod \"network-check-target-wmrfp\" (UID: \"3619f5ba-a927-4dfb-a50e-e092f1f16e4e\") " pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794841    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-registration-dir\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794868    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-device-dir\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794894    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0ee54fa9-ffda-46f3-a939-ea782030cb96-ovnkube-script-lib\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794955    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-registration-dir\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.794961    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-device-dir\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795010    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795030    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-multus-daemon-config\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795051    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04aea387-ec29-4e20-8c5b-321b7851dd82-host-slash\") pod \"iptables-alerter-9h7gb\" (UID: \"04aea387-ec29-4e20-8c5b-321b7851dd82\") " pod="openshift-network-operator/iptables-alerter-9h7gb"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795097    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/186342af-27e9-4ba1-b631-3bbc2d944659-konnectivity-ca\") pod \"konnectivity-agent-r6zvj\" (UID: \"186342af-27e9-4ba1-b631-3bbc2d944659\") " pod="kube-system/konnectivity-agent-r6zvj"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795100    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795138    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-node-log\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795167    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04aea387-ec29-4e20-8c5b-321b7851dd82-host-slash\") pod \"iptables-alerter-9h7gb\" (UID: \"04aea387-ec29-4e20-8c5b-321b7851dd82\") " pod="openshift-network-operator/iptables-alerter-9h7gb"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795167    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-log-socket\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795199    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-log-socket\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.796426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795205    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-sys-fs\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.797010 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795239    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0ee54fa9-ffda-46f3-a939-ea782030cb96-node-log\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.797010 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795285    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5c3f5490-5382-432f-9023-0e6c9caf639a-sys-fs\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.797010 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/186342af-27e9-4ba1-b631-3bbc2d944659-agent-certs\") pod \"konnectivity-agent-r6zvj\" (UID: \"186342af-27e9-4ba1-b631-3bbc2d944659\") " pod="kube-system/konnectivity-agent-r6zvj"
May 21 21:21:16.797010 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8959993d-94c0-4577-a84b-345a567afd85-host\") pod \"node-ca-4m8zj\" (UID: \"8959993d-94c0-4577-a84b-345a567afd85\") " pod="openshift-image-registry/node-ca-4m8zj"
May 21 21:21:16.797010 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795429    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0ee54fa9-ffda-46f3-a939-ea782030cb96-ovnkube-script-lib\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.797010 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.795592    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.797010 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.796018    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-multus-daemon-config\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.797332 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.797165    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0ee54fa9-ffda-46f3-a939-ea782030cb96-ovn-node-metrics-cert\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.804243 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.804216    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rntgw\" (UniqueName: \"kubernetes.io/projected/5c3f5490-5382-432f-9023-0e6c9caf639a-kube-api-access-rntgw\") pod \"aws-ebs-csi-driver-node-clf59\" (UID: \"5c3f5490-5382-432f-9023-0e6c9caf639a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.804445 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.804387    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgvtc\" (UniqueName: \"kubernetes.io/projected/04aea387-ec29-4e20-8c5b-321b7851dd82-kube-api-access-kgvtc\") pod \"iptables-alerter-9h7gb\" (UID: \"04aea387-ec29-4e20-8c5b-321b7851dd82\") " pod="openshift-network-operator/iptables-alerter-9h7gb"
May 21 21:21:16.804815 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.804778    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvs28\" (UniqueName: \"kubernetes.io/projected/d10c924d-f6bc-4673-94e7-ea20e5b2d1e4-kube-api-access-hvs28\") pod \"multus-additional-cni-plugins-xclmm\" (UID: \"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4\") " pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:16.805073 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.804973    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4xv5\" (UniqueName: \"kubernetes.io/projected/0ee54fa9-ffda-46f3-a939-ea782030cb96-kube-api-access-w4xv5\") pod \"ovnkube-node-x2klb\" (UID: \"0ee54fa9-ffda-46f3-a939-ea782030cb96\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.805170 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.805125    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l72l2\" (UniqueName: \"kubernetes.io/projected/ed2b98d3-2df0-46ce-b5a2-d9ff5f834719-kube-api-access-l72l2\") pod \"multus-lx2l5\" (UID: \"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719\") " pod="openshift-multus/multus-lx2l5"
May 21 21:21:16.895943 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.895914    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-tmp\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896114 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.895965    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8959993d-94c0-4577-a84b-345a567afd85-serviceca\") pod \"node-ca-4m8zj\" (UID: \"8959993d-94c0-4577-a84b-345a567afd85\") " pod="openshift-image-registry/node-ca-4m8zj"
May 21 21:21:16.896114 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896022    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-host\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896114 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896048    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-sysctl-d\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896114 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896072    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-var-lib-kubelet\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896114 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896103    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4v7n\" (UniqueName: \"kubernetes.io/projected/9f8199a0-fb92-4453-82c2-a9613c455612-kube-api-access-g4v7n\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:16.896363 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896127    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-systemd\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896363 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896151    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abd86fab-2669-4fe7-b5f0-25d4b3311ca1-tmp-dir\") pod \"node-resolver-k7cdj\" (UID: \"abd86fab-2669-4fe7-b5f0-25d4b3311ca1\") " pod="openshift-dns/node-resolver-k7cdj"
May 21 21:21:16.896363 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896166    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-host\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896363 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896236    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-var-lib-kubelet\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896363 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896245    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-sysctl-d\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896363 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896254    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-sysconfig\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896363 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896177    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-sysconfig\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896363 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896299    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-systemd\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896363 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896320    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-446rt\" (UniqueName: \"kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt\") pod \"network-check-target-wmrfp\" (UID: \"3619f5ba-a927-4dfb-a50e-e092f1f16e4e\") " pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896396    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/186342af-27e9-4ba1-b631-3bbc2d944659-konnectivity-ca\") pod \"konnectivity-agent-r6zvj\" (UID: \"186342af-27e9-4ba1-b631-3bbc2d944659\") " pod="kube-system/konnectivity-agent-r6zvj"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896426    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/186342af-27e9-4ba1-b631-3bbc2d944659-agent-certs\") pod \"konnectivity-agent-r6zvj\" (UID: \"186342af-27e9-4ba1-b631-3bbc2d944659\") " pod="kube-system/konnectivity-agent-r6zvj"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896433    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8959993d-94c0-4577-a84b-345a567afd85-serviceca\") pod \"node-ca-4m8zj\" (UID: \"8959993d-94c0-4577-a84b-345a567afd85\") " pod="openshift-image-registry/node-ca-4m8zj"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896448    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8959993d-94c0-4577-a84b-345a567afd85-host\") pod \"node-ca-4m8zj\" (UID: \"8959993d-94c0-4577-a84b-345a567afd85\") " pod="openshift-image-registry/node-ca-4m8zj"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896486    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-kubernetes\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896511    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tw52\" (UniqueName: \"kubernetes.io/projected/abd86fab-2669-4fe7-b5f0-25d4b3311ca1-kube-api-access-2tw52\") pod \"node-resolver-k7cdj\" (UID: \"abd86fab-2669-4fe7-b5f0-25d4b3311ca1\") " pod="openshift-dns/node-resolver-k7cdj"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896517    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/abd86fab-2669-4fe7-b5f0-25d4b3311ca1-tmp-dir\") pod \"node-resolver-k7cdj\" (UID: \"abd86fab-2669-4fe7-b5f0-25d4b3311ca1\") " pod="openshift-dns/node-resolver-k7cdj"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896550    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8959993d-94c0-4577-a84b-345a567afd85-host\") pod \"node-ca-4m8zj\" (UID: \"8959993d-94c0-4577-a84b-345a567afd85\") " pod="openshift-image-registry/node-ca-4m8zj"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896559    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-lib-modules\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896593    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4rz7k\" (UniqueName: \"kubernetes.io/projected/8959993d-94c0-4577-a84b-345a567afd85-kube-api-access-4rz7k\") pod \"node-ca-4m8zj\" (UID: \"8959993d-94c0-4577-a84b-345a567afd85\") " pod="openshift-image-registry/node-ca-4m8zj"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896605    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-kubernetes\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896616    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-modprobe-d\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896638    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abd86fab-2669-4fe7-b5f0-25d4b3311ca1-hosts-file\") pod \"node-resolver-k7cdj\" (UID: \"abd86fab-2669-4fe7-b5f0-25d4b3311ca1\") " pod="openshift-dns/node-resolver-k7cdj"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896667    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-sysctl-conf\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896688    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-lib-modules\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.896757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896730    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/abd86fab-2669-4fe7-b5f0-25d4b3311ca1-hosts-file\") pod \"node-resolver-k7cdj\" (UID: \"abd86fab-2669-4fe7-b5f0-25d4b3311ca1\") " pod="openshift-dns/node-resolver-k7cdj"
May 21 21:21:16.897529 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896848    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-sysctl-conf\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.897529 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896691    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-tuned\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.897529 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896891    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4zggs\" (UniqueName: \"kubernetes.io/projected/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-kube-api-access-4zggs\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.897529 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896919    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-sys\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.897529 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896946    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:16.897529 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896968    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-run\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.897529 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.896973    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/186342af-27e9-4ba1-b631-3bbc2d944659-konnectivity-ca\") pod \"konnectivity-agent-r6zvj\" (UID: \"186342af-27e9-4ba1-b631-3bbc2d944659\") " pod="kube-system/konnectivity-agent-r6zvj"
May 21 21:21:16.897529 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.897043    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-sys\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.897529 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.897063    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-run\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.897529 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:16.897090    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:16.897529 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:16.897160    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs podName:9f8199a0-fb92-4453-82c2-a9613c455612 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:17.397141872 +0000 UTC m=+3.085517201 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs") pod "network-metrics-daemon-scfdw" (UID: "9f8199a0-fb92-4453-82c2-a9613c455612") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:16.897529 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.897213    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-modprobe-d\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.899363 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.899340    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-etc-tuned\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.899363 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.899358    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/186342af-27e9-4ba1-b631-3bbc2d944659-agent-certs\") pod \"konnectivity-agent-r6zvj\" (UID: \"186342af-27e9-4ba1-b631-3bbc2d944659\") " pod="kube-system/konnectivity-agent-r6zvj"
May 21 21:21:16.899499 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.899382    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-tmp\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.912673 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:16.912607    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:21:16.912673 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:16.912639    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:21:16.912673 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:16.912654    2576 projected.go:194] Error preparing data for projected volume kube-api-access-446rt for pod openshift-network-diagnostics/network-check-target-wmrfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:16.912920 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:16.912754    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt podName:3619f5ba-a927-4dfb-a50e-e092f1f16e4e nodeName:}" failed. No retries permitted until 2026-05-21 21:21:17.412733355 +0000 UTC m=+3.101108675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-446rt" (UniqueName: "kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt") pod "network-check-target-wmrfp" (UID: "3619f5ba-a927-4dfb-a50e-e092f1f16e4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:16.914321 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.914289    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zggs\" (UniqueName: \"kubernetes.io/projected/f034750e-1e78-4c2c-8cf9-cdb1a5db7187-kube-api-access-4zggs\") pod \"tuned-8t67h\" (UID: \"f034750e-1e78-4c2c-8cf9-cdb1a5db7187\") " pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:16.914783 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.914761    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tw52\" (UniqueName: \"kubernetes.io/projected/abd86fab-2669-4fe7-b5f0-25d4b3311ca1-kube-api-access-2tw52\") pod \"node-resolver-k7cdj\" (UID: \"abd86fab-2669-4fe7-b5f0-25d4b3311ca1\") " pod="openshift-dns/node-resolver-k7cdj"
May 21 21:21:16.916192 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.916169    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rz7k\" (UniqueName: \"kubernetes.io/projected/8959993d-94c0-4577-a84b-345a567afd85-kube-api-access-4rz7k\") pod \"node-ca-4m8zj\" (UID: \"8959993d-94c0-4577-a84b-345a567afd85\") " pod="openshift-image-registry/node-ca-4m8zj"
May 21 21:21:16.916308 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.916284    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4v7n\" (UniqueName: \"kubernetes.io/projected/9f8199a0-fb92-4453-82c2-a9613c455612-kube-api-access-g4v7n\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:16.982122 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.982085    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:16.989017 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.988976    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59"
May 21 21:21:16.998647 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:16.998621    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xclmm"
May 21 21:21:17.003293 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.003269    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lx2l5"
May 21 21:21:17.011827 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.011808    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9h7gb"
May 21 21:21:17.020451 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.020431    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-r6zvj"
May 21 21:21:17.025888 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.025869    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8t67h"
May 21 21:21:17.032433 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.032416    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k7cdj"
May 21 21:21:17.037970 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.037950    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4m8zj"
May 21 21:21:17.401041 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.400964    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:17.401136 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:17.401100    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:17.401177 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:17.401166    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs podName:9f8199a0-fb92-4453-82c2-a9613c455612 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:18.401146208 +0000 UTC m=+4.089521511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs") pod "network-metrics-daemon-scfdw" (UID: "9f8199a0-fb92-4453-82c2-a9613c455612") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:17.415969 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:17.415910    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabd86fab_2669_4fe7_b5f0_25d4b3311ca1.slice/crio-be397720ed7a346d503db57192d806e1d60e4ce7856f4441134e53a4f2b8efe5 WatchSource:0}: Error finding container be397720ed7a346d503db57192d806e1d60e4ce7856f4441134e53a4f2b8efe5: Status 404 returned error can't find the container with id be397720ed7a346d503db57192d806e1d60e4ce7856f4441134e53a4f2b8efe5
May 21 21:21:17.417435 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:17.417410    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf034750e_1e78_4c2c_8cf9_cdb1a5db7187.slice/crio-fa3fd71830bd3312ee4d24ad6693c1073eb4cc20fdfb0598f6733343b42e374d WatchSource:0}: Error finding container fa3fd71830bd3312ee4d24ad6693c1073eb4cc20fdfb0598f6733343b42e374d: Status 404 returned error can't find the container with id fa3fd71830bd3312ee4d24ad6693c1073eb4cc20fdfb0598f6733343b42e374d
May 21 21:21:17.418813 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:17.418787    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c3f5490_5382_432f_9023_0e6c9caf639a.slice/crio-b3d3ef0b22322c7cca8fb525087e521b116d21f6278ffea6bee9619c5bb465be WatchSource:0}: Error finding container b3d3ef0b22322c7cca8fb525087e521b116d21f6278ffea6bee9619c5bb465be: Status 404 returned error can't find the container with id b3d3ef0b22322c7cca8fb525087e521b116d21f6278ffea6bee9619c5bb465be
May 21 21:21:17.419410 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:17.419375    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8959993d_94c0_4577_a84b_345a567afd85.slice/crio-13442bfd5fbeb3599ba5d2f8dd25b187e26122ac43afe71c3cc7804c4d4381b2 WatchSource:0}: Error finding container 13442bfd5fbeb3599ba5d2f8dd25b187e26122ac43afe71c3cc7804c4d4381b2: Status 404 returned error can't find the container with id 13442bfd5fbeb3599ba5d2f8dd25b187e26122ac43afe71c3cc7804c4d4381b2
May 21 21:21:17.421333 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:17.421310    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod186342af_27e9_4ba1_b631_3bbc2d944659.slice/crio-1500081c992be2c9b6e72354ef468a675a649d8b0b0664eae378974fbe488842 WatchSource:0}: Error finding container 1500081c992be2c9b6e72354ef468a675a649d8b0b0664eae378974fbe488842: Status 404 returned error can't find the container with id 1500081c992be2c9b6e72354ef468a675a649d8b0b0664eae378974fbe488842
May 21 21:21:17.422137 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:17.422115    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd10c924d_f6bc_4673_94e7_ea20e5b2d1e4.slice/crio-647eb8f6cfb27a040c685a0bce083ef328324adeb2b40733f5b23e2c12ecf8d7 WatchSource:0}: Error finding container 647eb8f6cfb27a040c685a0bce083ef328324adeb2b40733f5b23e2c12ecf8d7: Status 404 returned error can't find the container with id 647eb8f6cfb27a040c685a0bce083ef328324adeb2b40733f5b23e2c12ecf8d7
May 21 21:21:17.423576 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:17.423553    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2b98d3_2df0_46ce_b5a2_d9ff5f834719.slice/crio-775f94b6c6caf10ab4c0d209ab57f9dc6ac09b0a6aadae1748b2f304bf4093d8 WatchSource:0}: Error finding container 775f94b6c6caf10ab4c0d209ab57f9dc6ac09b0a6aadae1748b2f304bf4093d8: Status 404 returned error can't find the container with id 775f94b6c6caf10ab4c0d209ab57f9dc6ac09b0a6aadae1748b2f304bf4093d8
May 21 21:21:17.424950 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:21:17.424644    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04aea387_ec29_4e20_8c5b_321b7851dd82.slice/crio-8050a968c4e4924b58dbb0a5f736e03fd440c97dfacc4c1dca2e594483847ead WatchSource:0}: Error finding container 8050a968c4e4924b58dbb0a5f736e03fd440c97dfacc4c1dca2e594483847ead: Status 404 returned error can't find the container with id 8050a968c4e4924b58dbb0a5f736e03fd440c97dfacc4c1dca2e594483847ead
May 21 21:21:17.502499 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.502317    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-446rt\" (UniqueName: \"kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt\") pod \"network-check-target-wmrfp\" (UID: \"3619f5ba-a927-4dfb-a50e-e092f1f16e4e\") " pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:17.502590 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:17.502476    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:21:17.502590 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:17.502565    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:21:17.502590 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:17.502576    2576 projected.go:194] Error preparing data for projected volume kube-api-access-446rt for pod openshift-network-diagnostics/network-check-target-wmrfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:17.502706 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:17.502636    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt podName:3619f5ba-a927-4dfb-a50e-e092f1f16e4e nodeName:}" failed. No retries permitted until 2026-05-21 21:21:18.502616041 +0000 UTC m=+4.190991343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-446rt" (UniqueName: "kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt") pod "network-check-target-wmrfp" (UID: "3619f5ba-a927-4dfb-a50e-e092f1f16e4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:17.715027 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.714999    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 21:16:15 +0000 UTC" deadline="2027-12-02 16:07:59.343751524 +0000 UTC"
May 21 21:21:17.715405 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.715028    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13434h46m41.628726739s"
May 21 21:21:17.801642 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.801557    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:17.801811 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:17.801688    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:17.809367 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.809332    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-166.ec2.internal" event={"ID":"fe6111d74f5d482969b74b3d8e3e3529","Type":"ContainerStarted","Data":"5b1416ec836fd67e013bfd8b96e571e335af535d9b70260f777a724529f12d96"}
May 21 21:21:17.811802 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.811773    2576 generic.go:358] "Generic (PLEG): container finished" podID="e51a9e1b1b9713d1842ac77f04b71964" containerID="051a2912262895eeca516bbb0b1f2b2b3ac24844018b82813f05a5f32c596b48" exitCode=0
May 21 21:21:17.811943 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.811851    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal" event={"ID":"e51a9e1b1b9713d1842ac77f04b71964","Type":"ContainerDied","Data":"051a2912262895eeca516bbb0b1f2b2b3ac24844018b82813f05a5f32c596b48"}
May 21 21:21:17.814134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.814110    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb" event={"ID":"0ee54fa9-ffda-46f3-a939-ea782030cb96","Type":"ContainerStarted","Data":"da7e9bea4b3cf83b614c99d46deca81a34f09a10cc92559121475917a8f9676a"}
May 21 21:21:17.815094 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.815075    2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 21:21:17.816292 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.816267    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9h7gb" event={"ID":"04aea387-ec29-4e20-8c5b-321b7851dd82","Type":"ContainerStarted","Data":"8050a968c4e4924b58dbb0a5f736e03fd440c97dfacc4c1dca2e594483847ead"}
May 21 21:21:17.821315 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.821288    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lx2l5" event={"ID":"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719","Type":"ContainerStarted","Data":"775f94b6c6caf10ab4c0d209ab57f9dc6ac09b0a6aadae1748b2f304bf4093d8"}
May 21 21:21:17.824824 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.824754    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-166.ec2.internal" podStartSLOduration=2.824738172 podStartE2EDuration="2.824738172s" podCreationTimestamp="2026-05-21 21:21:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:21:17.824360205 +0000 UTC m=+3.512735526" watchObservedRunningTime="2026-05-21 21:21:17.824738172 +0000 UTC m=+3.513113488"
May 21 21:21:17.826703 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.826668    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59" event={"ID":"5c3f5490-5382-432f-9023-0e6c9caf639a","Type":"ContainerStarted","Data":"b3d3ef0b22322c7cca8fb525087e521b116d21f6278ffea6bee9619c5bb465be"}
May 21 21:21:17.829376 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.829321    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8t67h" event={"ID":"f034750e-1e78-4c2c-8cf9-cdb1a5db7187","Type":"ContainerStarted","Data":"fa3fd71830bd3312ee4d24ad6693c1073eb4cc20fdfb0598f6733343b42e374d"}
May 21 21:21:17.832024 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.831994    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k7cdj" event={"ID":"abd86fab-2669-4fe7-b5f0-25d4b3311ca1","Type":"ContainerStarted","Data":"be397720ed7a346d503db57192d806e1d60e4ce7856f4441134e53a4f2b8efe5"}
May 21 21:21:17.835327 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.835301    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xclmm" event={"ID":"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4","Type":"ContainerStarted","Data":"647eb8f6cfb27a040c685a0bce083ef328324adeb2b40733f5b23e2c12ecf8d7"}
May 21 21:21:17.840264 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.840239    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r6zvj" event={"ID":"186342af-27e9-4ba1-b631-3bbc2d944659","Type":"ContainerStarted","Data":"1500081c992be2c9b6e72354ef468a675a649d8b0b0664eae378974fbe488842"}
May 21 21:21:17.843053 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:17.843028    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4m8zj" event={"ID":"8959993d-94c0-4577-a84b-345a567afd85","Type":"ContainerStarted","Data":"13442bfd5fbeb3599ba5d2f8dd25b187e26122ac43afe71c3cc7804c4d4381b2"}
May 21 21:21:18.409724 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:18.409684    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:18.409931 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:18.409855    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:18.409931 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:18.409923    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs podName:9f8199a0-fb92-4453-82c2-a9613c455612 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:20.409903959 +0000 UTC m=+6.098279272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs") pod "network-metrics-daemon-scfdw" (UID: "9f8199a0-fb92-4453-82c2-a9613c455612") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:18.510702 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:18.510661    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-446rt\" (UniqueName: \"kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt\") pod \"network-check-target-wmrfp\" (UID: \"3619f5ba-a927-4dfb-a50e-e092f1f16e4e\") " pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:18.510890 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:18.510861    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:21:18.510890 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:18.510883    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:21:18.511030 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:18.510896    2576 projected.go:194] Error preparing data for projected volume kube-api-access-446rt for pod openshift-network-diagnostics/network-check-target-wmrfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:18.511030 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:18.510959    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt podName:3619f5ba-a927-4dfb-a50e-e092f1f16e4e nodeName:}" failed. No retries permitted until 2026-05-21 21:21:20.510939265 +0000 UTC m=+6.199314570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-446rt" (UniqueName: "kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt") pod "network-check-target-wmrfp" (UID: "3619f5ba-a927-4dfb-a50e-e092f1f16e4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:18.803209 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:18.803177    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:18.803675 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:18.803314    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:18.869140 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:18.869103    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal" event={"ID":"e51a9e1b1b9713d1842ac77f04b71964","Type":"ContainerStarted","Data":"c44ead040e4f6882a4941d90d12af8b7a78782d090152482573a315397a0e057"}
May 21 21:21:19.802104 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:19.801579    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:19.802104 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:19.801707    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:20.423991 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:20.423940    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:20.424448 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:20.424123    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:20.424448 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:20.424193    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs podName:9f8199a0-fb92-4453-82c2-a9613c455612 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:24.424172141 +0000 UTC m=+10.112547440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs") pod "network-metrics-daemon-scfdw" (UID: "9f8199a0-fb92-4453-82c2-a9613c455612") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:20.524816 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:20.524766    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-446rt\" (UniqueName: \"kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt\") pod \"network-check-target-wmrfp\" (UID: \"3619f5ba-a927-4dfb-a50e-e092f1f16e4e\") " pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:20.525019 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:20.524956    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:21:20.525019 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:20.524999    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:21:20.525019 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:20.525012    2576 projected.go:194] Error preparing data for projected volume kube-api-access-446rt for pod openshift-network-diagnostics/network-check-target-wmrfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:20.525177 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:20.525078    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt podName:3619f5ba-a927-4dfb-a50e-e092f1f16e4e nodeName:}" failed. No retries permitted until 2026-05-21 21:21:24.525058306 +0000 UTC m=+10.213433615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-446rt" (UniqueName: "kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt") pod "network-check-target-wmrfp" (UID: "3619f5ba-a927-4dfb-a50e-e092f1f16e4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:20.803759 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:20.803724    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:20.803942 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:20.803869    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:21.801753 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:21.801711    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:21.802253 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:21.801853    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:22.802735 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:22.802702    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:22.803277 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:22.802847    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:23.801901 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:23.801861    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:23.802092 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:23.802027    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:24.459271 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:24.459165    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:24.459735 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:24.459292    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:24.459735 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:24.459342    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs podName:9f8199a0-fb92-4453-82c2-a9613c455612 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:32.459328876 +0000 UTC m=+18.147704176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs") pod "network-metrics-daemon-scfdw" (UID: "9f8199a0-fb92-4453-82c2-a9613c455612") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:24.559722 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:24.559560    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-446rt\" (UniqueName: \"kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt\") pod \"network-check-target-wmrfp\" (UID: \"3619f5ba-a927-4dfb-a50e-e092f1f16e4e\") " pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:24.559912 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:24.559728    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:21:24.559912 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:24.559749    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:21:24.559912 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:24.559762    2576 projected.go:194] Error preparing data for projected volume kube-api-access-446rt for pod openshift-network-diagnostics/network-check-target-wmrfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:24.559912 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:24.559831    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt podName:3619f5ba-a927-4dfb-a50e-e092f1f16e4e nodeName:}" failed. No retries permitted until 2026-05-21 21:21:32.559811483 +0000 UTC m=+18.248186796 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-446rt" (UniqueName: "kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt") pod "network-check-target-wmrfp" (UID: "3619f5ba-a927-4dfb-a50e-e092f1f16e4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:24.803134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:24.803100    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:24.803308 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:24.803238    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:25.802233 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:25.802168    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:25.802699 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:25.802315    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:26.801412 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:26.801375    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:26.801602 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:26.801523    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:27.801857 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:27.801822    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:27.802350 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:27.801936    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:28.448308 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:28.448253    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-166.ec2.internal" podStartSLOduration=13.448235567 podStartE2EDuration="13.448235567s" podCreationTimestamp="2026-05-21 21:21:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:21:18.885931671 +0000 UTC m=+4.574306993" watchObservedRunningTime="2026-05-21 21:21:28.448235567 +0000 UTC m=+14.136610890"
May 21 21:21:28.449198 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:28.449168    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-z2fpm"]
May 21 21:21:28.466435 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:28.466408    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:28.466553 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:28.466501    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2fpm" podUID="c17c1b66-c3b4-4a15-be33-d8febf18700d"
May 21 21:21:28.593054 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:28.593018    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c17c1b66-c3b4-4a15-be33-d8febf18700d-kubelet-config\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:28.593219 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:28.593126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:28.593219 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:28.593151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c17c1b66-c3b4-4a15-be33-d8febf18700d-dbus\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:28.693628 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:28.693589    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c17c1b66-c3b4-4a15-be33-d8febf18700d-kubelet-config\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:28.693628 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:28.693654    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:28.693875 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:28.693743    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c17c1b66-c3b4-4a15-be33-d8febf18700d-kubelet-config\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:28.693875 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:28.693757    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 21:21:28.693875 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:28.693775    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c17c1b66-c3b4-4a15-be33-d8febf18700d-dbus\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:28.693875 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:28.693821    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret podName:c17c1b66-c3b4-4a15-be33-d8febf18700d nodeName:}" failed. No retries permitted until 2026-05-21 21:21:29.193802282 +0000 UTC m=+14.882177589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret") pod "global-pull-secret-syncer-z2fpm" (UID: "c17c1b66-c3b4-4a15-be33-d8febf18700d") : object "kube-system"/"original-pull-secret" not registered
May 21 21:21:28.694104 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:28.693951    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c17c1b66-c3b4-4a15-be33-d8febf18700d-dbus\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:28.802558 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:28.802509    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:28.802919 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:28.802660    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:29.196641 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:29.196558    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:29.196791 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:29.196709    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 21:21:29.196791 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:29.196770    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret podName:c17c1b66-c3b4-4a15-be33-d8febf18700d nodeName:}" failed. No retries permitted until 2026-05-21 21:21:30.196752378 +0000 UTC m=+15.885127686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret") pod "global-pull-secret-syncer-z2fpm" (UID: "c17c1b66-c3b4-4a15-be33-d8febf18700d") : object "kube-system"/"original-pull-secret" not registered
May 21 21:21:29.801510 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:29.801473    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:29.801695 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:29.801598    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:30.204507 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:30.204426    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:30.204907 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:30.204540    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 21:21:30.204907 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:30.204611    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret podName:c17c1b66-c3b4-4a15-be33-d8febf18700d nodeName:}" failed. No retries permitted until 2026-05-21 21:21:32.204595494 +0000 UTC m=+17.892970797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret") pod "global-pull-secret-syncer-z2fpm" (UID: "c17c1b66-c3b4-4a15-be33-d8febf18700d") : object "kube-system"/"original-pull-secret" not registered
May 21 21:21:30.801997 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:30.801931    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:30.802164 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:30.802076    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:30.802164 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:30.802115    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:30.802296 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:30.802175    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2fpm" podUID="c17c1b66-c3b4-4a15-be33-d8febf18700d"
May 21 21:21:31.801875 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:31.801838    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:31.802382 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:31.801966    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:32.219745 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:32.219648    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:32.219915 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:32.219840    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 21:21:32.219915 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:32.219913    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret podName:c17c1b66-c3b4-4a15-be33-d8febf18700d nodeName:}" failed. No retries permitted until 2026-05-21 21:21:36.219894198 +0000 UTC m=+21.908269514 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret") pod "global-pull-secret-syncer-z2fpm" (UID: "c17c1b66-c3b4-4a15-be33-d8febf18700d") : object "kube-system"/"original-pull-secret" not registered
May 21 21:21:32.522417 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:32.522378    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:32.522594 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:32.522518    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:32.522594 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:32.522585    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs podName:9f8199a0-fb92-4453-82c2-a9613c455612 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:48.522566659 +0000 UTC m=+34.210941972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs") pod "network-metrics-daemon-scfdw" (UID: "9f8199a0-fb92-4453-82c2-a9613c455612") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:32.622891 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:32.622857    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-446rt\" (UniqueName: \"kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt\") pod \"network-check-target-wmrfp\" (UID: \"3619f5ba-a927-4dfb-a50e-e092f1f16e4e\") " pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:32.623120 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:32.623088    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:21:32.623120 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:32.623110    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:21:32.623120 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:32.623122    2576 projected.go:194] Error preparing data for projected volume kube-api-access-446rt for pod openshift-network-diagnostics/network-check-target-wmrfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:32.623278 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:32.623190    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt podName:3619f5ba-a927-4dfb-a50e-e092f1f16e4e nodeName:}" failed. No retries permitted until 2026-05-21 21:21:48.623169004 +0000 UTC m=+34.311544307 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-446rt" (UniqueName: "kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt") pod "network-check-target-wmrfp" (UID: "3619f5ba-a927-4dfb-a50e-e092f1f16e4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:32.801956 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:32.801867    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:32.801956 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:32.801896    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:32.802569 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:32.802016    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:32.802569 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:32.802146    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2fpm" podUID="c17c1b66-c3b4-4a15-be33-d8febf18700d"
May 21 21:21:33.802256 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:33.802216    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:33.802687 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:33.802338    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:34.802761 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:34.802719    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:34.803244 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:34.802829    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2fpm" podUID="c17c1b66-c3b4-4a15-be33-d8febf18700d"
May 21 21:21:34.803244 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:34.802927    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:34.803244 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:34.803084    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:35.802346 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:35.802318    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:35.802470 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:35.802447    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:36.248007 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.247682    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:36.248576 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:36.247820    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 21:21:36.248576 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:36.248147    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret podName:c17c1b66-c3b4-4a15-be33-d8febf18700d nodeName:}" failed. No retries permitted until 2026-05-21 21:21:44.248124101 +0000 UTC m=+29.936499409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret") pod "global-pull-secret-syncer-z2fpm" (UID: "c17c1b66-c3b4-4a15-be33-d8febf18700d") : object "kube-system"/"original-pull-secret" not registered
May 21 21:21:36.802330 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.802294    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:36.802491 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.802296    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:36.802491 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:36.802396    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2fpm" podUID="c17c1b66-c3b4-4a15-be33-d8febf18700d"
May 21 21:21:36.802491 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:36.802484    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:36.929095 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.929058    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lx2l5" event={"ID":"ed2b98d3-2df0-46ce-b5a2-d9ff5f834719","Type":"ContainerStarted","Data":"f5b331b812545359dfe83a84aced8501b0e05175fd6943db331e243c0e3af947"}
May 21 21:21:36.930396 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.930363    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59" event={"ID":"5c3f5490-5382-432f-9023-0e6c9caf639a","Type":"ContainerStarted","Data":"8884ebff4913548bb4fd5e668ce548cf9f367eaead891feeff6f6b0f0cfab428"}
May 21 21:21:36.931500 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.931466    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8t67h" event={"ID":"f034750e-1e78-4c2c-8cf9-cdb1a5db7187","Type":"ContainerStarted","Data":"a6894e64632fb18286198d165270a7d37ecd8e314996b6935047396e5c063ee8"}
May 21 21:21:36.932716 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.932688    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k7cdj" event={"ID":"abd86fab-2669-4fe7-b5f0-25d4b3311ca1","Type":"ContainerStarted","Data":"ce9d5ece95f705d0a60df319dab392749a23dc7d0b9a3b91135f07f4bca99281"}
May 21 21:21:36.934055 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.934031    2576 generic.go:358] "Generic (PLEG): container finished" podID="d10c924d-f6bc-4673-94e7-ea20e5b2d1e4" containerID="a1462f939eff423d7f26ac04c3070ba302842db55190ea4226d83c3c074be787" exitCode=0
May 21 21:21:36.934138 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.934091    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xclmm" event={"ID":"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4","Type":"ContainerDied","Data":"a1462f939eff423d7f26ac04c3070ba302842db55190ea4226d83c3c074be787"}
May 21 21:21:36.935291 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.935270    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-r6zvj" event={"ID":"186342af-27e9-4ba1-b631-3bbc2d944659","Type":"ContainerStarted","Data":"b52188d2260077fdbdc4fafefea286350f82e4f6e43e1c2df3617a3d8d8261f4"}
May 21 21:21:36.936540 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.936510    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4m8zj" event={"ID":"8959993d-94c0-4577-a84b-345a567afd85","Type":"ContainerStarted","Data":"32dd2c221cc1ff764efa3ddd1cd86ed15d775523f916f4f24bc03b66bd8ed4d6"}
May 21 21:21:36.938767 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.938742    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb" event={"ID":"0ee54fa9-ffda-46f3-a939-ea782030cb96","Type":"ContainerStarted","Data":"f827cc82fd5c43148510948b05a5f9876e7a98224c172b6cc18cdaf043d02120"}
May 21 21:21:36.938767 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.938770    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb" event={"ID":"0ee54fa9-ffda-46f3-a939-ea782030cb96","Type":"ContainerStarted","Data":"2c6afec89229de1de22a283bbe5bdf0ef3150e378567e552762d8ebef11e7d0d"}
May 21 21:21:36.938912 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.938780    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb" event={"ID":"0ee54fa9-ffda-46f3-a939-ea782030cb96","Type":"ContainerStarted","Data":"e08be44eff596d96d7fd4e2ba22f3d91cd0dd96d14ffc4b0f372ade7ad355ad8"}
May 21 21:21:36.938912 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.938788    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb" event={"ID":"0ee54fa9-ffda-46f3-a939-ea782030cb96","Type":"ContainerStarted","Data":"b8cfcf82bea4a42dd446fac1f3f166f762aa940a568c525994ed65407fb0ae11"}
May 21 21:21:36.938912 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.938795    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb" event={"ID":"0ee54fa9-ffda-46f3-a939-ea782030cb96","Type":"ContainerStarted","Data":"0fdbb134d547aa23a21cc06ee3a011da59d2de73b4ec56675ff90c3acb1cf557"}
May 21 21:21:36.938912 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.938805    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb" event={"ID":"0ee54fa9-ffda-46f3-a939-ea782030cb96","Type":"ContainerStarted","Data":"1fb6ea472d631227d1636598cc2dc78d6f7038715de697d941f08d66201d3b02"}
May 21 21:21:36.945809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.945765    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-lx2l5" podStartSLOduration=4.640051945 podStartE2EDuration="22.945753816s" podCreationTimestamp="2026-05-21 21:21:14 +0000 UTC" firstStartedPulling="2026-05-21 21:21:17.425637852 +0000 UTC m=+3.114013166" lastFinishedPulling="2026-05-21 21:21:35.731339737 +0000 UTC m=+21.419715037" observedRunningTime="2026-05-21 21:21:36.944372077 +0000 UTC m=+22.632747398" watchObservedRunningTime="2026-05-21 21:21:36.945753816 +0000 UTC m=+22.634129201"
May 21 21:21:36.973030 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.972960    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8t67h" podStartSLOduration=4.667939542 podStartE2EDuration="22.972944655s" podCreationTimestamp="2026-05-21 21:21:14 +0000 UTC" firstStartedPulling="2026-05-21 21:21:17.419858191 +0000 UTC m=+3.108233507" lastFinishedPulling="2026-05-21 21:21:35.724863305 +0000 UTC m=+21.413238620" observedRunningTime="2026-05-21 21:21:36.972786141 +0000 UTC m=+22.661161462" watchObservedRunningTime="2026-05-21 21:21:36.972944655 +0000 UTC m=+22.661319972"
May 21 21:21:36.973266 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.973244    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-r6zvj" podStartSLOduration=4.69755534 podStartE2EDuration="22.973238693s" podCreationTimestamp="2026-05-21 21:21:14 +0000 UTC" firstStartedPulling="2026-05-21 21:21:17.423157492 +0000 UTC m=+3.111532793" lastFinishedPulling="2026-05-21 21:21:35.698840834 +0000 UTC m=+21.387216146" observedRunningTime="2026-05-21 21:21:36.958067186 +0000 UTC m=+22.646442501" watchObservedRunningTime="2026-05-21 21:21:36.973238693 +0000 UTC m=+22.661614017"
May 21 21:21:36.986771 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:36.986700    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4m8zj" podStartSLOduration=12.918783968 podStartE2EDuration="22.986680665s" podCreationTimestamp="2026-05-21 21:21:14 +0000 UTC" firstStartedPulling="2026-05-21 21:21:17.421152122 +0000 UTC m=+3.109527435" lastFinishedPulling="2026-05-21 21:21:27.489048825 +0000 UTC m=+13.177424132" observedRunningTime="2026-05-21 21:21:36.986040847 +0000 UTC m=+22.674416168" watchObservedRunningTime="2026-05-21 21:21:36.986680665 +0000 UTC m=+22.675055988"
May 21 21:21:37.001012 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:37.000951    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-k7cdj" podStartSLOduration=4.695755066 podStartE2EDuration="23.000932579s" podCreationTimestamp="2026-05-21 21:21:14 +0000 UTC" firstStartedPulling="2026-05-21 21:21:17.418035496 +0000 UTC m=+3.106410798" lastFinishedPulling="2026-05-21 21:21:35.723213002 +0000 UTC m=+21.411588311" observedRunningTime="2026-05-21 21:21:37.000873671 +0000 UTC m=+22.689249008" watchObservedRunningTime="2026-05-21 21:21:37.000932579 +0000 UTC m=+22.689307898"
May 21 21:21:37.164788 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:37.164690    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 21:21:37.756406 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:37.756280    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T21:21:37.16470985Z","UUID":"4b0f9882-f17d-43eb-80ed-aa691337cb1f","Handler":null,"Name":"","Endpoint":""}
May 21 21:21:37.759319 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:37.759294    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 21:21:37.759477 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:37.759329    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 21:21:37.802370 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:37.802343    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:37.802588 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:37.802462    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:37.942534 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:37.942494    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9h7gb" event={"ID":"04aea387-ec29-4e20-8c5b-321b7851dd82","Type":"ContainerStarted","Data":"33514899586b654f726b101b4069afae5315b0e0ac6f5c23524fbebcfa6fb333"}
May 21 21:21:37.945029 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:37.944995    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59" event={"ID":"5c3f5490-5382-432f-9023-0e6c9caf639a","Type":"ContainerStarted","Data":"d5a75549197da8e0af528679a7e9d9ae8ca343b23876962ba170f56460971f63"}
May 21 21:21:38.802160 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:38.802126    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:38.802577 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:38.802169    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:38.802577 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:38.802241    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:38.802577 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:38.802347    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2fpm" podUID="c17c1b66-c3b4-4a15-be33-d8febf18700d"
May 21 21:21:38.947903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:38.947868    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59" event={"ID":"5c3f5490-5382-432f-9023-0e6c9caf639a","Type":"ContainerStarted","Data":"154a9e76ef2c58c8b2d6c527df35e9264f521b07dded663ed06127b3588d53bb"}
May 21 21:21:38.950479 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:38.950451    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb" event={"ID":"0ee54fa9-ffda-46f3-a939-ea782030cb96","Type":"ContainerStarted","Data":"b5fb3efb0a183feff2e8bb3543f5f4fbb533e7a9346fed71e76c054115e13a3a"}
May 21 21:21:38.966800 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:38.966755    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9h7gb" podStartSLOduration=6.671875661 podStartE2EDuration="24.966744515s" podCreationTimestamp="2026-05-21 21:21:14 +0000 UTC" firstStartedPulling="2026-05-21 21:21:17.428404893 +0000 UTC m=+3.116780195" lastFinishedPulling="2026-05-21 21:21:35.723273749 +0000 UTC m=+21.411649049" observedRunningTime="2026-05-21 21:21:37.956535647 +0000 UTC m=+23.644910970" watchObservedRunningTime="2026-05-21 21:21:38.966744515 +0000 UTC m=+24.655119836"
May 21 21:21:38.967195 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:38.967172    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-clf59" podStartSLOduration=4.172029395 podStartE2EDuration="24.967166723s" podCreationTimestamp="2026-05-21 21:21:14 +0000 UTC" firstStartedPulling="2026-05-21 21:21:17.421156525 +0000 UTC m=+3.109531833" lastFinishedPulling="2026-05-21 21:21:38.216293846 +0000 UTC m=+23.904669161" observedRunningTime="2026-05-21 21:21:38.966676861 +0000 UTC m=+24.655052181" watchObservedRunningTime="2026-05-21 21:21:38.967166723 +0000 UTC m=+24.655542043"
May 21 21:21:39.801999 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:39.801797    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:39.802207 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:39.802096    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:40.801746 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:40.801716    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:40.801746 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:40.801735    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:40.801934 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:40.801860    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:40.802014 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:40.801995    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2fpm" podUID="c17c1b66-c3b4-4a15-be33-d8febf18700d"
May 21 21:21:40.957144 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:40.957106    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb" event={"ID":"0ee54fa9-ffda-46f3-a939-ea782030cb96","Type":"ContainerStarted","Data":"0c881c5413b150efbbb3fe9edbb52d02d936a61d04a12f47ebe970ba7e9feb68"}
May 21 21:21:40.957899 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:40.957389    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:40.957899 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:40.957416    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:40.972851 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:40.972824    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:40.972966 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:40.972894    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:40.990100 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:40.990066    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb" podStartSLOduration=8.56715425 podStartE2EDuration="26.990054073s" podCreationTimestamp="2026-05-21 21:21:14 +0000 UTC" firstStartedPulling="2026-05-21 21:21:17.429486759 +0000 UTC m=+3.117862058" lastFinishedPulling="2026-05-21 21:21:35.852386562 +0000 UTC m=+21.540761881" observedRunningTime="2026-05-21 21:21:40.989776198 +0000 UTC m=+26.678151520" watchObservedRunningTime="2026-05-21 21:21:40.990054073 +0000 UTC m=+26.678429393"
May 21 21:21:41.251536 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:41.251507    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-r6zvj"
May 21 21:21:41.252374 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:41.252345    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-r6zvj"
May 21 21:21:41.802123 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:41.802086    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:41.802315 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:41.802231    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:41.959401 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:41.959370    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 21 21:21:41.959806 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:41.959775    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-r6zvj"
May 21 21:21:41.960121 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:41.960102    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-r6zvj"
May 21 21:21:42.458462 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:42.458260    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z2fpm"]
May 21 21:21:42.458667 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:42.458583    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:42.458740 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:42.458698    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2fpm" podUID="c17c1b66-c3b4-4a15-be33-d8febf18700d"
May 21 21:21:42.461973 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:42.461911    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wmrfp"]
May 21 21:21:42.462096 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:42.462055    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:42.462244 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:42.462173    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:42.462650 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:42.462627    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-scfdw"]
May 21 21:21:42.462766 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:42.462749    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:42.462879 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:42.462858    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:42.961632 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:42.961601    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 21 21:21:43.585535 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:43.585503    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:21:43.801628 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:43.801595    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:43.801628 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:43.801627    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:43.801829 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:43.801728    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:43.801829 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:43.801727    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2fpm" podUID="c17c1b66-c3b4-4a15-be33-d8febf18700d"
May 21 21:21:43.801829 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:43.801798    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:43.802003 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:43.801899    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:44.314410 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:44.314383    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:44.314678 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:44.314482    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 21:21:44.314678 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:44.314533    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret podName:c17c1b66-c3b4-4a15-be33-d8febf18700d nodeName:}" failed. No retries permitted until 2026-05-21 21:22:00.314515294 +0000 UTC m=+46.002890594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret") pod "global-pull-secret-syncer-z2fpm" (UID: "c17c1b66-c3b4-4a15-be33-d8febf18700d") : object "kube-system"/"original-pull-secret" not registered
May 21 21:21:44.968140 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:44.968026    2576 generic.go:358] "Generic (PLEG): container finished" podID="d10c924d-f6bc-4673-94e7-ea20e5b2d1e4" containerID="6d6c308c4ed8afe077510893863f812ac1843abbc56f37d54fc514549fa79291" exitCode=0
May 21 21:21:44.968140 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:44.968073    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xclmm" event={"ID":"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4","Type":"ContainerDied","Data":"6d6c308c4ed8afe077510893863f812ac1843abbc56f37d54fc514549fa79291"}
May 21 21:21:45.801453 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:45.801420    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:45.801924 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:45.801418    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:45.801924 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:45.801575    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:45.801924 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:45.801432    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:45.801924 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:45.801668    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2fpm" podUID="c17c1b66-c3b4-4a15-be33-d8febf18700d"
May 21 21:21:45.801924 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:45.801767    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:46.976020 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:46.975967    2576 generic.go:358] "Generic (PLEG): container finished" podID="d10c924d-f6bc-4673-94e7-ea20e5b2d1e4" containerID="41c98819a9af92040f45799a2989a5c5c82e578e441792cc9b228d46fd0edc75" exitCode=0
May 21 21:21:46.976336 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:46.976013    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xclmm" event={"ID":"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4","Type":"ContainerDied","Data":"41c98819a9af92040f45799a2989a5c5c82e578e441792cc9b228d46fd0edc75"}
May 21 21:21:47.801576 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:47.801542    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:47.801719 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:47.801548    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:47.801719 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:47.801662    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z2fpm" podUID="c17c1b66-c3b4-4a15-be33-d8febf18700d"
May 21 21:21:47.801719 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:47.801557    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:47.801850 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:47.801720    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-scfdw" podUID="9f8199a0-fb92-4453-82c2-a9613c455612"
May 21 21:21:47.801850 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:47.801793    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wmrfp" podUID="3619f5ba-a927-4dfb-a50e-e092f1f16e4e"
May 21 21:21:48.545079 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.545033    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:48.545598 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:48.545192    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:48.545598 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:48.545282    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs podName:9f8199a0-fb92-4453-82c2-a9613c455612 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:20.545264649 +0000 UTC m=+66.233639952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs") pod "network-metrics-daemon-scfdw" (UID: "9f8199a0-fb92-4453-82c2-a9613c455612") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 21:21:48.646223 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.646179    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-446rt\" (UniqueName: \"kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt\") pod \"network-check-target-wmrfp\" (UID: \"3619f5ba-a927-4dfb-a50e-e092f1f16e4e\") " pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:48.646423 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:48.646308    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 21:21:48.646423 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:48.646321    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 21:21:48.646423 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:48.646331    2576 projected.go:194] Error preparing data for projected volume kube-api-access-446rt for pod openshift-network-diagnostics/network-check-target-wmrfp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:48.646423 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:48.646381    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt podName:3619f5ba-a927-4dfb-a50e-e092f1f16e4e nodeName:}" failed. No retries permitted until 2026-05-21 21:22:20.646366105 +0000 UTC m=+66.334741403 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-446rt" (UniqueName: "kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt") pod "network-check-target-wmrfp" (UID: "3619f5ba-a927-4dfb-a50e-e092f1f16e4e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 21:21:48.662534 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.662501    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-166.ec2.internal" event="NodeReady"
May 21 21:21:48.662712 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.662658    2576 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 21:21:48.711923 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.711891    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2wxsq"]
May 21 21:21:48.725163 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.725133    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xff2c"]
May 21 21:21:48.725348 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.725293    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:48.727735 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.727692    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 21:21:48.727891 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.727748    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 21:21:48.727891 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.727823    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bvcxl\""
May 21 21:21:48.737372 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.737348    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2wxsq"]
May 21 21:21:48.737372 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.737374    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xff2c"]
May 21 21:21:48.737549 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.737480    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:21:48.739996 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.739957    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 21:21:48.740127 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.740063    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 21:21:48.740127 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.740100    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6c5qz\""
May 21 21:21:48.740127 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.740114    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 21:21:48.847310 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.847220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9354592a-23e0-44c3-a67c-64cf57490f9e-tmp-dir\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:48.847310 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.847273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:21:48.847310 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.847303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs8dr\" (UniqueName: \"kubernetes.io/projected/9354592a-23e0-44c3-a67c-64cf57490f9e-kube-api-access-vs8dr\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:48.847545 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.847338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9354592a-23e0-44c3-a67c-64cf57490f9e-config-volume\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:48.847545 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.847363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zshfz\" (UniqueName: \"kubernetes.io/projected/f976c3bf-c462-4143-afdf-d41bb38742e5-kube-api-access-zshfz\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:21:48.847545 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.847421    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:48.948459 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.948421    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9354592a-23e0-44c3-a67c-64cf57490f9e-tmp-dir\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:48.948459 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.948465    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:21:48.948784 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.948491    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vs8dr\" (UniqueName: \"kubernetes.io/projected/9354592a-23e0-44c3-a67c-64cf57490f9e-kube-api-access-vs8dr\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:48.948784 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.948515    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9354592a-23e0-44c3-a67c-64cf57490f9e-config-volume\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:48.948784 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.948547    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zshfz\" (UniqueName: \"kubernetes.io/projected/f976c3bf-c462-4143-afdf-d41bb38742e5-kube-api-access-zshfz\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:21:48.948784 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.948568    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:48.948784 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:48.948605    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:21:48.948784 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:48.948657    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:21:48.948784 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:48.948677    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert podName:f976c3bf-c462-4143-afdf-d41bb38742e5 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:49.448659601 +0000 UTC m=+35.137034899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert") pod "ingress-canary-xff2c" (UID: "f976c3bf-c462-4143-afdf-d41bb38742e5") : secret "canary-serving-cert" not found
May 21 21:21:48.948784 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:48.948707    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls podName:9354592a-23e0-44c3-a67c-64cf57490f9e nodeName:}" failed. No retries permitted until 2026-05-21 21:21:49.44868894 +0000 UTC m=+35.137064252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls") pod "dns-default-2wxsq" (UID: "9354592a-23e0-44c3-a67c-64cf57490f9e") : secret "dns-default-metrics-tls" not found
May 21 21:21:48.949159 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.948791    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9354592a-23e0-44c3-a67c-64cf57490f9e-tmp-dir\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:48.949159 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.949057    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9354592a-23e0-44c3-a67c-64cf57490f9e-config-volume\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:48.958507 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.958479    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs8dr\" (UniqueName: \"kubernetes.io/projected/9354592a-23e0-44c3-a67c-64cf57490f9e-kube-api-access-vs8dr\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:48.958620 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.958547    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zshfz\" (UniqueName: \"kubernetes.io/projected/f976c3bf-c462-4143-afdf-d41bb38742e5-kube-api-access-zshfz\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:21:48.982093 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.982061    2576 generic.go:358] "Generic (PLEG): container finished" podID="d10c924d-f6bc-4673-94e7-ea20e5b2d1e4" containerID="c0db05be9cf247c12b0271aa25dbce6cedb00889c5f8557a39c3b57d9c05f099" exitCode=0
May 21 21:21:48.982253 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:48.982105    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xclmm" event={"ID":"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4","Type":"ContainerDied","Data":"c0db05be9cf247c12b0271aa25dbce6cedb00889c5f8557a39c3b57d9c05f099"}
May 21 21:21:49.451894 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:49.451859    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:49.452091 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:49.451916    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:21:49.452091 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:49.452028    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:21:49.452091 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:49.452029    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:21:49.452091 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:49.452078    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert podName:f976c3bf-c462-4143-afdf-d41bb38742e5 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:50.452064274 +0000 UTC m=+36.140439578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert") pod "ingress-canary-xff2c" (UID: "f976c3bf-c462-4143-afdf-d41bb38742e5") : secret "canary-serving-cert" not found
May 21 21:21:49.452091 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:49.452090    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls podName:9354592a-23e0-44c3-a67c-64cf57490f9e nodeName:}" failed. No retries permitted until 2026-05-21 21:21:50.45208453 +0000 UTC m=+36.140459829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls") pod "dns-default-2wxsq" (UID: "9354592a-23e0-44c3-a67c-64cf57490f9e") : secret "dns-default-metrics-tls" not found
May 21 21:21:49.801751 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:49.801708    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:21:49.802383 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:49.801770    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:21:49.802383 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:49.801708    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:21:49.804658 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:49.804627    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 21:21:49.805494 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:49.805469    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 21:21:49.805637 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:49.805473    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xmr9w\""
May 21 21:21:49.805637 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:49.805514    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 21:21:49.805637 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:49.805477    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqv7p\""
May 21 21:21:49.805637 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:49.805477    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 21:21:50.460504 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:50.460469    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:50.460698 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:50.460525    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:21:50.460698 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:50.460638    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:21:50.460786 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:50.460712    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls podName:9354592a-23e0-44c3-a67c-64cf57490f9e nodeName:}" failed. No retries permitted until 2026-05-21 21:21:52.460694627 +0000 UTC m=+38.149069930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls") pod "dns-default-2wxsq" (UID: "9354592a-23e0-44c3-a67c-64cf57490f9e") : secret "dns-default-metrics-tls" not found
May 21 21:21:50.460786 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:50.460638    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:21:50.460786 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:50.460766    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert podName:f976c3bf-c462-4143-afdf-d41bb38742e5 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:52.460756906 +0000 UTC m=+38.149132205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert") pod "ingress-canary-xff2c" (UID: "f976c3bf-c462-4143-afdf-d41bb38742e5") : secret "canary-serving-cert" not found
May 21 21:21:52.476049 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:52.476009    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:52.476581 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:52.476091    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:21:52.476581 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:52.476169    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:21:52.476581 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:52.476193    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:21:52.476581 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:52.476239    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls podName:9354592a-23e0-44c3-a67c-64cf57490f9e nodeName:}" failed. No retries permitted until 2026-05-21 21:21:56.47622359 +0000 UTC m=+42.164598889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls") pod "dns-default-2wxsq" (UID: "9354592a-23e0-44c3-a67c-64cf57490f9e") : secret "dns-default-metrics-tls" not found
May 21 21:21:52.476581 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:52.476259    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert podName:f976c3bf-c462-4143-afdf-d41bb38742e5 nodeName:}" failed. No retries permitted until 2026-05-21 21:21:56.476249925 +0000 UTC m=+42.164625230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert") pod "ingress-canary-xff2c" (UID: "f976c3bf-c462-4143-afdf-d41bb38742e5") : secret "canary-serving-cert" not found
May 21 21:21:55.997106 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:55.997001    2576 generic.go:358] "Generic (PLEG): container finished" podID="d10c924d-f6bc-4673-94e7-ea20e5b2d1e4" containerID="b39aa98cff285a3e71cb6be215882f113765a4d1fefc4ea0c3f10ee72471e9d9" exitCode=0
May 21 21:21:55.997106 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:55.997053    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xclmm" event={"ID":"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4","Type":"ContainerDied","Data":"b39aa98cff285a3e71cb6be215882f113765a4d1fefc4ea0c3f10ee72471e9d9"}
May 21 21:21:56.511540 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:56.511503    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:21:56.511715 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:56.511571    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:21:56.511715 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:56.511649    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:21:56.511715 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:56.511652    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:21:56.511715 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:56.511702    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls podName:9354592a-23e0-44c3-a67c-64cf57490f9e nodeName:}" failed. No retries permitted until 2026-05-21 21:22:04.511687724 +0000 UTC m=+50.200063023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls") pod "dns-default-2wxsq" (UID: "9354592a-23e0-44c3-a67c-64cf57490f9e") : secret "dns-default-metrics-tls" not found
May 21 21:21:56.511715 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:21:56.511715    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert podName:f976c3bf-c462-4143-afdf-d41bb38742e5 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:04.511708859 +0000 UTC m=+50.200084158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert") pod "ingress-canary-xff2c" (UID: "f976c3bf-c462-4143-afdf-d41bb38742e5") : secret "canary-serving-cert" not found
May 21 21:21:57.001542 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:57.001504    2576 generic.go:358] "Generic (PLEG): container finished" podID="d10c924d-f6bc-4673-94e7-ea20e5b2d1e4" containerID="0c7de74785d13b4c23444d966b31b8e6cc8ea018824831151bbe13f7c5d31935" exitCode=0
May 21 21:21:57.001881 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:57.001573    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xclmm" event={"ID":"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4","Type":"ContainerDied","Data":"0c7de74785d13b4c23444d966b31b8e6cc8ea018824831151bbe13f7c5d31935"}
May 21 21:21:58.005975 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:58.005938    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xclmm" event={"ID":"d10c924d-f6bc-4673-94e7-ea20e5b2d1e4","Type":"ContainerStarted","Data":"65584cd8773e376a2be86ffe5e3a35f5f80e240ae0f0c7c52df7defa8dea5167"}
May 21 21:21:58.041849 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:21:58.041793    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xclmm" podStartSLOduration=6.00328131 podStartE2EDuration="44.041776601s" podCreationTimestamp="2026-05-21 21:21:14 +0000 UTC" firstStartedPulling="2026-05-21 21:21:17.424093067 +0000 UTC m=+3.112468371" lastFinishedPulling="2026-05-21 21:21:55.462588363 +0000 UTC m=+41.150963662" observedRunningTime="2026-05-21 21:21:58.041776257 +0000 UTC m=+43.730151582" watchObservedRunningTime="2026-05-21 21:21:58.041776601 +0000 UTC m=+43.730151922"
May 21 21:22:00.338453 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:00.338407    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:22:00.340994 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:00.340961    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c17c1b66-c3b4-4a15-be33-d8febf18700d-original-pull-secret\") pod \"global-pull-secret-syncer-z2fpm\" (UID: \"c17c1b66-c3b4-4a15-be33-d8febf18700d\") " pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:22:00.627051 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:00.626941    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z2fpm"
May 21 21:22:00.814255 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:00.814159    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z2fpm"]
May 21 21:22:00.817890 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:22:00.817862    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc17c1b66_c3b4_4a15_be33_d8febf18700d.slice/crio-27c65052946c0842254361a5d888d7b30c60442772d9d4774f6c5304a14f065c WatchSource:0}: Error finding container 27c65052946c0842254361a5d888d7b30c60442772d9d4774f6c5304a14f065c: Status 404 returned error can't find the container with id 27c65052946c0842254361a5d888d7b30c60442772d9d4774f6c5304a14f065c
May 21 21:22:01.013257 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:01.013165    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z2fpm" event={"ID":"c17c1b66-c3b4-4a15-be33-d8febf18700d","Type":"ContainerStarted","Data":"27c65052946c0842254361a5d888d7b30c60442772d9d4774f6c5304a14f065c"}
May 21 21:22:04.569112 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:04.569073    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:22:04.569618 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:04.569148    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:22:04.569618 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:04.569238    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:22:04.569618 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:04.569271    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:22:04.569618 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:04.569332    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls podName:9354592a-23e0-44c3-a67c-64cf57490f9e nodeName:}" failed. No retries permitted until 2026-05-21 21:22:20.569312351 +0000 UTC m=+66.257687667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls") pod "dns-default-2wxsq" (UID: "9354592a-23e0-44c3-a67c-64cf57490f9e") : secret "dns-default-metrics-tls" not found
May 21 21:22:04.569618 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:04.569353    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert podName:f976c3bf-c462-4143-afdf-d41bb38742e5 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:20.569341441 +0000 UTC m=+66.257716740 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert") pod "ingress-canary-xff2c" (UID: "f976c3bf-c462-4143-afdf-d41bb38742e5") : secret "canary-serving-cert" not found
May 21 21:22:05.021996 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:05.021953    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z2fpm" event={"ID":"c17c1b66-c3b4-4a15-be33-d8febf18700d","Type":"ContainerStarted","Data":"ad6d42f62b5cddd0fad9bba6e8dc2663f406abc4b8f2d496684793e0118cc225"}
May 21 21:22:05.038775 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:05.038723    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z2fpm" podStartSLOduration=33.137348864 podStartE2EDuration="37.038706921s" podCreationTimestamp="2026-05-21 21:21:28 +0000 UTC" firstStartedPulling="2026-05-21 21:22:00.819535051 +0000 UTC m=+46.507910353" lastFinishedPulling="2026-05-21 21:22:04.720893095 +0000 UTC m=+50.409268410" observedRunningTime="2026-05-21 21:22:05.037789589 +0000 UTC m=+50.726164910" watchObservedRunningTime="2026-05-21 21:22:05.038706921 +0000 UTC m=+50.727082236"
May 21 21:22:13.974308 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:13.974274    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2klb"
May 21 21:22:17.606132 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.606098    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2"]
May 21 21:22:17.609333 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.609311    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2"
May 21 21:22:17.611913 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.611892    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 21 21:22:17.612035 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.611921    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-p4mxp\""
May 21 21:22:17.612899 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.612867    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 21 21:22:17.612899 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.612885    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 21 21:22:17.613025 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.612901    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 21 21:22:17.618211 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.618183    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2"]
May 21 21:22:17.639321 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.639290    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"]
May 21 21:22:17.641405 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.641392    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.643727 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.643709    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 21 21:22:17.643831 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.643731    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 21 21:22:17.643831 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.643731    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 21 21:22:17.643831 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.643772    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 21 21:22:17.653664 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.653644    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"]
May 21 21:22:17.669323 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.669302    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ebf42024-a790-4123-86a3-1d177c3fb2a8-hub\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.669431 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.669330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/ebf42024-a790-4123-86a3-1d177c3fb2a8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.669431 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.669349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ebf42024-a790-4123-86a3-1d177c3fb2a8-ca\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.669431 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.669377    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/31600337-eef4-4770-b22c-0dbdcf9e7858-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2\" (UID: \"31600337-eef4-4770-b22c-0dbdcf9e7858\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2"
May 21 21:22:17.669550 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.669436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ebf42024-a790-4123-86a3-1d177c3fb2a8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.669550 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.669465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdv2r\" (UniqueName: \"kubernetes.io/projected/ebf42024-a790-4123-86a3-1d177c3fb2a8-kube-api-access-pdv2r\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.669550 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.669487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ebf42024-a790-4123-86a3-1d177c3fb2a8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.669651 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.669560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb2kj\" (UniqueName: \"kubernetes.io/projected/31600337-eef4-4770-b22c-0dbdcf9e7858-kube-api-access-pb2kj\") pod \"managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2\" (UID: \"31600337-eef4-4770-b22c-0dbdcf9e7858\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2"
May 21 21:22:17.770548 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.770518    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdv2r\" (UniqueName: \"kubernetes.io/projected/ebf42024-a790-4123-86a3-1d177c3fb2a8-kube-api-access-pdv2r\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.770548 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.770553    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ebf42024-a790-4123-86a3-1d177c3fb2a8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.770807 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.770593    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pb2kj\" (UniqueName: \"kubernetes.io/projected/31600337-eef4-4770-b22c-0dbdcf9e7858-kube-api-access-pb2kj\") pod \"managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2\" (UID: \"31600337-eef4-4770-b22c-0dbdcf9e7858\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2"
May 21 21:22:17.770807 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.770621    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ebf42024-a790-4123-86a3-1d177c3fb2a8-hub\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.770807 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.770648    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/ebf42024-a790-4123-86a3-1d177c3fb2a8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.770807 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.770677    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ebf42024-a790-4123-86a3-1d177c3fb2a8-ca\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.770807 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.770716    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/31600337-eef4-4770-b22c-0dbdcf9e7858-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2\" (UID: \"31600337-eef4-4770-b22c-0dbdcf9e7858\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2"
May 21 21:22:17.770807 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.770786    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ebf42024-a790-4123-86a3-1d177c3fb2a8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.771542 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.771518    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/ebf42024-a790-4123-86a3-1d177c3fb2a8-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.773258 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.773231    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ebf42024-a790-4123-86a3-1d177c3fb2a8-ca\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.773368 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.773352    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ebf42024-a790-4123-86a3-1d177c3fb2a8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.773435 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.773401    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ebf42024-a790-4123-86a3-1d177c3fb2a8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.773620 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.773596    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ebf42024-a790-4123-86a3-1d177c3fb2a8-hub\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.773677 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.773633    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/31600337-eef4-4770-b22c-0dbdcf9e7858-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2\" (UID: \"31600337-eef4-4770-b22c-0dbdcf9e7858\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2"
May 21 21:22:17.778701 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.778677    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb2kj\" (UniqueName: \"kubernetes.io/projected/31600337-eef4-4770-b22c-0dbdcf9e7858-kube-api-access-pb2kj\") pod \"managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2\" (UID: \"31600337-eef4-4770-b22c-0dbdcf9e7858\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2"
May 21 21:22:17.778797 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.778677    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdv2r\" (UniqueName: \"kubernetes.io/projected/ebf42024-a790-4123-86a3-1d177c3fb2a8-kube-api-access-pdv2r\") pod \"cluster-proxy-proxy-agent-cf6d85444-brxtd\" (UID: \"ebf42024-a790-4123-86a3-1d177c3fb2a8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:17.925368 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.925253    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2"
May 21 21:22:17.949340 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:17.949310    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:22:18.067617 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:18.067580    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2"]
May 21 21:22:18.070932 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:22:18.070905    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31600337_eef4_4770_b22c_0dbdcf9e7858.slice/crio-cb7dfe5cacf8d7ead092b738a12ca01fcf63539cedf3aa38ece0c21e0cbbadc7 WatchSource:0}: Error finding container cb7dfe5cacf8d7ead092b738a12ca01fcf63539cedf3aa38ece0c21e0cbbadc7: Status 404 returned error can't find the container with id cb7dfe5cacf8d7ead092b738a12ca01fcf63539cedf3aa38ece0c21e0cbbadc7
May 21 21:22:18.092188 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:18.092136    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"]
May 21 21:22:18.095644 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:22:18.095617    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebf42024_a790_4123_86a3_1d177c3fb2a8.slice/crio-f59c555c27f3ab74f36ff536980602d5a856340979a7224159a3b1633c342f16 WatchSource:0}: Error finding container f59c555c27f3ab74f36ff536980602d5a856340979a7224159a3b1633c342f16: Status 404 returned error can't find the container with id f59c555c27f3ab74f36ff536980602d5a856340979a7224159a3b1633c342f16
May 21 21:22:19.053323 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:19.053268    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd" event={"ID":"ebf42024-a790-4123-86a3-1d177c3fb2a8","Type":"ContainerStarted","Data":"f59c555c27f3ab74f36ff536980602d5a856340979a7224159a3b1633c342f16"}
May 21 21:22:19.054397 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:19.054365    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2" event={"ID":"31600337-eef4-4770-b22c-0dbdcf9e7858","Type":"ContainerStarted","Data":"cb7dfe5cacf8d7ead092b738a12ca01fcf63539cedf3aa38ece0c21e0cbbadc7"}
May 21 21:22:20.591780 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:20.591744    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:22:20.592350 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:20.591821    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:22:20.592350 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:20.591898    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:22:20.592350 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:20.591919    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:22:20.592350 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:20.591994    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:22:20.592350 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:20.592006    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert podName:f976c3bf-c462-4143-afdf-d41bb38742e5 nodeName:}" failed. No retries permitted until 2026-05-21 21:22:52.591969994 +0000 UTC m=+98.280345294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert") pod "ingress-canary-xff2c" (UID: "f976c3bf-c462-4143-afdf-d41bb38742e5") : secret "canary-serving-cert" not found
May 21 21:22:20.592350 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:20.592045    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls podName:9354592a-23e0-44c3-a67c-64cf57490f9e nodeName:}" failed. No retries permitted until 2026-05-21 21:22:52.592030115 +0000 UTC m=+98.280405415 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls") pod "dns-default-2wxsq" (UID: "9354592a-23e0-44c3-a67c-64cf57490f9e") : secret "dns-default-metrics-tls" not found
May 21 21:22:20.594277 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:20.594246    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 21:22:20.602566 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:20.602527    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 21:22:20.602764 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:20.602625    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs podName:9f8199a0-fb92-4453-82c2-a9613c455612 nodeName:}" failed. No retries permitted until 2026-05-21 21:23:24.602597689 +0000 UTC m=+130.290973003 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs") pod "network-metrics-daemon-scfdw" (UID: "9f8199a0-fb92-4453-82c2-a9613c455612") : secret "metrics-daemon-secret" not found
May 21 21:22:20.692469 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:20.692426    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-446rt\" (UniqueName: \"kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt\") pod \"network-check-target-wmrfp\" (UID: \"3619f5ba-a927-4dfb-a50e-e092f1f16e4e\") " pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:22:20.695345 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:20.695314    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 21:22:20.706176 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:20.706142    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 21:22:20.717331 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:20.717303    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-446rt\" (UniqueName: \"kubernetes.io/projected/3619f5ba-a927-4dfb-a50e-e092f1f16e4e-kube-api-access-446rt\") pod \"network-check-target-wmrfp\" (UID: \"3619f5ba-a927-4dfb-a50e-e092f1f16e4e\") " pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:22:20.724721 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:20.724687    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xmr9w\""
May 21 21:22:20.732899 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:20.732862    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:22:22.124115 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:22.124088    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wmrfp"]
May 21 21:22:22.127153 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:22:22.127129    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3619f5ba_a927_4dfb_a50e_e092f1f16e4e.slice/crio-e31aae3532d2c3f9afce450302610d18c118d1c3d290aa9ef732fde7041a2b70 WatchSource:0}: Error finding container e31aae3532d2c3f9afce450302610d18c118d1c3d290aa9ef732fde7041a2b70: Status 404 returned error can't find the container with id e31aae3532d2c3f9afce450302610d18c118d1c3d290aa9ef732fde7041a2b70
May 21 21:22:23.063711 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:23.063665    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd" event={"ID":"ebf42024-a790-4123-86a3-1d177c3fb2a8","Type":"ContainerStarted","Data":"535aea93efd321b13ab124873b38da99eb12a536596b7ce551a29441c99241c1"}
May 21 21:22:23.064842 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:23.064810    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wmrfp" event={"ID":"3619f5ba-a927-4dfb-a50e-e092f1f16e4e","Type":"ContainerStarted","Data":"e31aae3532d2c3f9afce450302610d18c118d1c3d290aa9ef732fde7041a2b70"}
May 21 21:22:23.066148 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:23.066096    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2" event={"ID":"31600337-eef4-4770-b22c-0dbdcf9e7858","Type":"ContainerStarted","Data":"de93edd3d6b80545d46c79f24cbd807d83d368af7674acab5cc20744903cffea"}
May 21 21:22:23.081236 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:23.081188    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f8bf4c4c6-8jgt2" podStartSLOduration=2.099231746 podStartE2EDuration="6.081171014s" podCreationTimestamp="2026-05-21 21:22:17 +0000 UTC" firstStartedPulling="2026-05-21 21:22:18.072898444 +0000 UTC m=+63.761273746" lastFinishedPulling="2026-05-21 21:22:22.0548377 +0000 UTC m=+67.743213014" observedRunningTime="2026-05-21 21:22:23.080321283 +0000 UTC m=+68.768696605" watchObservedRunningTime="2026-05-21 21:22:23.081171014 +0000 UTC m=+68.769546679"
May 21 21:22:27.076732 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:27.076687    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd" event={"ID":"ebf42024-a790-4123-86a3-1d177c3fb2a8","Type":"ContainerStarted","Data":"c832218619d2c07cd6f68939b6e035a72009d4f086de2debb842e19d3ff9ed48"}
May 21 21:22:27.076732 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:27.076731    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd" event={"ID":"ebf42024-a790-4123-86a3-1d177c3fb2a8","Type":"ContainerStarted","Data":"203ae33a9f5209dde063916072b42a75a3eb3db56b39056ad00fb10057d1b5eb"}
May 21 21:22:27.077947 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:27.077914    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wmrfp" event={"ID":"3619f5ba-a927-4dfb-a50e-e092f1f16e4e","Type":"ContainerStarted","Data":"1fab4de8a9f8666b8ae6d999acabaa1085828bdcb96c541a19bb66d8858207ce"}
May 21 21:22:27.078083 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:27.078060    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:22:27.096598 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:27.096558    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd" podStartSLOduration=1.905863536 podStartE2EDuration="10.096546806s" podCreationTimestamp="2026-05-21 21:22:17 +0000 UTC" firstStartedPulling="2026-05-21 21:22:18.097387851 +0000 UTC m=+63.785763150" lastFinishedPulling="2026-05-21 21:22:26.288071119 +0000 UTC m=+71.976446420" observedRunningTime="2026-05-21 21:22:27.094665829 +0000 UTC m=+72.783041364" watchObservedRunningTime="2026-05-21 21:22:27.096546806 +0000 UTC m=+72.784922126"
May 21 21:22:27.109442 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:27.109292    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wmrfp" podStartSLOduration=68.948144647 podStartE2EDuration="1m13.109276433s" podCreationTimestamp="2026-05-21 21:21:14 +0000 UTC" firstStartedPulling="2026-05-21 21:22:22.129068334 +0000 UTC m=+67.817443632" lastFinishedPulling="2026-05-21 21:22:26.29020012 +0000 UTC m=+71.978575418" observedRunningTime="2026-05-21 21:22:27.109233291 +0000 UTC m=+72.797608612" watchObservedRunningTime="2026-05-21 21:22:27.109276433 +0000 UTC m=+72.797651756"
May 21 21:22:52.632400 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:52.632349    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:22:52.632860 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:52.632439    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:22:52.632860 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:52.632513    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 21:22:52.632860 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:52.632532    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 21:22:52.632860 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:52.632587    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert podName:f976c3bf-c462-4143-afdf-d41bb38742e5 nodeName:}" failed. No retries permitted until 2026-05-21 21:23:56.632568819 +0000 UTC m=+162.320944117 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert") pod "ingress-canary-xff2c" (UID: "f976c3bf-c462-4143-afdf-d41bb38742e5") : secret "canary-serving-cert" not found
May 21 21:22:52.632860 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:22:52.632602    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls podName:9354592a-23e0-44c3-a67c-64cf57490f9e nodeName:}" failed. No retries permitted until 2026-05-21 21:23:56.632595643 +0000 UTC m=+162.320970942 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls") pod "dns-default-2wxsq" (UID: "9354592a-23e0-44c3-a67c-64cf57490f9e") : secret "dns-default-metrics-tls" not found
May 21 21:22:53.959792 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:53.959765    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k7cdj_abd86fab-2669-4fe7-b5f0-25d4b3311ca1/dns-node-resolver/0.log"
May 21 21:22:54.559345 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:54.559317    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4m8zj_8959993d-94c0-4577-a84b-345a567afd85/node-ca/0.log"
May 21 21:22:58.081926 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:22:58.081890    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wmrfp"
May 21 21:23:20.450320 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.450282    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c9489dbd7-8tb4p"]
May 21 21:23:20.453284 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.453264    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.456588 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.456553    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 21:23:20.456813 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.456793    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tbbwf\""
May 21 21:23:20.457832 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.457816    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 21:23:20.457905 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.457861    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 21:23:20.461904 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.461888    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 21:23:20.465413 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.465389    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s7z78"]
May 21 21:23:20.468461 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.468444    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.468897 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.468878    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9489dbd7-8tb4p"]
May 21 21:23:20.470776 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.470755    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-w6tpj\""
May 21 21:23:20.470972 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.470937    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 21:23:20.471070 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.471053    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 21:23:20.471129 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.471075    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 21:23:20.471524 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.471510    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 21:23:20.485570 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.485548    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s7z78"]
May 21 21:23:20.492418 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.492399    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c9489dbd7-8tb4p"]
May 21 21:23:20.492558 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:23:20.492539    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-t8xtx registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-t8xtx registry-certificates registry-tls trusted-ca]: context canceled" pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p" podUID="f3b9df46-1e80-4488-a3d7-800fa4962165"
May 21 21:23:20.528696 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.528662    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-bound-sa-token\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.528696 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.528705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8xtx\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-kube-api-access-t8xtx\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.528842 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.528726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-registry-tls\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.528842 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.528762    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3b9df46-1e80-4488-a3d7-800fa4962165-ca-trust-extracted\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.528842 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.528839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3b9df46-1e80-4488-a3d7-800fa4962165-registry-certificates\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.528934 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.528874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3b9df46-1e80-4488-a3d7-800fa4962165-trusted-ca\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.528934 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.528892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3b9df46-1e80-4488-a3d7-800fa4962165-image-registry-private-configuration\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.528934 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.528925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a972374-4882-4306-835c-5879be26a155-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.529090 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.528947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq7zn\" (UniqueName: \"kubernetes.io/projected/4a972374-4882-4306-835c-5879be26a155-kube-api-access-fq7zn\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.529090 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.528966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3b9df46-1e80-4488-a3d7-800fa4962165-installation-pull-secrets\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.529090 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.528996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a972374-4882-4306-835c-5879be26a155-crio-socket\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.529090 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.529012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a972374-4882-4306-835c-5879be26a155-data-volume\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.529090 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.529026    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a972374-4882-4306-835c-5879be26a155-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.630052 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630029    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-bound-sa-token\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.630171 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630060    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t8xtx\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-kube-api-access-t8xtx\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.630171 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630083    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-registry-tls\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.630171 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630114    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3b9df46-1e80-4488-a3d7-800fa4962165-ca-trust-extracted\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.630171 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630158    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3b9df46-1e80-4488-a3d7-800fa4962165-registry-certificates\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.630361 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630195    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3b9df46-1e80-4488-a3d7-800fa4962165-trusted-ca\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.630361 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630224    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3b9df46-1e80-4488-a3d7-800fa4962165-image-registry-private-configuration\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.630361 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630267    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a972374-4882-4306-835c-5879be26a155-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.630361 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630290    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fq7zn\" (UniqueName: \"kubernetes.io/projected/4a972374-4882-4306-835c-5879be26a155-kube-api-access-fq7zn\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.630577 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630557    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3b9df46-1e80-4488-a3d7-800fa4962165-ca-trust-extracted\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.630631 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630613    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3b9df46-1e80-4488-a3d7-800fa4962165-installation-pull-secrets\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.630685 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630648    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a972374-4882-4306-835c-5879be26a155-crio-socket\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.630685 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630680    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a972374-4882-4306-835c-5879be26a155-data-volume\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.630791 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630706    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a972374-4882-4306-835c-5879be26a155-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.630850 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630838    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a972374-4882-4306-835c-5879be26a155-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.631264 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.630911    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a972374-4882-4306-835c-5879be26a155-crio-socket\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.631264 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.631090    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3b9df46-1e80-4488-a3d7-800fa4962165-registry-certificates\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.631264 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.631217    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a972374-4882-4306-835c-5879be26a155-data-volume\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.631264 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.631219    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3b9df46-1e80-4488-a3d7-800fa4962165-trusted-ca\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.632831 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.632805    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-registry-tls\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.632933 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.632872    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3b9df46-1e80-4488-a3d7-800fa4962165-image-registry-private-configuration\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.632933 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.632897    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a972374-4882-4306-835c-5879be26a155-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.633048 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.633031    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3b9df46-1e80-4488-a3d7-800fa4962165-installation-pull-secrets\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.641383 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.641354    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-bound-sa-token\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.641600 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.641579    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8xtx\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-kube-api-access-t8xtx\") pod \"image-registry-c9489dbd7-8tb4p\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") " pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:20.641784 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.641766    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq7zn\" (UniqueName: \"kubernetes.io/projected/4a972374-4882-4306-835c-5879be26a155-kube-api-access-fq7zn\") pod \"insights-runtime-extractor-s7z78\" (UID: \"4a972374-4882-4306-835c-5879be26a155\") " pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.776883 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.776859    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s7z78"
May 21 21:23:20.913969 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:20.913927    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s7z78"]
May 21 21:23:20.919260 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:23:20.919220    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a972374_4882_4306_835c_5879be26a155.slice/crio-316c548ddab99cb5a52c64567621e91bd3c0fa245d5e4e5c5971eeab53745547 WatchSource:0}: Error finding container 316c548ddab99cb5a52c64567621e91bd3c0fa245d5e4e5c5971eeab53745547: Status 404 returned error can't find the container with id 316c548ddab99cb5a52c64567621e91bd3c0fa245d5e4e5c5971eeab53745547
May 21 21:23:21.207416 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.207316    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:21.207416 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.207333    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s7z78" event={"ID":"4a972374-4882-4306-835c-5879be26a155","Type":"ContainerStarted","Data":"6071728120b83764a825b59ecd013691c0e1297652e098416ee1693172cfb97a"}
May 21 21:23:21.207416 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.207366    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s7z78" event={"ID":"4a972374-4882-4306-835c-5879be26a155","Type":"ContainerStarted","Data":"316c548ddab99cb5a52c64567621e91bd3c0fa245d5e4e5c5971eeab53745547"}
May 21 21:23:21.211825 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.211793    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:21.234227 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.234193    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3b9df46-1e80-4488-a3d7-800fa4962165-image-registry-private-configuration\") pod \"f3b9df46-1e80-4488-a3d7-800fa4962165\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") "
May 21 21:23:21.234227 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.234231    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-bound-sa-token\") pod \"f3b9df46-1e80-4488-a3d7-800fa4962165\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") "
May 21 21:23:21.234470 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.234266    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8xtx\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-kube-api-access-t8xtx\") pod \"f3b9df46-1e80-4488-a3d7-800fa4962165\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") "
May 21 21:23:21.234470 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.234288    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3b9df46-1e80-4488-a3d7-800fa4962165-ca-trust-extracted\") pod \"f3b9df46-1e80-4488-a3d7-800fa4962165\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") "
May 21 21:23:21.234470 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.234315    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3b9df46-1e80-4488-a3d7-800fa4962165-installation-pull-secrets\") pod \"f3b9df46-1e80-4488-a3d7-800fa4962165\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") "
May 21 21:23:21.234470 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.234352    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3b9df46-1e80-4488-a3d7-800fa4962165-registry-certificates\") pod \"f3b9df46-1e80-4488-a3d7-800fa4962165\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") "
May 21 21:23:21.234470 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.234370    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-registry-tls\") pod \"f3b9df46-1e80-4488-a3d7-800fa4962165\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") "
May 21 21:23:21.234470 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.234390    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3b9df46-1e80-4488-a3d7-800fa4962165-trusted-ca\") pod \"f3b9df46-1e80-4488-a3d7-800fa4962165\" (UID: \"f3b9df46-1e80-4488-a3d7-800fa4962165\") "
May 21 21:23:21.234773 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.234563    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3b9df46-1e80-4488-a3d7-800fa4962165-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f3b9df46-1e80-4488-a3d7-800fa4962165" (UID: "f3b9df46-1e80-4488-a3d7-800fa4962165"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:23:21.234829 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.234808    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3b9df46-1e80-4488-a3d7-800fa4962165-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f3b9df46-1e80-4488-a3d7-800fa4962165" (UID: "f3b9df46-1e80-4488-a3d7-800fa4962165"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:23:21.234930 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.234909    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3b9df46-1e80-4488-a3d7-800fa4962165-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f3b9df46-1e80-4488-a3d7-800fa4962165" (UID: "f3b9df46-1e80-4488-a3d7-800fa4962165"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:23:21.236679 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.236641    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3b9df46-1e80-4488-a3d7-800fa4962165-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f3b9df46-1e80-4488-a3d7-800fa4962165" (UID: "f3b9df46-1e80-4488-a3d7-800fa4962165"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:23:21.236799 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.236737    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f3b9df46-1e80-4488-a3d7-800fa4962165" (UID: "f3b9df46-1e80-4488-a3d7-800fa4962165"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:23:21.236844 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.236810    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f3b9df46-1e80-4488-a3d7-800fa4962165" (UID: "f3b9df46-1e80-4488-a3d7-800fa4962165"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:23:21.236885 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.236863    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-kube-api-access-t8xtx" (OuterVolumeSpecName: "kube-api-access-t8xtx") pod "f3b9df46-1e80-4488-a3d7-800fa4962165" (UID: "f3b9df46-1e80-4488-a3d7-800fa4962165"). InnerVolumeSpecName "kube-api-access-t8xtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:23:21.236946 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.236932    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3b9df46-1e80-4488-a3d7-800fa4962165-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f3b9df46-1e80-4488-a3d7-800fa4962165" (UID: "f3b9df46-1e80-4488-a3d7-800fa4962165"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:23:21.335938 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.335866    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3b9df46-1e80-4488-a3d7-800fa4962165-registry-certificates\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:23:21.335938 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.335931    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-registry-tls\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:23:21.335938 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.335940    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3b9df46-1e80-4488-a3d7-800fa4962165-trusted-ca\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:23:21.336194 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.335951    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3b9df46-1e80-4488-a3d7-800fa4962165-image-registry-private-configuration\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:23:21.336194 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.335961    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-bound-sa-token\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:23:21.336194 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.335971    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8xtx\" (UniqueName: \"kubernetes.io/projected/f3b9df46-1e80-4488-a3d7-800fa4962165-kube-api-access-t8xtx\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:23:21.336194 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.336008    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3b9df46-1e80-4488-a3d7-800fa4962165-ca-trust-extracted\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:23:21.336194 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:21.336024    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3b9df46-1e80-4488-a3d7-800fa4962165-installation-pull-secrets\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:23:22.210908 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:22.210877    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9489dbd7-8tb4p"
May 21 21:23:22.210908 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:22.210891    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s7z78" event={"ID":"4a972374-4882-4306-835c-5879be26a155","Type":"ContainerStarted","Data":"21bbf373683d35304ec5d1a870b5d768281d8d19035268290ce0961be7ac4dd6"}
May 21 21:23:22.247305 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:22.247265    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c9489dbd7-8tb4p"]
May 21 21:23:22.248139 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:22.248116    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c9489dbd7-8tb4p"]
May 21 21:23:22.804523 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:22.804492    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3b9df46-1e80-4488-a3d7-800fa4962165" path="/var/lib/kubelet/pods/f3b9df46-1e80-4488-a3d7-800fa4962165/volumes"
May 21 21:23:24.219527 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:24.219482    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s7z78" event={"ID":"4a972374-4882-4306-835c-5879be26a155","Type":"ContainerStarted","Data":"72d79e19a5dab4b9a034fd56990cc107d9bb74c25c2da1ea13fe2c242e627904"}
May 21 21:23:24.237869 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:24.237817    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s7z78" podStartSLOduration=1.7165535250000001 podStartE2EDuration="4.237801613s" podCreationTimestamp="2026-05-21 21:23:20 +0000 UTC" firstStartedPulling="2026-05-21 21:23:20.981271622 +0000 UTC m=+126.669646928" lastFinishedPulling="2026-05-21 21:23:23.502519714 +0000 UTC m=+129.190895016" observedRunningTime="2026-05-21 21:23:24.237397183 +0000 UTC m=+129.925772505" watchObservedRunningTime="2026-05-21 21:23:24.237801613 +0000 UTC m=+129.926176957"
May 21 21:23:24.667688 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:24.667644    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:23:24.669968 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:24.669943    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f8199a0-fb92-4453-82c2-a9613c455612-metrics-certs\") pod \"network-metrics-daemon-scfdw\" (UID: \"9f8199a0-fb92-4453-82c2-a9613c455612\") " pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:23:24.916031 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:24.915976    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jqv7p\""
May 21 21:23:24.924194 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:24.924136    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-scfdw"
May 21 21:23:25.049575 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:25.049537    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-scfdw"]
May 21 21:23:25.053199 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:23:25.053170    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8199a0_fb92_4453_82c2_a9613c455612.slice/crio-ee5aa0ad6bcf1b50f7ae59ff070a2f730dc660973bba81199cca189422fcb945 WatchSource:0}: Error finding container ee5aa0ad6bcf1b50f7ae59ff070a2f730dc660973bba81199cca189422fcb945: Status 404 returned error can't find the container with id ee5aa0ad6bcf1b50f7ae59ff070a2f730dc660973bba81199cca189422fcb945
May 21 21:23:25.222642 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:25.222566    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-scfdw" event={"ID":"9f8199a0-fb92-4453-82c2-a9613c455612","Type":"ContainerStarted","Data":"ee5aa0ad6bcf1b50f7ae59ff070a2f730dc660973bba81199cca189422fcb945"}
May 21 21:23:26.227078 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:26.227042    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-scfdw" event={"ID":"9f8199a0-fb92-4453-82c2-a9613c455612","Type":"ContainerStarted","Data":"0a747f29a4eb0348feb77a10b708428c63f5d1ec40d0b6cbe40776b43425567a"}
May 21 21:23:27.230695 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:27.230654    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-scfdw" event={"ID":"9f8199a0-fb92-4453-82c2-a9613c455612","Type":"ContainerStarted","Data":"4702608cef3596c5095465ed069d26993d0596d4d543144776b85eaac9c63d14"}
May 21 21:23:27.246815 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:27.246509    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-scfdw" podStartSLOduration=132.175522705 podStartE2EDuration="2m13.246493491s" podCreationTimestamp="2026-05-21 21:21:14 +0000 UTC" firstStartedPulling="2026-05-21 21:23:25.054973998 +0000 UTC m=+130.743349302" lastFinishedPulling="2026-05-21 21:23:26.125944779 +0000 UTC m=+131.814320088" observedRunningTime="2026-05-21 21:23:27.244962126 +0000 UTC m=+132.933337462" watchObservedRunningTime="2026-05-21 21:23:27.246493491 +0000 UTC m=+132.934868813"
May 21 21:23:31.486023 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.485966    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"]
May 21 21:23:31.489158 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.489139    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.491800 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.491781    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 21 21:23:31.492839 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.492823    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 21:23:31.492839 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.492839    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 21 21:23:31.493012 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.492857    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 21:23:31.493012 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.492905    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 21 21:23:31.493012 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.492928    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 21:23:31.493012 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.492859    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-69bjb\""
May 21 21:23:31.507514 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.507491    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"]
May 21 21:23:31.511135 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.511115    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b7tdj"]
May 21 21:23:31.514115 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.514096    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.514750 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.514731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e58c47e6-e31d-479a-887f-0ac09a4f296a-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.514818 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.514771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.514859 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.514840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz2x2\" (UniqueName: \"kubernetes.io/projected/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-api-access-fz2x2\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.514900 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.514874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e58c47e6-e31d-479a-887f-0ac09a4f296a-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.514977 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.514961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.515044 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.515022    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.516609 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.516559    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 21:23:31.516878 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.516564    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lb4kv\""
May 21 21:23:31.517449 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.517288    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 21:23:31.517449 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.517324    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 21:23:31.616274 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616231    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.616477 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616292    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-tls\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.616477 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616329    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e58c47e6-e31d-479a-887f-0ac09a4f296a-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.616477 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616352    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-metrics-client-ca\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.616477 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616417    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.616477 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-sys\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.616477 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:23:31.616475    2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 21 21:23:31.616759 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:23:31.616540    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-state-metrics-tls podName:e58c47e6-e31d-479a-887f-0ac09a4f296a nodeName:}" failed. No retries permitted until 2026-05-21 21:23:32.116517776 +0000 UTC m=+137.804893077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-6rrsj" (UID: "e58c47e6-e31d-479a-887f-0ac09a4f296a") : secret "kube-state-metrics-tls" not found
May 21 21:23:31.616759 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-accelerators-collector-config\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.616759 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8ksg\" (UniqueName: \"kubernetes.io/projected/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-kube-api-access-c8ksg\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.616759 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616621    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-wtmp\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.616759 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616651    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fz2x2\" (UniqueName: \"kubernetes.io/projected/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-api-access-fz2x2\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.616759 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616702    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e58c47e6-e31d-479a-887f-0ac09a4f296a-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.616759 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.617139 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616788    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-root\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.617139 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616828    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-textfile\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.617139 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.616912    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.617139 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.617022    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e58c47e6-e31d-479a-887f-0ac09a4f296a-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.617139 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.617098    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e58c47e6-e31d-479a-887f-0ac09a4f296a-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.617536 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.617513    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.618639 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.618618    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.624954 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.624933    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz2x2\" (UniqueName: \"kubernetes.io/projected/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-api-access-fz2x2\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:31.717409 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.717371    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.717581 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.717419    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-root\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.717581 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.717466    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-root\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.717581 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.717494    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-textfile\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.717581 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.717549    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-tls\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.717780 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.717579    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-metrics-client-ca\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.717780 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.717623    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-sys\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.717780 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.717649    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-accelerators-collector-config\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.717780 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.717672    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ksg\" (UniqueName: \"kubernetes.io/projected/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-kube-api-access-c8ksg\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.717780 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.717702    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-wtmp\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.718048 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.717797    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-sys\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.718048 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.717867    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-wtmp\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.718048 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.717870    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-textfile\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.718238 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.718216    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-metrics-client-ca\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.718307 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.718256    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-accelerators-collector-config\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.719791 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.719771    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.719867 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.719857    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-node-exporter-tls\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.726015 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.725971    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8ksg\" (UniqueName: \"kubernetes.io/projected/5f5d86a3-efd0-4ab7-860f-a9bfd78b974f-kube-api-access-c8ksg\") pod \"node-exporter-b7tdj\" (UID: \"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f\") " pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.824211 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:31.824184    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b7tdj"
May 21 21:23:31.832021 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:23:31.831973    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5d86a3_efd0_4ab7_860f_a9bfd78b974f.slice/crio-4ba600b6bedc89852f0558240cbc682355c007bb03b4d04d4f037aafa0b98ac8 WatchSource:0}: Error finding container 4ba600b6bedc89852f0558240cbc682355c007bb03b4d04d4f037aafa0b98ac8: Status 404 returned error can't find the container with id 4ba600b6bedc89852f0558240cbc682355c007bb03b4d04d4f037aafa0b98ac8
May 21 21:23:32.120697 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:32.120620    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:32.122873 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:32.122851    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e58c47e6-e31d-479a-887f-0ac09a4f296a-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-6rrsj\" (UID: \"e58c47e6-e31d-479a-887f-0ac09a4f296a\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:32.244893 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:32.244855    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b7tdj" event={"ID":"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f","Type":"ContainerStarted","Data":"4ba600b6bedc89852f0558240cbc682355c007bb03b4d04d4f037aafa0b98ac8"}
May 21 21:23:32.398134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:32.398059    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"
May 21 21:23:32.535553 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:32.535518    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj"]
May 21 21:23:32.725601 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:23:32.725527    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode58c47e6_e31d_479a_887f_0ac09a4f296a.slice/crio-89d7de76e0753dd89b050e9c8207600060d9b5eea9f7a28bb696f06336a8737c WatchSource:0}: Error finding container 89d7de76e0753dd89b050e9c8207600060d9b5eea9f7a28bb696f06336a8737c: Status 404 returned error can't find the container with id 89d7de76e0753dd89b050e9c8207600060d9b5eea9f7a28bb696f06336a8737c
May 21 21:23:33.248541 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:33.248507    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj" event={"ID":"e58c47e6-e31d-479a-887f-0ac09a4f296a","Type":"ContainerStarted","Data":"89d7de76e0753dd89b050e9c8207600060d9b5eea9f7a28bb696f06336a8737c"}
May 21 21:23:33.249878 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:33.249850    2576 generic.go:358] "Generic (PLEG): container finished" podID="5f5d86a3-efd0-4ab7-860f-a9bfd78b974f" containerID="7290046674c7f906805706291bae65ddcbe5b4881c00a0d5d3cffefd52aef5e7" exitCode=0
May 21 21:23:33.250026 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:33.249885    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b7tdj" event={"ID":"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f","Type":"ContainerDied","Data":"7290046674c7f906805706291bae65ddcbe5b4881c00a0d5d3cffefd52aef5e7"}
May 21 21:23:34.254243 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:34.254212    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj" event={"ID":"e58c47e6-e31d-479a-887f-0ac09a4f296a","Type":"ContainerStarted","Data":"893c6e0412a0e05b4af5cacfd9516c67d7ba6118d7c9fd61971d032683c82c99"}
May 21 21:23:34.254647 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:34.254254    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj" event={"ID":"e58c47e6-e31d-479a-887f-0ac09a4f296a","Type":"ContainerStarted","Data":"130168a7d7b5d0bd7478c3b4c0e12046ec80751685b2f2617c813b77aa01131c"}
May 21 21:23:34.256364 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:34.256339    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b7tdj" event={"ID":"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f","Type":"ContainerStarted","Data":"65134239165e3ad96a091888915432b2de6af8483c2198ac7a23dec7eefea929"}
May 21 21:23:34.256478 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:34.256369    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b7tdj" event={"ID":"5f5d86a3-efd0-4ab7-860f-a9bfd78b974f","Type":"ContainerStarted","Data":"24ca1954e646734a3e872223e108423eba9a742a6ce5dac9476c02a5b4b36f62"}
May 21 21:23:34.278660 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:34.278593    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b7tdj" podStartSLOduration=2.342590808 podStartE2EDuration="3.278570455s" podCreationTimestamp="2026-05-21 21:23:31 +0000 UTC" firstStartedPulling="2026-05-21 21:23:31.833487762 +0000 UTC m=+137.521863061" lastFinishedPulling="2026-05-21 21:23:32.769467409 +0000 UTC m=+138.457842708" observedRunningTime="2026-05-21 21:23:34.276849261 +0000 UTC m=+139.965224606" watchObservedRunningTime="2026-05-21 21:23:34.278570455 +0000 UTC m=+139.966945777"
May 21 21:23:35.261041 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:35.260997    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj" event={"ID":"e58c47e6-e31d-479a-887f-0ac09a4f296a","Type":"ContainerStarted","Data":"c8941d08c164cd801e9e21ef16ff21457dd68facd4d516769d48ab430781d1f2"}
May 21 21:23:35.279881 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:35.279833    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-6rrsj" podStartSLOduration=2.9421510079999997 podStartE2EDuration="4.279820812s" podCreationTimestamp="2026-05-21 21:23:31 +0000 UTC" firstStartedPulling="2026-05-21 21:23:32.727406322 +0000 UTC m=+138.415781640" lastFinishedPulling="2026-05-21 21:23:34.065076133 +0000 UTC m=+139.753451444" observedRunningTime="2026-05-21 21:23:35.278468367 +0000 UTC m=+140.966843726" watchObservedRunningTime="2026-05-21 21:23:35.279820812 +0000 UTC m=+140.968196133"
May 21 21:23:47.950506 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:47.950454    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd" podUID="ebf42024-a790-4123-86a3-1d177c3fb2a8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 21:23:51.735970 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:23:51.735920    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2wxsq" podUID="9354592a-23e0-44c3-a67c-64cf57490f9e"
May 21 21:23:51.746099 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:23:51.746067    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-xff2c" podUID="f976c3bf-c462-4143-afdf-d41bb38742e5"
May 21 21:23:52.302423 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:52.302389    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2wxsq"
May 21 21:23:53.250147 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.250105    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-cc65cd5bb-4fmnn"]
May 21 21:23:53.254127 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.254097    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.257829 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.257798    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 21 21:23:53.258039 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.257862    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 21 21:23:53.258039 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.257891    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g9zpv\""
May 21 21:23:53.258039 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.257919    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 21 21:23:53.258039 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.258000    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 21 21:23:53.258039 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.257798    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 21 21:23:53.258315 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.258215    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 21 21:23:53.258369 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.258343    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 21 21:23:53.263928 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.263899    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cc65cd5bb-4fmnn"]
May 21 21:23:53.403799 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.403753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8f66\" (UniqueName: \"kubernetes.io/projected/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-kube-api-access-v8f66\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.404022 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.403873    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-oauth-config\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.404022 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.403915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-oauth-serving-cert\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.404022 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.403936    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-serving-cert\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.404022 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.403963    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-service-ca\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.404188 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.404110    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-config\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.504826 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.504735    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8f66\" (UniqueName: \"kubernetes.io/projected/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-kube-api-access-v8f66\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.504826 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.504810    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-oauth-config\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.505061 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.504837    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-oauth-serving-cert\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.505061 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.504857    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-serving-cert\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.505061 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.504879    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-service-ca\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.505061 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.504928    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-config\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.505674 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.505644    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-oauth-serving-cert\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.505674 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.505659    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-service-ca\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.505820 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.505648    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-config\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.507477 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.507443    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-oauth-config\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.507620 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.507595    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-serving-cert\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.513516 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.513487    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8f66\" (UniqueName: \"kubernetes.io/projected/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-kube-api-access-v8f66\") pod \"console-cc65cd5bb-4fmnn\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") " pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.564757 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.564713    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:23:53.694734 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:53.694694    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cc65cd5bb-4fmnn"]
May 21 21:23:53.698023 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:23:53.697975    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d2dfa8_60f0_4093_84a9_ca4a436e3cb0.slice/crio-d0e0f1257959ef405d49ec5a034982c29ec0fb21a033b5c470715e9c08c46b98 WatchSource:0}: Error finding container d0e0f1257959ef405d49ec5a034982c29ec0fb21a033b5c470715e9c08c46b98: Status 404 returned error can't find the container with id d0e0f1257959ef405d49ec5a034982c29ec0fb21a033b5c470715e9c08c46b98
May 21 21:23:54.311028 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:54.310972    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc65cd5bb-4fmnn" event={"ID":"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0","Type":"ContainerStarted","Data":"d0e0f1257959ef405d49ec5a034982c29ec0fb21a033b5c470715e9c08c46b98"}
May 21 21:23:56.633653 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:56.633604    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:23:56.634150 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:56.633691    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:23:56.636435 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:56.636400    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9354592a-23e0-44c3-a67c-64cf57490f9e-metrics-tls\") pod \"dns-default-2wxsq\" (UID: \"9354592a-23e0-44c3-a67c-64cf57490f9e\") " pod="openshift-dns/dns-default-2wxsq"
May 21 21:23:56.636648 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:56.636621    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f976c3bf-c462-4143-afdf-d41bb38742e5-cert\") pod \"ingress-canary-xff2c\" (UID: \"f976c3bf-c462-4143-afdf-d41bb38742e5\") " pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:23:56.805946 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:56.805912    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bvcxl\""
May 21 21:23:56.813108 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:56.813069    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2wxsq"
May 21 21:23:57.034998 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:57.034946    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2wxsq"]
May 21 21:23:57.038334 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:23:57.038293    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9354592a_23e0_44c3_a67c_64cf57490f9e.slice/crio-dfa3bc4378b9e95df1d3caf0e86480da234a8c5c79d312eddf77d3ff2d692371 WatchSource:0}: Error finding container dfa3bc4378b9e95df1d3caf0e86480da234a8c5c79d312eddf77d3ff2d692371: Status 404 returned error can't find the container with id dfa3bc4378b9e95df1d3caf0e86480da234a8c5c79d312eddf77d3ff2d692371
May 21 21:23:57.320323 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:57.320282    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc65cd5bb-4fmnn" event={"ID":"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0","Type":"ContainerStarted","Data":"1b806f1b113a78065269c54b8f13379fd285c800c4f93d8c0911a02c23b4fc58"}
May 21 21:23:57.321330 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:57.321302    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2wxsq" event={"ID":"9354592a-23e0-44c3-a67c-64cf57490f9e","Type":"ContainerStarted","Data":"dfa3bc4378b9e95df1d3caf0e86480da234a8c5c79d312eddf77d3ff2d692371"}
May 21 21:23:57.340859 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:57.340790    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-cc65cd5bb-4fmnn" podStartSLOduration=1.087361301 podStartE2EDuration="4.340769954s" podCreationTimestamp="2026-05-21 21:23:53 +0000 UTC" firstStartedPulling="2026-05-21 21:23:53.700356833 +0000 UTC m=+159.388732135" lastFinishedPulling="2026-05-21 21:23:56.95376548 +0000 UTC m=+162.642140788" observedRunningTime="2026-05-21 21:23:57.34047107 +0000 UTC m=+163.028846392" watchObservedRunningTime="2026-05-21 21:23:57.340769954 +0000 UTC m=+163.029145276"
May 21 21:23:57.950693 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:57.950643    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd" podUID="ebf42024-a790-4123-86a3-1d177c3fb2a8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 21:23:59.329224 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:59.329189    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2wxsq" event={"ID":"9354592a-23e0-44c3-a67c-64cf57490f9e","Type":"ContainerStarted","Data":"0d50ce97274b9785a9ba6bcf6f1537f77e0169e55ceb789075dcfccd441a10ce"}
May 21 21:23:59.329224 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:59.329228    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2wxsq" event={"ID":"9354592a-23e0-44c3-a67c-64cf57490f9e","Type":"ContainerStarted","Data":"fc0bb91bb1dbe9f515fa898671f017ee169b6a029611c20d376238798b1ed0ae"}
May 21 21:23:59.329637 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:59.329320    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2wxsq"
May 21 21:23:59.345354 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:23:59.345306    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-2wxsq" podStartSLOduration=130.126541449 podStartE2EDuration="2m11.34529286s" podCreationTimestamp="2026-05-21 21:21:48 +0000 UTC" firstStartedPulling="2026-05-21 21:23:57.040492383 +0000 UTC m=+162.728867685" lastFinishedPulling="2026-05-21 21:23:58.259243798 +0000 UTC m=+163.947619096" observedRunningTime="2026-05-21 21:23:59.3446673 +0000 UTC m=+165.033042621" watchObservedRunningTime="2026-05-21 21:23:59.34529286 +0000 UTC m=+165.033668180"
May 21 21:24:03.565129 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:03.565086    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:24:03.565129 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:03.565135    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:24:03.570097 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:03.570074    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:24:04.349969 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:04.349930    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:24:05.801405 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:05.801357    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:24:05.804373 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:05.804348    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6c5qz\""
May 21 21:24:05.812734 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:05.812697    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xff2c"
May 21 21:24:05.951911 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:05.951876    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xff2c"]
May 21 21:24:05.955124 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:24:05.955085    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf976c3bf_c462_4143_afdf_d41bb38742e5.slice/crio-9790653593e105713548bbad0dd1f57c4ea3a39d880e02171456a7f8eab8bf6a WatchSource:0}: Error finding container 9790653593e105713548bbad0dd1f57c4ea3a39d880e02171456a7f8eab8bf6a: Status 404 returned error can't find the container with id 9790653593e105713548bbad0dd1f57c4ea3a39d880e02171456a7f8eab8bf6a
May 21 21:24:06.350448 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:06.350415    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xff2c" event={"ID":"f976c3bf-c462-4143-afdf-d41bb38742e5","Type":"ContainerStarted","Data":"9790653593e105713548bbad0dd1f57c4ea3a39d880e02171456a7f8eab8bf6a"}
May 21 21:24:07.950334 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:07.950285    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd" podUID="ebf42024-a790-4123-86a3-1d177c3fb2a8" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 21:24:07.950691 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:07.950363    2576 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd"
May 21 21:24:07.950848 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:07.950817    2576 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c832218619d2c07cd6f68939b6e035a72009d4f086de2debb842e19d3ff9ed48"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 21 21:24:07.950896 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:07.950882    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd" podUID="ebf42024-a790-4123-86a3-1d177c3fb2a8" containerName="service-proxy" containerID="cri-o://c832218619d2c07cd6f68939b6e035a72009d4f086de2debb842e19d3ff9ed48" gracePeriod=30
May 21 21:24:08.357125 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:08.357021    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xff2c" event={"ID":"f976c3bf-c462-4143-afdf-d41bb38742e5","Type":"ContainerStarted","Data":"9ff08b36cd1a3d13cac6ecfdcba223ff6dcb53a885b156f4192ecbf48baa6cae"}
May 21 21:24:08.359011 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:08.358972    2576 generic.go:358] "Generic (PLEG): container finished" podID="ebf42024-a790-4123-86a3-1d177c3fb2a8" containerID="c832218619d2c07cd6f68939b6e035a72009d4f086de2debb842e19d3ff9ed48" exitCode=2
May 21 21:24:08.359132 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:08.359039    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd" event={"ID":"ebf42024-a790-4123-86a3-1d177c3fb2a8","Type":"ContainerDied","Data":"c832218619d2c07cd6f68939b6e035a72009d4f086de2debb842e19d3ff9ed48"}
May 21 21:24:08.359132 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:08.359070    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cf6d85444-brxtd" event={"ID":"ebf42024-a790-4123-86a3-1d177c3fb2a8","Type":"ContainerStarted","Data":"9accab54f812a23dc1f3303536c8eecbab659de84cb04da62bc61f18c8e7676a"}
May 21 21:24:08.382188 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:08.382129    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xff2c" podStartSLOduration=138.608798763 podStartE2EDuration="2m20.382114472s" podCreationTimestamp="2026-05-21 21:21:48 +0000 UTC" firstStartedPulling="2026-05-21 21:24:05.956811506 +0000 UTC m=+171.645186812" lastFinishedPulling="2026-05-21 21:24:07.730127219 +0000 UTC m=+173.418502521" observedRunningTime="2026-05-21 21:24:08.381026816 +0000 UTC m=+174.069402129" watchObservedRunningTime="2026-05-21 21:24:08.382114472 +0000 UTC m=+174.070489793"
May 21 21:24:09.334514 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:09.334475    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2wxsq"
May 21 21:24:11.823501 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:11.823466    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cc65cd5bb-4fmnn"]
May 21 21:24:36.842593 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:36.842524    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-cc65cd5bb-4fmnn" podUID="e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0" containerName="console" containerID="cri-o://1b806f1b113a78065269c54b8f13379fd285c800c4f93d8c0911a02c23b4fc58" gracePeriod=15
May 21 21:24:37.097255 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.097183    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cc65cd5bb-4fmnn_e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0/console/0.log"
May 21 21:24:37.097395 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.097256    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:24:37.124961 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.124925    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8f66\" (UniqueName: \"kubernetes.io/projected/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-kube-api-access-v8f66\") pod \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") "
May 21 21:24:37.125176 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.124993    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-config\") pod \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") "
May 21 21:24:37.125176 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.125018    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-oauth-config\") pod \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") "
May 21 21:24:37.125176 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.125037    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-service-ca\") pod \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") "
May 21 21:24:37.125176 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.125085    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-oauth-serving-cert\") pod \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") "
May 21 21:24:37.125176 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.125124    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-serving-cert\") pod \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\" (UID: \"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0\") "
May 21 21:24:37.125832 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.125782    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-service-ca" (OuterVolumeSpecName: "service-ca") pod "e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0" (UID: "e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:24:37.126069 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.126039    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0" (UID: "e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:24:37.126133 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.126049    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-config" (OuterVolumeSpecName: "console-config") pod "e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0" (UID: "e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:24:37.128043 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.128013    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0" (UID: "e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:24:37.128287 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.128251    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-kube-api-access-v8f66" (OuterVolumeSpecName: "kube-api-access-v8f66") pod "e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0" (UID: "e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0"). InnerVolumeSpecName "kube-api-access-v8f66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:24:37.128366 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.128273    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0" (UID: "e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:24:37.226181 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.226125    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8f66\" (UniqueName: \"kubernetes.io/projected/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-kube-api-access-v8f66\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:24:37.226181 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.226177    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-config\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:24:37.226181 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.226191    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-oauth-config\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:24:37.226448 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.226204    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-service-ca\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:24:37.226448 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.226218    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-oauth-serving-cert\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:24:37.226448 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.226230    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0-console-serving-cert\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:24:37.436686 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.436609    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cc65cd5bb-4fmnn_e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0/console/0.log"
May 21 21:24:37.436686 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.436648    2576 generic.go:358] "Generic (PLEG): container finished" podID="e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0" containerID="1b806f1b113a78065269c54b8f13379fd285c800c4f93d8c0911a02c23b4fc58" exitCode=2
May 21 21:24:37.436864 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.436686    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc65cd5bb-4fmnn" event={"ID":"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0","Type":"ContainerDied","Data":"1b806f1b113a78065269c54b8f13379fd285c800c4f93d8c0911a02c23b4fc58"}
May 21 21:24:37.436864 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.436730    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cc65cd5bb-4fmnn" event={"ID":"e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0","Type":"ContainerDied","Data":"d0e0f1257959ef405d49ec5a034982c29ec0fb21a033b5c470715e9c08c46b98"}
May 21 21:24:37.436864 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.436736    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cc65cd5bb-4fmnn"
May 21 21:24:37.436864 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.436746    2576 scope.go:117] "RemoveContainer" containerID="1b806f1b113a78065269c54b8f13379fd285c800c4f93d8c0911a02c23b4fc58"
May 21 21:24:37.445099 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.445081    2576 scope.go:117] "RemoveContainer" containerID="1b806f1b113a78065269c54b8f13379fd285c800c4f93d8c0911a02c23b4fc58"
May 21 21:24:37.445354 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:24:37.445325    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b806f1b113a78065269c54b8f13379fd285c800c4f93d8c0911a02c23b4fc58\": container with ID starting with 1b806f1b113a78065269c54b8f13379fd285c800c4f93d8c0911a02c23b4fc58 not found: ID does not exist" containerID="1b806f1b113a78065269c54b8f13379fd285c800c4f93d8c0911a02c23b4fc58"
May 21 21:24:37.445561 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.445361    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b806f1b113a78065269c54b8f13379fd285c800c4f93d8c0911a02c23b4fc58"} err="failed to get container status \"1b806f1b113a78065269c54b8f13379fd285c800c4f93d8c0911a02c23b4fc58\": rpc error: code = NotFound desc = could not find container \"1b806f1b113a78065269c54b8f13379fd285c800c4f93d8c0911a02c23b4fc58\": container with ID starting with 1b806f1b113a78065269c54b8f13379fd285c800c4f93d8c0911a02c23b4fc58 not found: ID does not exist"
May 21 21:24:37.460576 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.460541    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cc65cd5bb-4fmnn"]
May 21 21:24:37.467309 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:37.467278    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cc65cd5bb-4fmnn"]
May 21 21:24:38.806064 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:24:38.806032    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0" path="/var/lib/kubelet/pods/e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0/volumes"
May 21 21:25:25.562352 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.562309    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-57cbd86d98-r4vx5"]
May 21 21:25:25.562847 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.562651    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0" containerName="console"
May 21 21:25:25.562847 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.562671    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0" containerName="console"
May 21 21:25:25.562847 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.562726    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="e5d2dfa8-60f0-4093-84a9-ca4a436e3cb0" containerName="console"
May 21 21:25:25.566751 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.566733    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.569885 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.569862    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 21 21:25:25.570039 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.569954    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 21 21:25:25.572314 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.572288    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 21 21:25:25.572314 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.572294    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 21 21:25:25.572896 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.572873    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g9zpv\""
May 21 21:25:25.573000 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.572876    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 21 21:25:25.573721 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.573346    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 21 21:25:25.578945 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.578922    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 21 21:25:25.599324 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.599264    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 21 21:25:25.600690 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.600656    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57cbd86d98-r4vx5"]
May 21 21:25:25.676653 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.676606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-service-ca\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.676653 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.676655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hckhf\" (UniqueName: \"kubernetes.io/projected/1063ce57-0422-4291-89a9-865847734622-kube-api-access-hckhf\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.676893 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.676691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-oauth-serving-cert\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.676893 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.676707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-trusted-ca-bundle\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.676893 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.676761    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1063ce57-0422-4291-89a9-865847734622-console-serving-cert\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.676893 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.676778    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-console-config\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.676893 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.676796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1063ce57-0422-4291-89a9-865847734622-console-oauth-config\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.778002 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.777942    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1063ce57-0422-4291-89a9-865847734622-console-serving-cert\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.778002 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.778003    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-console-config\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.778227 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.778032    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1063ce57-0422-4291-89a9-865847734622-console-oauth-config\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.778227 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.778059    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-service-ca\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.778227 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.778090    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hckhf\" (UniqueName: \"kubernetes.io/projected/1063ce57-0422-4291-89a9-865847734622-kube-api-access-hckhf\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.778227 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.778138    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-oauth-serving-cert\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.778227 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.778161    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-trusted-ca-bundle\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.778886 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.778858    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-console-config\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.779024 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.778892    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-oauth-serving-cert\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.779024 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.778901    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-service-ca\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.779122 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.779028    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-trusted-ca-bundle\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.780413 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.780393    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1063ce57-0422-4291-89a9-865847734622-console-serving-cert\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.780507 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.780491    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1063ce57-0422-4291-89a9-865847734622-console-oauth-config\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.789205 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.789175    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hckhf\" (UniqueName: \"kubernetes.io/projected/1063ce57-0422-4291-89a9-865847734622-kube-api-access-hckhf\") pod \"console-57cbd86d98-r4vx5\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") " pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:25.876928 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:25.876836    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:26.015223 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:26.015190    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57cbd86d98-r4vx5"]
May 21 21:25:26.018889 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:25:26.018857    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1063ce57_0422_4291_89a9_865847734622.slice/crio-ac97871596b1532308d33fcc8af4ce9c46b5d808fb768b3c57335fcbdfa25523 WatchSource:0}: Error finding container ac97871596b1532308d33fcc8af4ce9c46b5d808fb768b3c57335fcbdfa25523: Status 404 returned error can't find the container with id ac97871596b1532308d33fcc8af4ce9c46b5d808fb768b3c57335fcbdfa25523
May 21 21:25:26.566904 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:26.566865    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cbd86d98-r4vx5" event={"ID":"1063ce57-0422-4291-89a9-865847734622","Type":"ContainerStarted","Data":"7d2b3dff140bc6a6004cbff365f8291ca4f5e0fd44a9daf0ab1652b68cb18822"}
May 21 21:25:26.566904 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:26.566910    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cbd86d98-r4vx5" event={"ID":"1063ce57-0422-4291-89a9-865847734622","Type":"ContainerStarted","Data":"ac97871596b1532308d33fcc8af4ce9c46b5d808fb768b3c57335fcbdfa25523"}
May 21 21:25:26.586521 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:26.586471    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-57cbd86d98-r4vx5" podStartSLOduration=1.5864540539999998 podStartE2EDuration="1.586454054s" podCreationTimestamp="2026-05-21 21:25:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:25:26.585180438 +0000 UTC m=+252.273555761" watchObservedRunningTime="2026-05-21 21:25:26.586454054 +0000 UTC m=+252.274829375"
May 21 21:25:35.877615 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:35.877520    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:35.877615 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:35.877573    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:35.882480 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:35.882452    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:36.601142 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:36.601111    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:25:40.937720 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:40.937676    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"]
May 21 21:25:40.940991 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:40.940955    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"
May 21 21:25:40.944648 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:40.944622    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gfbhl\""
May 21 21:25:40.945318 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:40.945295    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 21:25:40.945494 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:40.945475    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 21:25:40.972457 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:40.972426    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"]
May 21 21:25:41.093201 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:41.093150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnfkc\" (UniqueName: \"kubernetes.io/projected/21dc0a85-b899-4922-ab4c-42f1df839eff-kube-api-access-vnfkc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84\" (UID: \"21dc0a85-b899-4922-ab4c-42f1df839eff\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"
May 21 21:25:41.093201 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:41.093200    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21dc0a85-b899-4922-ab4c-42f1df839eff-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84\" (UID: \"21dc0a85-b899-4922-ab4c-42f1df839eff\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"
May 21 21:25:41.093418 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:41.093279    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21dc0a85-b899-4922-ab4c-42f1df839eff-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84\" (UID: \"21dc0a85-b899-4922-ab4c-42f1df839eff\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"
May 21 21:25:41.193841 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:41.193752    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vnfkc\" (UniqueName: \"kubernetes.io/projected/21dc0a85-b899-4922-ab4c-42f1df839eff-kube-api-access-vnfkc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84\" (UID: \"21dc0a85-b899-4922-ab4c-42f1df839eff\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"
May 21 21:25:41.193841 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:41.193799    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21dc0a85-b899-4922-ab4c-42f1df839eff-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84\" (UID: \"21dc0a85-b899-4922-ab4c-42f1df839eff\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"
May 21 21:25:41.194026 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:41.193861    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21dc0a85-b899-4922-ab4c-42f1df839eff-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84\" (UID: \"21dc0a85-b899-4922-ab4c-42f1df839eff\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"
May 21 21:25:41.194340 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:41.194319    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21dc0a85-b899-4922-ab4c-42f1df839eff-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84\" (UID: \"21dc0a85-b899-4922-ab4c-42f1df839eff\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"
May 21 21:25:41.194379 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:41.194335    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21dc0a85-b899-4922-ab4c-42f1df839eff-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84\" (UID: \"21dc0a85-b899-4922-ab4c-42f1df839eff\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"
May 21 21:25:41.215731 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:41.215692    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnfkc\" (UniqueName: \"kubernetes.io/projected/21dc0a85-b899-4922-ab4c-42f1df839eff-kube-api-access-vnfkc\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84\" (UID: \"21dc0a85-b899-4922-ab4c-42f1df839eff\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"
May 21 21:25:41.250307 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:41.250260    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"
May 21 21:25:41.407768 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:41.407734    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"]
May 21 21:25:41.411125 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:25:41.411096    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21dc0a85_b899_4922_ab4c_42f1df839eff.slice/crio-2e533d8104b9e7a36323549c0740f8ef3ef8d6e4c56da6ae385de912b3eb5de8 WatchSource:0}: Error finding container 2e533d8104b9e7a36323549c0740f8ef3ef8d6e4c56da6ae385de912b3eb5de8: Status 404 returned error can't find the container with id 2e533d8104b9e7a36323549c0740f8ef3ef8d6e4c56da6ae385de912b3eb5de8
May 21 21:25:41.611334 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:41.611300    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84" event={"ID":"21dc0a85-b899-4922-ab4c-42f1df839eff","Type":"ContainerStarted","Data":"2e533d8104b9e7a36323549c0740f8ef3ef8d6e4c56da6ae385de912b3eb5de8"}
May 21 21:25:48.632946 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:48.632911    2576 generic.go:358] "Generic (PLEG): container finished" podID="21dc0a85-b899-4922-ab4c-42f1df839eff" containerID="d652c41df9d326fb3135e5ad8955a2d6fc617b1d24111199ce7feb31f715e313" exitCode=0
May 21 21:25:48.633357 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:48.632966    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84" event={"ID":"21dc0a85-b899-4922-ab4c-42f1df839eff","Type":"ContainerDied","Data":"d652c41df9d326fb3135e5ad8955a2d6fc617b1d24111199ce7feb31f715e313"}
May 21 21:25:50.642173 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:50.642136    2576 generic.go:358] "Generic (PLEG): container finished" podID="21dc0a85-b899-4922-ab4c-42f1df839eff" containerID="54cda8281360db0b11bfcc467275f0c843ddc78830ad54b0c24abdbe1a92a91a" exitCode=0
May 21 21:25:50.642579 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:50.642192    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84" event={"ID":"21dc0a85-b899-4922-ab4c-42f1df839eff","Type":"ContainerDied","Data":"54cda8281360db0b11bfcc467275f0c843ddc78830ad54b0c24abdbe1a92a91a"}
May 21 21:25:57.663494 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:57.663457    2576 generic.go:358] "Generic (PLEG): container finished" podID="21dc0a85-b899-4922-ab4c-42f1df839eff" containerID="ed0ebee79d3ea42ec1953f0ef571a6215984aa07d04c9509507639f948402d36" exitCode=0
May 21 21:25:57.663935 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:57.663535    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84" event={"ID":"21dc0a85-b899-4922-ab4c-42f1df839eff","Type":"ContainerDied","Data":"ed0ebee79d3ea42ec1953f0ef571a6215984aa07d04c9509507639f948402d36"}
May 21 21:25:58.790943 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:58.790917    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"
May 21 21:25:58.826756 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:58.826722    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnfkc\" (UniqueName: \"kubernetes.io/projected/21dc0a85-b899-4922-ab4c-42f1df839eff-kube-api-access-vnfkc\") pod \"21dc0a85-b899-4922-ab4c-42f1df839eff\" (UID: \"21dc0a85-b899-4922-ab4c-42f1df839eff\") "
May 21 21:25:58.826923 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:58.826786    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21dc0a85-b899-4922-ab4c-42f1df839eff-util\") pod \"21dc0a85-b899-4922-ab4c-42f1df839eff\" (UID: \"21dc0a85-b899-4922-ab4c-42f1df839eff\") "
May 21 21:25:58.826923 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:58.826833    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21dc0a85-b899-4922-ab4c-42f1df839eff-bundle\") pod \"21dc0a85-b899-4922-ab4c-42f1df839eff\" (UID: \"21dc0a85-b899-4922-ab4c-42f1df839eff\") "
May 21 21:25:58.827657 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:58.827622    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21dc0a85-b899-4922-ab4c-42f1df839eff-bundle" (OuterVolumeSpecName: "bundle") pod "21dc0a85-b899-4922-ab4c-42f1df839eff" (UID: "21dc0a85-b899-4922-ab4c-42f1df839eff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:25:58.828930 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:58.828901    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21dc0a85-b899-4922-ab4c-42f1df839eff-kube-api-access-vnfkc" (OuterVolumeSpecName: "kube-api-access-vnfkc") pod "21dc0a85-b899-4922-ab4c-42f1df839eff" (UID: "21dc0a85-b899-4922-ab4c-42f1df839eff"). InnerVolumeSpecName "kube-api-access-vnfkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:25:58.833620 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:58.833587    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21dc0a85-b899-4922-ab4c-42f1df839eff-util" (OuterVolumeSpecName: "util") pod "21dc0a85-b899-4922-ab4c-42f1df839eff" (UID: "21dc0a85-b899-4922-ab4c-42f1df839eff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:25:58.927364 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:58.927264    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnfkc\" (UniqueName: \"kubernetes.io/projected/21dc0a85-b899-4922-ab4c-42f1df839eff-kube-api-access-vnfkc\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:25:58.927364 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:58.927310    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21dc0a85-b899-4922-ab4c-42f1df839eff-util\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:25:58.927364 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:58.927320    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21dc0a85-b899-4922-ab4c-42f1df839eff-bundle\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:25:59.671155 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:59.671122    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84" event={"ID":"21dc0a85-b899-4922-ab4c-42f1df839eff","Type":"ContainerDied","Data":"2e533d8104b9e7a36323549c0740f8ef3ef8d6e4c56da6ae385de912b3eb5de8"}
May 21 21:25:59.671155 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:59.671154    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e533d8104b9e7a36323549c0740f8ef3ef8d6e4c56da6ae385de912b3eb5de8"
May 21 21:25:59.671355 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:25:59.671164    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9jv84"
May 21 21:26:06.833181 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.833133    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7"]
May 21 21:26:06.833586 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.833394    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21dc0a85-b899-4922-ab4c-42f1df839eff" containerName="util"
May 21 21:26:06.833586 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.833405    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="21dc0a85-b899-4922-ab4c-42f1df839eff" containerName="util"
May 21 21:26:06.833586 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.833418    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21dc0a85-b899-4922-ab4c-42f1df839eff" containerName="pull"
May 21 21:26:06.833586 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.833425    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="21dc0a85-b899-4922-ab4c-42f1df839eff" containerName="pull"
May 21 21:26:06.833586 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.833432    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21dc0a85-b899-4922-ab4c-42f1df839eff" containerName="extract"
May 21 21:26:06.833586 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.833437    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="21dc0a85-b899-4922-ab4c-42f1df839eff" containerName="extract"
May 21 21:26:06.833586 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.833491    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="21dc0a85-b899-4922-ab4c-42f1df839eff" containerName="extract"
May 21 21:26:06.836322 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.836300    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7"
May 21 21:26:06.842209 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.842178    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fvp76\""
May 21 21:26:06.842383 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.842180    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
May 21 21:26:06.842383 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.842178    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
May 21 21:26:06.863327 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.863293    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7"]
May 21 21:26:06.879527 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.879481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42a6238-8933-4869-8bf5-9686070a17b3-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-ck9d7\" (UID: \"a42a6238-8933-4869-8bf5-9686070a17b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7"
May 21 21:26:06.879716 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.879593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blptg\" (UniqueName: \"kubernetes.io/projected/a42a6238-8933-4869-8bf5-9686070a17b3-kube-api-access-blptg\") pod \"cert-manager-operator-controller-manager-54b9655956-ck9d7\" (UID: \"a42a6238-8933-4869-8bf5-9686070a17b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7"
May 21 21:26:06.980377 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.980334    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-blptg\" (UniqueName: \"kubernetes.io/projected/a42a6238-8933-4869-8bf5-9686070a17b3-kube-api-access-blptg\") pod \"cert-manager-operator-controller-manager-54b9655956-ck9d7\" (UID: \"a42a6238-8933-4869-8bf5-9686070a17b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7"
May 21 21:26:06.980569 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.980386    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42a6238-8933-4869-8bf5-9686070a17b3-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-ck9d7\" (UID: \"a42a6238-8933-4869-8bf5-9686070a17b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7"
May 21 21:26:06.980767 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:06.980744    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a42a6238-8933-4869-8bf5-9686070a17b3-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-ck9d7\" (UID: \"a42a6238-8933-4869-8bf5-9686070a17b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7"
May 21 21:26:07.011456 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:07.011427    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blptg\" (UniqueName: \"kubernetes.io/projected/a42a6238-8933-4869-8bf5-9686070a17b3-kube-api-access-blptg\") pod \"cert-manager-operator-controller-manager-54b9655956-ck9d7\" (UID: \"a42a6238-8933-4869-8bf5-9686070a17b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7"
May 21 21:26:07.146359 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:07.146260    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7"
May 21 21:26:07.374674 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:07.374638    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7"]
May 21 21:26:07.381887 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:26:07.381809    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42a6238_8933_4869_8bf5_9686070a17b3.slice/crio-44ec485f2af3ba4860c5e09d2e85a76cd5c6c99c10f142e536f065c8aee024f5 WatchSource:0}: Error finding container 44ec485f2af3ba4860c5e09d2e85a76cd5c6c99c10f142e536f065c8aee024f5: Status 404 returned error can't find the container with id 44ec485f2af3ba4860c5e09d2e85a76cd5c6c99c10f142e536f065c8aee024f5
May 21 21:26:07.694413 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:07.694380    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7" event={"ID":"a42a6238-8933-4869-8bf5-9686070a17b3","Type":"ContainerStarted","Data":"44ec485f2af3ba4860c5e09d2e85a76cd5c6c99c10f142e536f065c8aee024f5"}
May 21 21:26:09.701937 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:09.701838    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7" event={"ID":"a42a6238-8933-4869-8bf5-9686070a17b3","Type":"ContainerStarted","Data":"8857c45f78fd6f17e82b228a8ec6b3143c54a85fec3b99bd7d912ec211d1ee35"}
May 21 21:26:09.769882 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:09.769820    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-ck9d7" podStartSLOduration=1.855670088 podStartE2EDuration="3.769803748s" podCreationTimestamp="2026-05-21 21:26:06 +0000 UTC" firstStartedPulling="2026-05-21 21:26:07.385274507 +0000 UTC m=+293.073649805" lastFinishedPulling="2026-05-21 21:26:09.299408163 +0000 UTC m=+294.987783465" observedRunningTime="2026-05-21 21:26:09.769700474 +0000 UTC m=+295.458075818" watchObservedRunningTime="2026-05-21 21:26:09.769803748 +0000 UTC m=+295.458179069"
May 21 21:26:11.110775 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.110742    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"]
May 21 21:26:11.114000 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.113971    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"
May 21 21:26:11.118809 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.118787    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gfbhl\""
May 21 21:26:11.119844 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.119820    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 21:26:11.119961 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.119847    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 21:26:11.133840 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.133813    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"]
May 21 21:26:11.209566 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.209510    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n5qc\" (UniqueName: \"kubernetes.io/projected/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-kube-api-access-8n5qc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx\" (UID: \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"
May 21 21:26:11.209722 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.209628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx\" (UID: \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"
May 21 21:26:11.209722 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.209670    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx\" (UID: \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"
May 21 21:26:11.310701 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.310664    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8n5qc\" (UniqueName: \"kubernetes.io/projected/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-kube-api-access-8n5qc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx\" (UID: \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"
May 21 21:26:11.310857 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.310730    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx\" (UID: \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"
May 21 21:26:11.310857 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.310751    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx\" (UID: \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"
May 21 21:26:11.311113 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.311096    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx\" (UID: \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"
May 21 21:26:11.311154 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.311134    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx\" (UID: \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"
May 21 21:26:11.359839 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.359816    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n5qc\" (UniqueName: \"kubernetes.io/projected/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-kube-api-access-8n5qc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx\" (UID: \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"
May 21 21:26:11.422883 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.422816    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"
May 21 21:26:11.581790 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.581767    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"]
May 21 21:26:11.584192 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:26:11.584153    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37ca3a7_19dd_42c5_bae2_f70e8c304e85.slice/crio-199713bcfc8cb876547debf4adadff99a05448968e435c05a186ff5783df5514 WatchSource:0}: Error finding container 199713bcfc8cb876547debf4adadff99a05448968e435c05a186ff5783df5514: Status 404 returned error can't find the container with id 199713bcfc8cb876547debf4adadff99a05448968e435c05a186ff5783df5514
May 21 21:26:11.709155 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.709120    2576 generic.go:358] "Generic (PLEG): container finished" podID="e37ca3a7-19dd-42c5-bae2-f70e8c304e85" containerID="96f545745825d2fb878709aaf15060db388bf9d7717801693c001b1bc4edec21" exitCode=0
May 21 21:26:11.709305 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.709209    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx" event={"ID":"e37ca3a7-19dd-42c5-bae2-f70e8c304e85","Type":"ContainerDied","Data":"96f545745825d2fb878709aaf15060db388bf9d7717801693c001b1bc4edec21"}
May 21 21:26:11.709305 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:11.709251    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx" event={"ID":"e37ca3a7-19dd-42c5-bae2-f70e8c304e85","Type":"ContainerStarted","Data":"199713bcfc8cb876547debf4adadff99a05448968e435c05a186ff5783df5514"}
May 21 21:26:14.444112 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.444078    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-rmt6g"]
May 21 21:26:14.447359 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.447337    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-rmt6g"
May 21 21:26:14.451249 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.451222    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zwbcs\""
May 21 21:26:14.451501 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.451484    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 21 21:26:14.452653 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.452633    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 21 21:26:14.477355 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.477310    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-rmt6g"]
May 21 21:26:14.531187 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.531154    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce7c1a43-bf45-45cd-9061-0820149af0c1-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-rmt6g\" (UID: \"ce7c1a43-bf45-45cd-9061-0820149af0c1\") " pod="cert-manager/cert-manager-cainjector-68b757865b-rmt6g"
May 21 21:26:14.531187 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.531190    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-525hc\" (UniqueName: \"kubernetes.io/projected/ce7c1a43-bf45-45cd-9061-0820149af0c1-kube-api-access-525hc\") pod \"cert-manager-cainjector-68b757865b-rmt6g\" (UID: \"ce7c1a43-bf45-45cd-9061-0820149af0c1\") " pod="cert-manager/cert-manager-cainjector-68b757865b-rmt6g"
May 21 21:26:14.631662 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.631567    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce7c1a43-bf45-45cd-9061-0820149af0c1-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-rmt6g\" (UID: \"ce7c1a43-bf45-45cd-9061-0820149af0c1\") " pod="cert-manager/cert-manager-cainjector-68b757865b-rmt6g"
May 21 21:26:14.631662 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.631611    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-525hc\" (UniqueName: \"kubernetes.io/projected/ce7c1a43-bf45-45cd-9061-0820149af0c1-kube-api-access-525hc\") pod \"cert-manager-cainjector-68b757865b-rmt6g\" (UID: \"ce7c1a43-bf45-45cd-9061-0820149af0c1\") " pod="cert-manager/cert-manager-cainjector-68b757865b-rmt6g"
May 21 21:26:14.650503 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.650454    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-525hc\" (UniqueName: \"kubernetes.io/projected/ce7c1a43-bf45-45cd-9061-0820149af0c1-kube-api-access-525hc\") pod \"cert-manager-cainjector-68b757865b-rmt6g\" (UID: \"ce7c1a43-bf45-45cd-9061-0820149af0c1\") " pod="cert-manager/cert-manager-cainjector-68b757865b-rmt6g"
May 21 21:26:14.650694 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.650553    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce7c1a43-bf45-45cd-9061-0820149af0c1-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-rmt6g\" (UID: \"ce7c1a43-bf45-45cd-9061-0820149af0c1\") " pod="cert-manager/cert-manager-cainjector-68b757865b-rmt6g"
May 21 21:26:14.699517 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.699492    2576 kubelet.go:1628] "Image garbage collection succeeded"
May 21 21:26:14.720235 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.720200    2576 generic.go:358] "Generic (PLEG): container finished" podID="e37ca3a7-19dd-42c5-bae2-f70e8c304e85" containerID="e69089cff18bceab3db4b02df116916418d461b44afcdade182612385b4e1269" exitCode=0
May 21 21:26:14.720380 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.720271    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx" event={"ID":"e37ca3a7-19dd-42c5-bae2-f70e8c304e85","Type":"ContainerDied","Data":"e69089cff18bceab3db4b02df116916418d461b44afcdade182612385b4e1269"}
May 21 21:26:14.760853 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.760827    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zwbcs\""
May 21 21:26:14.767635 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.767605    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-rmt6g"
May 21 21:26:14.917993 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:14.917899    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-rmt6g"]
May 21 21:26:14.921849 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:26:14.921825    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce7c1a43_bf45_45cd_9061_0820149af0c1.slice/crio-8c7ca8b20cce2dd5159df0dc19637d535171d0cb5afe11ab985fa83d4422238c WatchSource:0}: Error finding container 8c7ca8b20cce2dd5159df0dc19637d535171d0cb5afe11ab985fa83d4422238c: Status 404 returned error can't find the container with id 8c7ca8b20cce2dd5159df0dc19637d535171d0cb5afe11ab985fa83d4422238c
May 21 21:26:15.726099 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:15.726011    2576 generic.go:358] "Generic (PLEG): container finished" podID="e37ca3a7-19dd-42c5-bae2-f70e8c304e85" containerID="6e445d60537ad5c1c8e7f37b712c9d96d943eed768f2cbba1261ecf9670e6ad1" exitCode=0
May 21 21:26:15.726531 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:15.726093    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx" event={"ID":"e37ca3a7-19dd-42c5-bae2-f70e8c304e85","Type":"ContainerDied","Data":"6e445d60537ad5c1c8e7f37b712c9d96d943eed768f2cbba1261ecf9670e6ad1"}
May 21 21:26:15.727320 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:15.727288    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-rmt6g" event={"ID":"ce7c1a43-bf45-45cd-9061-0820149af0c1","Type":"ContainerStarted","Data":"8c7ca8b20cce2dd5159df0dc19637d535171d0cb5afe11ab985fa83d4422238c"}
May 21 21:26:17.385362 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.385326    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"
May 21 21:26:17.453292 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.453269    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-bundle\") pod \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\" (UID: \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\") "
May 21 21:26:17.453366 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.453354    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n5qc\" (UniqueName: \"kubernetes.io/projected/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-kube-api-access-8n5qc\") pod \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\" (UID: \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\") "
May 21 21:26:17.453408 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.453397    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-util\") pod \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\" (UID: \"e37ca3a7-19dd-42c5-bae2-f70e8c304e85\") "
May 21 21:26:17.453775 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.453738    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-bundle" (OuterVolumeSpecName: "bundle") pod "e37ca3a7-19dd-42c5-bae2-f70e8c304e85" (UID: "e37ca3a7-19dd-42c5-bae2-f70e8c304e85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:26:17.455622 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.455589    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-kube-api-access-8n5qc" (OuterVolumeSpecName: "kube-api-access-8n5qc") pod "e37ca3a7-19dd-42c5-bae2-f70e8c304e85" (UID: "e37ca3a7-19dd-42c5-bae2-f70e8c304e85"). InnerVolumeSpecName "kube-api-access-8n5qc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:26:17.460490 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.460460    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-util" (OuterVolumeSpecName: "util") pod "e37ca3a7-19dd-42c5-bae2-f70e8c304e85" (UID: "e37ca3a7-19dd-42c5-bae2-f70e8c304e85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:26:17.554840 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.554805    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-util\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:26:17.554840 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.554834    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-bundle\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:26:17.554840 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.554844    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n5qc\" (UniqueName: \"kubernetes.io/projected/e37ca3a7-19dd-42c5-bae2-f70e8c304e85-kube-api-access-8n5qc\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:26:17.735692 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.735595    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-rmt6g" event={"ID":"ce7c1a43-bf45-45cd-9061-0820149af0c1","Type":"ContainerStarted","Data":"ee6202cf06181602d8969eb29828144a303d70b61fd6235578273de07b997341"}
May 21 21:26:17.737280 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.737251    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx" event={"ID":"e37ca3a7-19dd-42c5-bae2-f70e8c304e85","Type":"ContainerDied","Data":"199713bcfc8cb876547debf4adadff99a05448968e435c05a186ff5783df5514"}
May 21 21:26:17.737280 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.737281    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="199713bcfc8cb876547debf4adadff99a05448968e435c05a186ff5783df5514"
May 21 21:26:17.737473 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:17.737303    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fh8fmx"
May 21 21:26:18.481376 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:18.481316    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-rmt6g" podStartSLOduration=1.965544773 podStartE2EDuration="4.481299693s" podCreationTimestamp="2026-05-21 21:26:14 +0000 UTC" firstStartedPulling="2026-05-21 21:26:14.92383741 +0000 UTC m=+300.612212709" lastFinishedPulling="2026-05-21 21:26:17.439592317 +0000 UTC m=+303.127967629" observedRunningTime="2026-05-21 21:26:17.771481134 +0000 UTC m=+303.459856455" watchObservedRunningTime="2026-05-21 21:26:18.481299693 +0000 UTC m=+304.169675013"
May 21 21:26:31.459084 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.459048    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"]
May 21 21:26:31.459593 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.459323    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37ca3a7-19dd-42c5-bae2-f70e8c304e85" containerName="pull"
May 21 21:26:31.459593 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.459337    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37ca3a7-19dd-42c5-bae2-f70e8c304e85" containerName="pull"
May 21 21:26:31.459593 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.459344    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37ca3a7-19dd-42c5-bae2-f70e8c304e85" containerName="extract"
May 21 21:26:31.459593 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.459350    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37ca3a7-19dd-42c5-bae2-f70e8c304e85" containerName="extract"
May 21 21:26:31.459593 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.459358    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37ca3a7-19dd-42c5-bae2-f70e8c304e85" containerName="util"
May 21 21:26:31.459593 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.459363    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37ca3a7-19dd-42c5-bae2-f70e8c304e85" containerName="util"
May 21 21:26:31.459593 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.459405    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="e37ca3a7-19dd-42c5-bae2-f70e8c304e85" containerName="extract"
May 21 21:26:31.463189 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.463163    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"
May 21 21:26:31.468817 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.468783    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gfbhl\""
May 21 21:26:31.468968 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.468905    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 21:26:31.469636 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.469620    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 21:26:31.485556 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.485519    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"]
May 21 21:26:31.553843 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.553796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eec2183e-089c-43cf-8f3b-79e4b5439cab-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t\" (UID: \"eec2183e-089c-43cf-8f3b-79e4b5439cab\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"
May 21 21:26:31.554070 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.553865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsgxz\" (UniqueName: \"kubernetes.io/projected/eec2183e-089c-43cf-8f3b-79e4b5439cab-kube-api-access-hsgxz\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t\" (UID: \"eec2183e-089c-43cf-8f3b-79e4b5439cab\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"
May 21 21:26:31.554070 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.553908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eec2183e-089c-43cf-8f3b-79e4b5439cab-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t\" (UID: \"eec2183e-089c-43cf-8f3b-79e4b5439cab\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"
May 21 21:26:31.654728 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.654686    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsgxz\" (UniqueName: \"kubernetes.io/projected/eec2183e-089c-43cf-8f3b-79e4b5439cab-kube-api-access-hsgxz\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t\" (UID: \"eec2183e-089c-43cf-8f3b-79e4b5439cab\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"
May 21 21:26:31.654931 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.654736    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eec2183e-089c-43cf-8f3b-79e4b5439cab-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t\" (UID: \"eec2183e-089c-43cf-8f3b-79e4b5439cab\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"
May 21 21:26:31.654931 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.654782    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eec2183e-089c-43cf-8f3b-79e4b5439cab-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t\" (UID: \"eec2183e-089c-43cf-8f3b-79e4b5439cab\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"
May 21 21:26:31.655153 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.655132    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eec2183e-089c-43cf-8f3b-79e4b5439cab-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t\" (UID: \"eec2183e-089c-43cf-8f3b-79e4b5439cab\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"
May 21 21:26:31.655218 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.655190    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eec2183e-089c-43cf-8f3b-79e4b5439cab-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t\" (UID: \"eec2183e-089c-43cf-8f3b-79e4b5439cab\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"
May 21 21:26:31.672054 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.672022    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsgxz\" (UniqueName: \"kubernetes.io/projected/eec2183e-089c-43cf-8f3b-79e4b5439cab-kube-api-access-hsgxz\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t\" (UID: \"eec2183e-089c-43cf-8f3b-79e4b5439cab\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"
May 21 21:26:31.772578 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.772543    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"
May 21 21:26:31.938948 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.938914    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"]
May 21 21:26:31.942412 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:26:31.942382    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec2183e_089c_43cf_8f3b_79e4b5439cab.slice/crio-f3c163311733a695067d084399766cb881f50ff5fe9b49069c822f6598d18e6e WatchSource:0}: Error finding container f3c163311733a695067d084399766cb881f50ff5fe9b49069c822f6598d18e6e: Status 404 returned error can't find the container with id f3c163311733a695067d084399766cb881f50ff5fe9b49069c822f6598d18e6e
May 21 21:26:31.944441 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:31.944422    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 21:26:32.783791 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:32.783752    2576 generic.go:358] "Generic (PLEG): container finished" podID="eec2183e-089c-43cf-8f3b-79e4b5439cab" containerID="ee5efcdf34fcb25b52e850c4f845f2a5b138d5d37752803884e00c2f32361896" exitCode=0
May 21 21:26:32.784170 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:32.783845    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t" event={"ID":"eec2183e-089c-43cf-8f3b-79e4b5439cab","Type":"ContainerDied","Data":"ee5efcdf34fcb25b52e850c4f845f2a5b138d5d37752803884e00c2f32361896"}
May 21 21:26:32.784170 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:32.783886    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t" event={"ID":"eec2183e-089c-43cf-8f3b-79e4b5439cab","Type":"ContainerStarted","Data":"f3c163311733a695067d084399766cb881f50ff5fe9b49069c822f6598d18e6e"}
May 21 21:26:33.788797 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:33.788764    2576 generic.go:358] "Generic (PLEG): container finished" podID="eec2183e-089c-43cf-8f3b-79e4b5439cab" containerID="0b55762c608e3fa164812454dfe0e35a1c9272f7b72a6aa854baf6e4428919d8" exitCode=0
May 21 21:26:33.789233 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:33.788826    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t" event={"ID":"eec2183e-089c-43cf-8f3b-79e4b5439cab","Type":"ContainerDied","Data":"0b55762c608e3fa164812454dfe0e35a1c9272f7b72a6aa854baf6e4428919d8"}
May 21 21:26:34.793820 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:34.793789    2576 generic.go:358] "Generic (PLEG): container finished" podID="eec2183e-089c-43cf-8f3b-79e4b5439cab" containerID="46865b8d29fcad04e1a35a8b075df8537d3a751d40e11bfa8323d3c2ffff4cec" exitCode=0
May 21 21:26:34.794216 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:34.793847    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t" event={"ID":"eec2183e-089c-43cf-8f3b-79e4b5439cab","Type":"ContainerDied","Data":"46865b8d29fcad04e1a35a8b075df8537d3a751d40e11bfa8323d3c2ffff4cec"}
May 21 21:26:35.923301 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:35.923270    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"
May 21 21:26:35.982489 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:35.982446    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eec2183e-089c-43cf-8f3b-79e4b5439cab-bundle\") pod \"eec2183e-089c-43cf-8f3b-79e4b5439cab\" (UID: \"eec2183e-089c-43cf-8f3b-79e4b5439cab\") "
May 21 21:26:35.982701 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:35.982510    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eec2183e-089c-43cf-8f3b-79e4b5439cab-util\") pod \"eec2183e-089c-43cf-8f3b-79e4b5439cab\" (UID: \"eec2183e-089c-43cf-8f3b-79e4b5439cab\") "
May 21 21:26:35.982701 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:35.982530    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsgxz\" (UniqueName: \"kubernetes.io/projected/eec2183e-089c-43cf-8f3b-79e4b5439cab-kube-api-access-hsgxz\") pod \"eec2183e-089c-43cf-8f3b-79e4b5439cab\" (UID: \"eec2183e-089c-43cf-8f3b-79e4b5439cab\") "
May 21 21:26:35.983347 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:35.983291    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec2183e-089c-43cf-8f3b-79e4b5439cab-bundle" (OuterVolumeSpecName: "bundle") pod "eec2183e-089c-43cf-8f3b-79e4b5439cab" (UID: "eec2183e-089c-43cf-8f3b-79e4b5439cab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:26:35.984825 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:35.984800    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eec2183e-089c-43cf-8f3b-79e4b5439cab-kube-api-access-hsgxz" (OuterVolumeSpecName: "kube-api-access-hsgxz") pod "eec2183e-089c-43cf-8f3b-79e4b5439cab" (UID: "eec2183e-089c-43cf-8f3b-79e4b5439cab"). InnerVolumeSpecName "kube-api-access-hsgxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:26:35.988924 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:35.988834    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eec2183e-089c-43cf-8f3b-79e4b5439cab-util" (OuterVolumeSpecName: "util") pod "eec2183e-089c-43cf-8f3b-79e4b5439cab" (UID: "eec2183e-089c-43cf-8f3b-79e4b5439cab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:26:36.083364 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:36.083276    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eec2183e-089c-43cf-8f3b-79e4b5439cab-bundle\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:26:36.083364 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:36.083308    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eec2183e-089c-43cf-8f3b-79e4b5439cab-util\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:26:36.083364 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:36.083322    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsgxz\" (UniqueName: \"kubernetes.io/projected/eec2183e-089c-43cf-8f3b-79e4b5439cab-kube-api-access-hsgxz\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:26:36.802313 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:36.802284    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t"
May 21 21:26:36.805540 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:36.805503    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c5dcp2t" event={"ID":"eec2183e-089c-43cf-8f3b-79e4b5439cab","Type":"ContainerDied","Data":"f3c163311733a695067d084399766cb881f50ff5fe9b49069c822f6598d18e6e"}
May 21 21:26:36.805540 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:36.805546    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3c163311733a695067d084399766cb881f50ff5fe9b49069c822f6598d18e6e"
May 21 21:26:42.939938 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:42.939901    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"]
May 21 21:26:42.940323 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:42.940182    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec2183e-089c-43cf-8f3b-79e4b5439cab" containerName="util"
May 21 21:26:42.940323 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:42.940194    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec2183e-089c-43cf-8f3b-79e4b5439cab" containerName="util"
May 21 21:26:42.940323 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:42.940209    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec2183e-089c-43cf-8f3b-79e4b5439cab" containerName="pull"
May 21 21:26:42.940323 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:42.940215    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec2183e-089c-43cf-8f3b-79e4b5439cab" containerName="pull"
May 21 21:26:42.940323 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:42.940220    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eec2183e-089c-43cf-8f3b-79e4b5439cab" containerName="extract"
May 21 21:26:42.940323 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:42.940226    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eec2183e-089c-43cf-8f3b-79e4b5439cab" containerName="extract"
May 21 21:26:42.940323 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:42.940267    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="eec2183e-089c-43cf-8f3b-79e4b5439cab" containerName="extract"
May 21 21:26:42.944381 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:42.944362    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"
May 21 21:26:42.960889 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:42.960856    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gfbhl\""
May 21 21:26:42.961079 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:42.960999    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 21:26:42.973398 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:42.973360    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"]
May 21 21:26:42.986485 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:42.986459    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 21:26:43.039579 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.039536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf\" (UID: \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"
May 21 21:26:43.039759 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.039584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf\" (UID: \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"
May 21 21:26:43.039805 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.039759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbxmb\" (UniqueName: \"kubernetes.io/projected/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-kube-api-access-kbxmb\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf\" (UID: \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"
May 21 21:26:43.140916 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.140875    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kbxmb\" (UniqueName: \"kubernetes.io/projected/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-kube-api-access-kbxmb\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf\" (UID: \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"
May 21 21:26:43.141105 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.141003    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf\" (UID: \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"
May 21 21:26:43.141105 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.141057    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf\" (UID: \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"
May 21 21:26:43.141381 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.141364    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf\" (UID: \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"
May 21 21:26:43.141381 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.141373    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf\" (UID: \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"
May 21 21:26:43.165438 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.165404    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbxmb\" (UniqueName: \"kubernetes.io/projected/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-kube-api-access-kbxmb\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf\" (UID: \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"
May 21 21:26:43.253160 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.253068    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"
May 21 21:26:43.480283 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.480238    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"]
May 21 21:26:43.484819 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:26:43.484781    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9dc09b_9d60_48d4_b5f8_4fa56f914cd0.slice/crio-83c29a04ab623bcc71585fac798617cb7c92c234467994b6a91b9114f2ce7d82 WatchSource:0}: Error finding container 83c29a04ab623bcc71585fac798617cb7c92c234467994b6a91b9114f2ce7d82: Status 404 returned error can't find the container with id 83c29a04ab623bcc71585fac798617cb7c92c234467994b6a91b9114f2ce7d82
May 21 21:26:43.823436 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.823340    2576 generic.go:358] "Generic (PLEG): container finished" podID="6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0" containerID="6874c349052b6c04540028890bf2085d84c24492d5717aeba23ec9ae8bebca0a" exitCode=0
May 21 21:26:43.823436 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.823385    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf" event={"ID":"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0","Type":"ContainerDied","Data":"6874c349052b6c04540028890bf2085d84c24492d5717aeba23ec9ae8bebca0a"}
May 21 21:26:43.823436 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:43.823414    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf" event={"ID":"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0","Type":"ContainerStarted","Data":"83c29a04ab623bcc71585fac798617cb7c92c234467994b6a91b9114f2ce7d82"}
May 21 21:26:44.827523 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:44.827490    2576 generic.go:358] "Generic (PLEG): container finished" podID="6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0" containerID="e9425d40a8d654f0524e9db1fee34ecf6c6201b808fde6c6334f9c2d2ffa9103" exitCode=0
May 21 21:26:44.827901 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:44.827556    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf" event={"ID":"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0","Type":"ContainerDied","Data":"e9425d40a8d654f0524e9db1fee34ecf6c6201b808fde6c6334f9c2d2ffa9103"}
May 21 21:26:45.832609 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:45.832575    2576 generic.go:358] "Generic (PLEG): container finished" podID="6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0" containerID="002fba8f75a62bbd84b1d34f8dd7ef4aeff5362b79532100046c43d5e180dc8a" exitCode=0
May 21 21:26:45.833091 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:45.832660    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf" event={"ID":"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0","Type":"ContainerDied","Data":"002fba8f75a62bbd84b1d34f8dd7ef4aeff5362b79532100046c43d5e180dc8a"}
May 21 21:26:46.968623 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:46.968593    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"
May 21 21:26:47.068925 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:47.068888    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-util\") pod \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\" (UID: \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\") "
May 21 21:26:47.069111 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:47.068974    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbxmb\" (UniqueName: \"kubernetes.io/projected/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-kube-api-access-kbxmb\") pod \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\" (UID: \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\") "
May 21 21:26:47.069111 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:47.069047    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-bundle\") pod \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\" (UID: \"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0\") "
May 21 21:26:47.069946 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:47.069916    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-bundle" (OuterVolumeSpecName: "bundle") pod "6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0" (UID: "6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:26:47.071146 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:47.071122    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-kube-api-access-kbxmb" (OuterVolumeSpecName: "kube-api-access-kbxmb") pod "6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0" (UID: "6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0"). InnerVolumeSpecName "kube-api-access-kbxmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:26:47.076872 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:47.076842    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-util" (OuterVolumeSpecName: "util") pod "6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0" (UID: "6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:26:47.170112 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:47.170017    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbxmb\" (UniqueName: \"kubernetes.io/projected/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-kube-api-access-kbxmb\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:26:47.170112 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:47.170053    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-bundle\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:26:47.170112 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:47.170063    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0-util\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:26:47.840032 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:47.839997    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf" event={"ID":"6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0","Type":"ContainerDied","Data":"83c29a04ab623bcc71585fac798617cb7c92c234467994b6a91b9114f2ce7d82"}
May 21 21:26:47.840032 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:47.840026    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9zgjxf"
May 21 21:26:47.840032 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:47.840035    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83c29a04ab623bcc71585fac798617cb7c92c234467994b6a91b9114f2ce7d82"
May 21 21:26:48.353975 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.353943    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"]
May 21 21:26:48.354414 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.354272    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0" containerName="util"
May 21 21:26:48.354414 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.354287    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0" containerName="util"
May 21 21:26:48.354414 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.354295    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0" containerName="extract"
May 21 21:26:48.354414 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.354300    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0" containerName="extract"
May 21 21:26:48.354414 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.354309    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0" containerName="pull"
May 21 21:26:48.354414 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.354316    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0" containerName="pull"
May 21 21:26:48.354414 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.354372    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="6e9dc09b-9d60-48d4-b5f8-4fa56f914cd0" containerName="extract"
May 21 21:26:48.358385 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.358365    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"
May 21 21:26:48.368803 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.368785    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 21:26:48.375885 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.375865    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 21:26:48.377134 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.377117    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 21:26:48.378908 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.378895    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2wqfn\""
May 21 21:26:48.379564 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.379548    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 21:26:48.388293 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.388265    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"]
May 21 21:26:48.479829 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.479791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65845bff-99c6-42a0-bc0c-be602df9b59c-webhook-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-q2wg4\" (UID: \"65845bff-99c6-42a0-bc0c-be602df9b59c\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"
May 21 21:26:48.480033 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.479842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65845bff-99c6-42a0-bc0c-be602df9b59c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-q2wg4\" (UID: \"65845bff-99c6-42a0-bc0c-be602df9b59c\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"
May 21 21:26:48.480033 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.479915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvkhf\" (UniqueName: \"kubernetes.io/projected/65845bff-99c6-42a0-bc0c-be602df9b59c-kube-api-access-hvkhf\") pod \"opendatahub-operator-controller-manager-79646d69f8-q2wg4\" (UID: \"65845bff-99c6-42a0-bc0c-be602df9b59c\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"
May 21 21:26:48.581156 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.581114    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65845bff-99c6-42a0-bc0c-be602df9b59c-webhook-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-q2wg4\" (UID: \"65845bff-99c6-42a0-bc0c-be602df9b59c\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"
May 21 21:26:48.581316 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.581166    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65845bff-99c6-42a0-bc0c-be602df9b59c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-q2wg4\" (UID: \"65845bff-99c6-42a0-bc0c-be602df9b59c\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"
May 21 21:26:48.581316 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.581201    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvkhf\" (UniqueName: \"kubernetes.io/projected/65845bff-99c6-42a0-bc0c-be602df9b59c-kube-api-access-hvkhf\") pod \"opendatahub-operator-controller-manager-79646d69f8-q2wg4\" (UID: \"65845bff-99c6-42a0-bc0c-be602df9b59c\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"
May 21 21:26:48.583531 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.583499    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/65845bff-99c6-42a0-bc0c-be602df9b59c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-q2wg4\" (UID: \"65845bff-99c6-42a0-bc0c-be602df9b59c\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"
May 21 21:26:48.583662 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.583580    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65845bff-99c6-42a0-bc0c-be602df9b59c-webhook-cert\") pod \"opendatahub-operator-controller-manager-79646d69f8-q2wg4\" (UID: \"65845bff-99c6-42a0-bc0c-be602df9b59c\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"
May 21 21:26:48.608971 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.608903    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvkhf\" (UniqueName: \"kubernetes.io/projected/65845bff-99c6-42a0-bc0c-be602df9b59c-kube-api-access-hvkhf\") pod \"opendatahub-operator-controller-manager-79646d69f8-q2wg4\" (UID: \"65845bff-99c6-42a0-bc0c-be602df9b59c\") " pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"
May 21 21:26:48.667795 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.667758    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"
May 21 21:26:48.874769 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:26:48.874737    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65845bff_99c6_42a0_bc0c_be602df9b59c.slice/crio-918fb87a69ddd187407354b0be1a99f95499c2dad9bf9848b5be4836a9f79cfd WatchSource:0}: Error finding container 918fb87a69ddd187407354b0be1a99f95499c2dad9bf9848b5be4836a9f79cfd: Status 404 returned error can't find the container with id 918fb87a69ddd187407354b0be1a99f95499c2dad9bf9848b5be4836a9f79cfd
May 21 21:26:48.915325 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:48.915270    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"]
May 21 21:26:49.847691 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:49.847652    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4" event={"ID":"65845bff-99c6-42a0-bc0c-be602df9b59c","Type":"ContainerStarted","Data":"918fb87a69ddd187407354b0be1a99f95499c2dad9bf9848b5be4836a9f79cfd"}
May 21 21:26:51.855290 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:51.855248    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4" event={"ID":"65845bff-99c6-42a0-bc0c-be602df9b59c","Type":"ContainerStarted","Data":"596a95310a3ff8d6663c963317fdf6e5af7cf46fdc52cb162fc8c1e90e9b2881"}
May 21 21:26:51.855700 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:51.855480    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"
May 21 21:26:51.910364 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:26:51.910314    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4" podStartSLOduration=1.4890178889999999 podStartE2EDuration="3.910298268s" podCreationTimestamp="2026-05-21 21:26:48 +0000 UTC" firstStartedPulling="2026-05-21 21:26:48.876357913 +0000 UTC m=+334.564733216" lastFinishedPulling="2026-05-21 21:26:51.297638279 +0000 UTC m=+336.986013595" observedRunningTime="2026-05-21 21:26:51.90844824 +0000 UTC m=+337.596823573" watchObservedRunningTime="2026-05-21 21:26:51.910298268 +0000 UTC m=+337.598673589"
May 21 21:27:02.860999 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:02.860951    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79646d69f8-q2wg4"
May 21 21:27:06.334084 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.334051    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"]
May 21 21:27:06.337483 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.337464    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"
May 21 21:27:06.344721 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.344694    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gfbhl\""
May 21 21:27:06.344832 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.344745    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 21:27:06.344942 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.344921    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 21:27:06.425673 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.425633    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c6587ad-c0d6-4988-ba0d-eb6f45971680-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7\" (UID: \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"
May 21 21:27:06.425848 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.425709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c6587ad-c0d6-4988-ba0d-eb6f45971680-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7\" (UID: \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"
May 21 21:27:06.425848 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.425739    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjctj\" (UniqueName: \"kubernetes.io/projected/8c6587ad-c0d6-4988-ba0d-eb6f45971680-kube-api-access-bjctj\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7\" (UID: \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"
May 21 21:27:06.443579 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.443544    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"]
May 21 21:27:06.527028 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.526998    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c6587ad-c0d6-4988-ba0d-eb6f45971680-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7\" (UID: \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"
May 21 21:27:06.527182 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.527035    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjctj\" (UniqueName: \"kubernetes.io/projected/8c6587ad-c0d6-4988-ba0d-eb6f45971680-kube-api-access-bjctj\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7\" (UID: \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"
May 21 21:27:06.527182 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.527074    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c6587ad-c0d6-4988-ba0d-eb6f45971680-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7\" (UID: \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"
May 21 21:27:06.527380 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.527364    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c6587ad-c0d6-4988-ba0d-eb6f45971680-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7\" (UID: \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"
May 21 21:27:06.527453 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.527433    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c6587ad-c0d6-4988-ba0d-eb6f45971680-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7\" (UID: \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"
May 21 21:27:06.560013 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.559971    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjctj\" (UniqueName: \"kubernetes.io/projected/8c6587ad-c0d6-4988-ba0d-eb6f45971680-kube-api-access-bjctj\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7\" (UID: \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"
May 21 21:27:06.646096 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.646008    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"
May 21 21:27:06.829665 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.829626    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"]
May 21 21:27:06.834074 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:27:06.834043    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6587ad_c0d6_4988_ba0d_eb6f45971680.slice/crio-2a681ff87593c7a26d5faa6201409647e29e6939273285a852a093d8d362a6e6 WatchSource:0}: Error finding container 2a681ff87593c7a26d5faa6201409647e29e6939273285a852a093d8d362a6e6: Status 404 returned error can't find the container with id 2a681ff87593c7a26d5faa6201409647e29e6939273285a852a093d8d362a6e6
May 21 21:27:06.905250 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.905153    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7" event={"ID":"8c6587ad-c0d6-4988-ba0d-eb6f45971680","Type":"ContainerStarted","Data":"00ceb9be48ef64238dd47a4d1d38fe8a3118f8606008de04c2f4538af005f21e"}
May 21 21:27:06.905250 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:06.905206    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7" event={"ID":"8c6587ad-c0d6-4988-ba0d-eb6f45971680","Type":"ContainerStarted","Data":"2a681ff87593c7a26d5faa6201409647e29e6939273285a852a093d8d362a6e6"}
May 21 21:27:07.909925 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:07.909833    2576 generic.go:358] "Generic (PLEG): container finished" podID="8c6587ad-c0d6-4988-ba0d-eb6f45971680" containerID="00ceb9be48ef64238dd47a4d1d38fe8a3118f8606008de04c2f4538af005f21e" exitCode=0
May 21 21:27:07.909925 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:07.909876    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7" event={"ID":"8c6587ad-c0d6-4988-ba0d-eb6f45971680","Type":"ContainerDied","Data":"00ceb9be48ef64238dd47a4d1d38fe8a3118f8606008de04c2f4538af005f21e"}
May 21 21:27:08.043947 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.043904    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"]
May 21 21:27:08.047186 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.047115    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"
May 21 21:27:08.056715 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.056695    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 21:27:08.056956 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.056939    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 21:27:08.057020 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.056977    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 21:27:08.057207 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.057189    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 21:27:08.057241 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.057232    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-42kfg\""
May 21 21:27:08.069253 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.069233    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"]
May 21 21:27:08.139428 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.139395    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vrz5\" (UniqueName: \"kubernetes.io/projected/4e343953-5321-49fd-a659-4cd684761421-kube-api-access-4vrz5\") pod \"kube-auth-proxy-8bb597df6-dvsj6\" (UID: \"4e343953-5321-49fd-a659-4cd684761421\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"
May 21 21:27:08.139584 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.139445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e343953-5321-49fd-a659-4cd684761421-tmp\") pod \"kube-auth-proxy-8bb597df6-dvsj6\" (UID: \"4e343953-5321-49fd-a659-4cd684761421\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"
May 21 21:27:08.139584 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.139477    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e343953-5321-49fd-a659-4cd684761421-tls-certs\") pod \"kube-auth-proxy-8bb597df6-dvsj6\" (UID: \"4e343953-5321-49fd-a659-4cd684761421\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"
May 21 21:27:08.240634 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.240538    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4vrz5\" (UniqueName: \"kubernetes.io/projected/4e343953-5321-49fd-a659-4cd684761421-kube-api-access-4vrz5\") pod \"kube-auth-proxy-8bb597df6-dvsj6\" (UID: \"4e343953-5321-49fd-a659-4cd684761421\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"
May 21 21:27:08.240634 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.240596    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e343953-5321-49fd-a659-4cd684761421-tmp\") pod \"kube-auth-proxy-8bb597df6-dvsj6\" (UID: \"4e343953-5321-49fd-a659-4cd684761421\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"
May 21 21:27:08.240634 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.240619    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e343953-5321-49fd-a659-4cd684761421-tls-certs\") pod \"kube-auth-proxy-8bb597df6-dvsj6\" (UID: \"4e343953-5321-49fd-a659-4cd684761421\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"
May 21 21:27:08.242869 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.242834    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e343953-5321-49fd-a659-4cd684761421-tmp\") pod \"kube-auth-proxy-8bb597df6-dvsj6\" (UID: \"4e343953-5321-49fd-a659-4cd684761421\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"
May 21 21:27:08.243087 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.243070    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4e343953-5321-49fd-a659-4cd684761421-tls-certs\") pod \"kube-auth-proxy-8bb597df6-dvsj6\" (UID: \"4e343953-5321-49fd-a659-4cd684761421\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"
May 21 21:27:08.256354 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.256329    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vrz5\" (UniqueName: \"kubernetes.io/projected/4e343953-5321-49fd-a659-4cd684761421-kube-api-access-4vrz5\") pod \"kube-auth-proxy-8bb597df6-dvsj6\" (UID: \"4e343953-5321-49fd-a659-4cd684761421\") " pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"
May 21 21:27:08.356043 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.356004    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"
May 21 21:27:08.506337 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.506240    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6"]
May 21 21:27:08.510127 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:27:08.510100    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e343953_5321_49fd_a659_4cd684761421.slice/crio-b5ea77cc670ea96865913e8e0ca630262ae806c30f7a7857be72ae98d453d36f WatchSource:0}: Error finding container b5ea77cc670ea96865913e8e0ca630262ae806c30f7a7857be72ae98d453d36f: Status 404 returned error can't find the container with id b5ea77cc670ea96865913e8e0ca630262ae806c30f7a7857be72ae98d453d36f
May 21 21:27:08.914442 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:08.914404    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6" event={"ID":"4e343953-5321-49fd-a659-4cd684761421","Type":"ContainerStarted","Data":"b5ea77cc670ea96865913e8e0ca630262ae806c30f7a7857be72ae98d453d36f"}
May 21 21:27:09.919367 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:09.919333    2576 generic.go:358] "Generic (PLEG): container finished" podID="8c6587ad-c0d6-4988-ba0d-eb6f45971680" containerID="556a4f37a8dd4f8663733c429e331f340294826fdf0eeb48df42b26740eb1198" exitCode=0
May 21 21:27:09.919786 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:09.919430    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7" event={"ID":"8c6587ad-c0d6-4988-ba0d-eb6f45971680","Type":"ContainerDied","Data":"556a4f37a8dd4f8663733c429e331f340294826fdf0eeb48df42b26740eb1198"}
May 21 21:27:10.266355 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.265090    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-tlvg8"]
May 21 21:27:10.279762 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.279728    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8"
May 21 21:27:10.292791 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.292756    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pjptj\""
May 21 21:27:10.293136 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.293035    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 21 21:27:10.300299 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.300270    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-tlvg8"]
May 21 21:27:10.362089 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.362052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc03edfe-7068-4195-95f8-400d668f6169-cert\") pod \"odh-model-controller-858dbf95b8-tlvg8\" (UID: \"fc03edfe-7068-4195-95f8-400d668f6169\") " pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8"
May 21 21:27:10.362337 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.362189    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccz85\" (UniqueName: \"kubernetes.io/projected/fc03edfe-7068-4195-95f8-400d668f6169-kube-api-access-ccz85\") pod \"odh-model-controller-858dbf95b8-tlvg8\" (UID: \"fc03edfe-7068-4195-95f8-400d668f6169\") " pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8"
May 21 21:27:10.462881 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.462811    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ccz85\" (UniqueName: \"kubernetes.io/projected/fc03edfe-7068-4195-95f8-400d668f6169-kube-api-access-ccz85\") pod \"odh-model-controller-858dbf95b8-tlvg8\" (UID: \"fc03edfe-7068-4195-95f8-400d668f6169\") " pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8"
May 21 21:27:10.463113 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.462893    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc03edfe-7068-4195-95f8-400d668f6169-cert\") pod \"odh-model-controller-858dbf95b8-tlvg8\" (UID: \"fc03edfe-7068-4195-95f8-400d668f6169\") " pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8"
May 21 21:27:10.463113 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:27:10.463049    2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 21:27:10.463213 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:27:10.463115    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc03edfe-7068-4195-95f8-400d668f6169-cert podName:fc03edfe-7068-4195-95f8-400d668f6169 nodeName:}" failed. No retries permitted until 2026-05-21 21:27:10.963094581 +0000 UTC m=+356.651469880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fc03edfe-7068-4195-95f8-400d668f6169-cert") pod "odh-model-controller-858dbf95b8-tlvg8" (UID: "fc03edfe-7068-4195-95f8-400d668f6169") : secret "odh-model-controller-webhook-cert" not found
May 21 21:27:10.479229 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.479201    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccz85\" (UniqueName: \"kubernetes.io/projected/fc03edfe-7068-4195-95f8-400d668f6169-kube-api-access-ccz85\") pod \"odh-model-controller-858dbf95b8-tlvg8\" (UID: \"fc03edfe-7068-4195-95f8-400d668f6169\") " pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8"
May 21 21:27:10.924470 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.924380    2576 generic.go:358] "Generic (PLEG): container finished" podID="8c6587ad-c0d6-4988-ba0d-eb6f45971680" containerID="e574f2fd1eaf25776755f963ee907c6a21511d37155f9c280da151f75be74f7c" exitCode=0
May 21 21:27:10.924796 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.924467    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7" event={"ID":"8c6587ad-c0d6-4988-ba0d-eb6f45971680","Type":"ContainerDied","Data":"e574f2fd1eaf25776755f963ee907c6a21511d37155f9c280da151f75be74f7c"}
May 21 21:27:10.966862 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.966833    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc03edfe-7068-4195-95f8-400d668f6169-cert\") pod \"odh-model-controller-858dbf95b8-tlvg8\" (UID: \"fc03edfe-7068-4195-95f8-400d668f6169\") " pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8"
May 21 21:27:10.969284 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:10.969258    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc03edfe-7068-4195-95f8-400d668f6169-cert\") pod \"odh-model-controller-858dbf95b8-tlvg8\" (UID: \"fc03edfe-7068-4195-95f8-400d668f6169\") " pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8"
May 21 21:27:11.195166 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:11.195085    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8"
May 21 21:27:11.340680 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:11.340613    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-tlvg8"]
May 21 21:27:11.925080 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:27:11.925044    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc03edfe_7068_4195_95f8_400d668f6169.slice/crio-2c93152166744143fcab41dff28f061a578b8c3e29e46cab72e7c8b4de038019 WatchSource:0}: Error finding container 2c93152166744143fcab41dff28f061a578b8c3e29e46cab72e7c8b4de038019: Status 404 returned error can't find the container with id 2c93152166744143fcab41dff28f061a578b8c3e29e46cab72e7c8b4de038019
May 21 21:27:12.063190 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.062917    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"
May 21 21:27:12.177720 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.177626    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjctj\" (UniqueName: \"kubernetes.io/projected/8c6587ad-c0d6-4988-ba0d-eb6f45971680-kube-api-access-bjctj\") pod \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\" (UID: \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\") "
May 21 21:27:12.177720 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.177704    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c6587ad-c0d6-4988-ba0d-eb6f45971680-util\") pod \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\" (UID: \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\") "
May 21 21:27:12.177942 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.177767    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c6587ad-c0d6-4988-ba0d-eb6f45971680-bundle\") pod \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\" (UID: \"8c6587ad-c0d6-4988-ba0d-eb6f45971680\") "
May 21 21:27:12.178708 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.178676    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c6587ad-c0d6-4988-ba0d-eb6f45971680-bundle" (OuterVolumeSpecName: "bundle") pod "8c6587ad-c0d6-4988-ba0d-eb6f45971680" (UID: "8c6587ad-c0d6-4988-ba0d-eb6f45971680"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:27:12.179750 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.179715    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c6587ad-c0d6-4988-ba0d-eb6f45971680-kube-api-access-bjctj" (OuterVolumeSpecName: "kube-api-access-bjctj") pod "8c6587ad-c0d6-4988-ba0d-eb6f45971680" (UID: "8c6587ad-c0d6-4988-ba0d-eb6f45971680"). InnerVolumeSpecName "kube-api-access-bjctj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:27:12.188300 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.188271    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c6587ad-c0d6-4988-ba0d-eb6f45971680-util" (OuterVolumeSpecName: "util") pod "8c6587ad-c0d6-4988-ba0d-eb6f45971680" (UID: "8c6587ad-c0d6-4988-ba0d-eb6f45971680"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:27:12.278507 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.278466    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c6587ad-c0d6-4988-ba0d-eb6f45971680-bundle\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:27:12.278507 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.278502    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjctj\" (UniqueName: \"kubernetes.io/projected/8c6587ad-c0d6-4988-ba0d-eb6f45971680-kube-api-access-bjctj\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:27:12.278507 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.278512    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c6587ad-c0d6-4988-ba0d-eb6f45971680-util\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:27:12.934282 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.934220    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7" event={"ID":"8c6587ad-c0d6-4988-ba0d-eb6f45971680","Type":"ContainerDied","Data":"2a681ff87593c7a26d5faa6201409647e29e6939273285a852a093d8d362a6e6"}
May 21 21:27:12.934282 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.934251    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835q62t7"
May 21 21:27:12.934282 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.934261    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a681ff87593c7a26d5faa6201409647e29e6939273285a852a093d8d362a6e6"
May 21 21:27:12.937583 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.936874    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6" event={"ID":"4e343953-5321-49fd-a659-4cd684761421","Type":"ContainerStarted","Data":"5dce6e9006c71ae3eb372e6aa1179d685707153803d2a245509cb56778037cda"}
May 21 21:27:12.939356 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.939314    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8" event={"ID":"fc03edfe-7068-4195-95f8-400d668f6169","Type":"ContainerStarted","Data":"2c93152166744143fcab41dff28f061a578b8c3e29e46cab72e7c8b4de038019"}
May 21 21:27:12.974706 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:12.974645    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8bb597df6-dvsj6" podStartSLOduration=1.495061395 podStartE2EDuration="4.974626428s" podCreationTimestamp="2026-05-21 21:27:08 +0000 UTC" firstStartedPulling="2026-05-21 21:27:08.511787575 +0000 UTC m=+354.200162874" lastFinishedPulling="2026-05-21 21:27:11.991352594 +0000 UTC m=+357.679727907" observedRunningTime="2026-05-21 21:27:12.969108149 +0000 UTC m=+358.657483495" watchObservedRunningTime="2026-05-21 21:27:12.974626428 +0000 UTC m=+358.663001750"
May 21 21:27:15.950670 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:15.950625    2576 generic.go:358] "Generic (PLEG): container finished" podID="fc03edfe-7068-4195-95f8-400d668f6169" containerID="568757104c438eab0fa5f4e120f684938e0c51bc2dd419547836f7afc732f212" exitCode=1
May 21 21:27:15.951059 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:15.950710    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8" event={"ID":"fc03edfe-7068-4195-95f8-400d668f6169","Type":"ContainerDied","Data":"568757104c438eab0fa5f4e120f684938e0c51bc2dd419547836f7afc732f212"}
May 21 21:27:15.951059 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:15.950940    2576 scope.go:117] "RemoveContainer" containerID="568757104c438eab0fa5f4e120f684938e0c51bc2dd419547836f7afc732f212"
May 21 21:27:16.956958 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:16.956922    2576 generic.go:358] "Generic (PLEG): container finished" podID="fc03edfe-7068-4195-95f8-400d668f6169" containerID="f138ace44c8ca54f3d82c7c1c8215323052f09a36a49c4eed8f3d28131bf8636" exitCode=1
May 21 21:27:16.957417 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:16.957003    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8" event={"ID":"fc03edfe-7068-4195-95f8-400d668f6169","Type":"ContainerDied","Data":"f138ace44c8ca54f3d82c7c1c8215323052f09a36a49c4eed8f3d28131bf8636"}
May 21 21:27:16.957417 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:16.957049    2576 scope.go:117] "RemoveContainer" containerID="568757104c438eab0fa5f4e120f684938e0c51bc2dd419547836f7afc732f212"
May 21 21:27:16.957417 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:16.957279    2576 scope.go:117] "RemoveContainer" containerID="f138ace44c8ca54f3d82c7c1c8215323052f09a36a49c4eed8f3d28131bf8636"
May 21 21:27:16.957587 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:27:16.957496    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-tlvg8_opendatahub(fc03edfe-7068-4195-95f8-400d668f6169)\"" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8" podUID="fc03edfe-7068-4195-95f8-400d668f6169"
May 21 21:27:17.013754 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.013717    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7r67b"]
May 21 21:27:17.014082 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.014061    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c6587ad-c0d6-4988-ba0d-eb6f45971680" containerName="extract"
May 21 21:27:17.014149 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.014086    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c6587ad-c0d6-4988-ba0d-eb6f45971680" containerName="extract"
May 21 21:27:17.014149 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.014117    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c6587ad-c0d6-4988-ba0d-eb6f45971680" containerName="util"
May 21 21:27:17.014149 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.014125    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c6587ad-c0d6-4988-ba0d-eb6f45971680" containerName="util"
May 21 21:27:17.014149 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.014134    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c6587ad-c0d6-4988-ba0d-eb6f45971680" containerName="pull"
May 21 21:27:17.014149 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.014142    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c6587ad-c0d6-4988-ba0d-eb6f45971680" containerName="pull"
May 21 21:27:17.014345 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.014206    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c6587ad-c0d6-4988-ba0d-eb6f45971680" containerName="extract"
May 21 21:27:17.018542 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.018518    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-7r67b"
May 21 21:27:17.026320 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.026293    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-pwzw8\""
May 21 21:27:17.026819 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.026800    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 21 21:27:17.043360 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.043319    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7r67b"]
May 21 21:27:17.118763 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.118719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c64c3fc-7aa9-4694-9a52-16ab60693020-cert\") pod \"kserve-controller-manager-856948b99f-7r67b\" (UID: \"7c64c3fc-7aa9-4694-9a52-16ab60693020\") " pod="opendatahub/kserve-controller-manager-856948b99f-7r67b"
May 21 21:27:17.118967 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.118821    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8vqp\" (UniqueName: \"kubernetes.io/projected/7c64c3fc-7aa9-4694-9a52-16ab60693020-kube-api-access-k8vqp\") pod \"kserve-controller-manager-856948b99f-7r67b\" (UID: \"7c64c3fc-7aa9-4694-9a52-16ab60693020\") " pod="opendatahub/kserve-controller-manager-856948b99f-7r67b"
May 21 21:27:17.220324 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.220223    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c64c3fc-7aa9-4694-9a52-16ab60693020-cert\") pod \"kserve-controller-manager-856948b99f-7r67b\" (UID: \"7c64c3fc-7aa9-4694-9a52-16ab60693020\") " pod="opendatahub/kserve-controller-manager-856948b99f-7r67b"
May 21 21:27:17.220488 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.220328    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8vqp\" (UniqueName: \"kubernetes.io/projected/7c64c3fc-7aa9-4694-9a52-16ab60693020-kube-api-access-k8vqp\") pod \"kserve-controller-manager-856948b99f-7r67b\" (UID: \"7c64c3fc-7aa9-4694-9a52-16ab60693020\") " pod="opendatahub/kserve-controller-manager-856948b99f-7r67b"
May 21 21:27:17.220488 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:27:17.220394    2576 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 21 21:27:17.220488 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:27:17.220470    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c64c3fc-7aa9-4694-9a52-16ab60693020-cert podName:7c64c3fc-7aa9-4694-9a52-16ab60693020 nodeName:}" failed. No retries permitted until 2026-05-21 21:27:17.720454431 +0000 UTC m=+363.408829731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7c64c3fc-7aa9-4694-9a52-16ab60693020-cert") pod "kserve-controller-manager-856948b99f-7r67b" (UID: "7c64c3fc-7aa9-4694-9a52-16ab60693020") : secret "kserve-webhook-server-cert" not found
May 21 21:27:17.246113 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.246079    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8vqp\" (UniqueName: \"kubernetes.io/projected/7c64c3fc-7aa9-4694-9a52-16ab60693020-kube-api-access-k8vqp\") pod \"kserve-controller-manager-856948b99f-7r67b\" (UID: \"7c64c3fc-7aa9-4694-9a52-16ab60693020\") " pod="opendatahub/kserve-controller-manager-856948b99f-7r67b"
May 21 21:27:17.725037 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.724966    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c64c3fc-7aa9-4694-9a52-16ab60693020-cert\") pod \"kserve-controller-manager-856948b99f-7r67b\" (UID: \"7c64c3fc-7aa9-4694-9a52-16ab60693020\") " pod="opendatahub/kserve-controller-manager-856948b99f-7r67b"
May 21 21:27:17.727456 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.727425    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c64c3fc-7aa9-4694-9a52-16ab60693020-cert\") pod \"kserve-controller-manager-856948b99f-7r67b\" (UID: \"7c64c3fc-7aa9-4694-9a52-16ab60693020\") " pod="opendatahub/kserve-controller-manager-856948b99f-7r67b"
May 21 21:27:17.929523 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.929494    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-7r67b"
May 21 21:27:17.962041 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:17.962014    2576 scope.go:117] "RemoveContainer" containerID="f138ace44c8ca54f3d82c7c1c8215323052f09a36a49c4eed8f3d28131bf8636"
May 21 21:27:17.962419 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:27:17.962210    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-tlvg8_opendatahub(fc03edfe-7068-4195-95f8-400d668f6169)\"" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8" podUID="fc03edfe-7068-4195-95f8-400d668f6169"
May 21 21:27:18.070282 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:18.070252    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7r67b"]
May 21 21:27:18.072551 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:27:18.072515    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c64c3fc_7aa9_4694_9a52_16ab60693020.slice/crio-c3836f7addaf2a63b5a81a07f5a65c9dfd23ec0dcb175ccd7dc98a01cf620e05 WatchSource:0}: Error finding container c3836f7addaf2a63b5a81a07f5a65c9dfd23ec0dcb175ccd7dc98a01cf620e05: Status 404 returned error can't find the container with id c3836f7addaf2a63b5a81a07f5a65c9dfd23ec0dcb175ccd7dc98a01cf620e05
May 21 21:27:18.967116 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:18.967076    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-7r67b" event={"ID":"7c64c3fc-7aa9-4694-9a52-16ab60693020","Type":"ContainerStarted","Data":"c3836f7addaf2a63b5a81a07f5a65c9dfd23ec0dcb175ccd7dc98a01cf620e05"}
May 21 21:27:21.195393 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:21.195357    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8"
May 21 21:27:21.195765 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:21.195750    2576 scope.go:117] "RemoveContainer" containerID="f138ace44c8ca54f3d82c7c1c8215323052f09a36a49c4eed8f3d28131bf8636"
May 21 21:27:21.195971 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:27:21.195954    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-tlvg8_opendatahub(fc03edfe-7068-4195-95f8-400d668f6169)\"" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8" podUID="fc03edfe-7068-4195-95f8-400d668f6169"
May 21 21:27:22.719494 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.719459    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"]
May 21 21:27:22.748695 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.748661    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"
May 21 21:27:22.751667 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.751636    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 21 21:27:22.752770 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.752742    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gfbhl\""
May 21 21:27:22.755215 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.755177    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"]
May 21 21:27:22.757630 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.757606    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 21 21:27:22.870053 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.870020    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e622826-a848-4e6d-8a6b-a41aab440a5b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5\" (UID: \"1e622826-a848-4e6d-8a6b-a41aab440a5b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"
May 21 21:27:22.870228 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.870144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e622826-a848-4e6d-8a6b-a41aab440a5b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5\" (UID: \"1e622826-a848-4e6d-8a6b-a41aab440a5b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"
May 21 21:27:22.870228 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.870175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh4sv\" (UniqueName: \"kubernetes.io/projected/1e622826-a848-4e6d-8a6b-a41aab440a5b-kube-api-access-sh4sv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5\" (UID: \"1e622826-a848-4e6d-8a6b-a41aab440a5b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"
May 21 21:27:22.971572 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.971471    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e622826-a848-4e6d-8a6b-a41aab440a5b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5\" (UID: \"1e622826-a848-4e6d-8a6b-a41aab440a5b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"
May 21 21:27:22.971572 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.971518    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sh4sv\" (UniqueName: \"kubernetes.io/projected/1e622826-a848-4e6d-8a6b-a41aab440a5b-kube-api-access-sh4sv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5\" (UID: \"1e622826-a848-4e6d-8a6b-a41aab440a5b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"
May 21 21:27:22.971572 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.971566    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e622826-a848-4e6d-8a6b-a41aab440a5b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5\" (UID: \"1e622826-a848-4e6d-8a6b-a41aab440a5b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"
May 21 21:27:22.971863 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.971847    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e622826-a848-4e6d-8a6b-a41aab440a5b-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5\" (UID: \"1e622826-a848-4e6d-8a6b-a41aab440a5b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"
May 21 21:27:22.971948 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.971927    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e622826-a848-4e6d-8a6b-a41aab440a5b-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5\" (UID: \"1e622826-a848-4e6d-8a6b-a41aab440a5b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"
May 21 21:27:22.982496 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.982464    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-7r67b" event={"ID":"7c64c3fc-7aa9-4694-9a52-16ab60693020","Type":"ContainerStarted","Data":"f48d44760629c43e9c8683a6a81af17a28fa600c9e6ed0eefa15a27bab35fedb"}
May 21 21:27:22.982652 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:22.982579    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-7r67b"
May 21 21:27:23.077340 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:23.077305    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh4sv\" (UniqueName: \"kubernetes.io/projected/1e622826-a848-4e6d-8a6b-a41aab440a5b-kube-api-access-sh4sv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5\" (UID: \"1e622826-a848-4e6d-8a6b-a41aab440a5b\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"
May 21 21:27:23.177451 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:23.177397    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-7r67b" podStartSLOduration=3.160305666 podStartE2EDuration="7.177379755s" podCreationTimestamp="2026-05-21 21:27:16 +0000 UTC" firstStartedPulling="2026-05-21 21:27:18.07426271 +0000 UTC m=+363.762638010" lastFinishedPulling="2026-05-21 21:27:22.09133678 +0000 UTC m=+367.779712099" observedRunningTime="2026-05-21 21:27:23.175604541 +0000 UTC m=+368.863979864" watchObservedRunningTime="2026-05-21 21:27:23.177379755 +0000 UTC m=+368.865755076"
May 21 21:27:23.359865 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:23.359821    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"
May 21 21:27:23.549310 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:23.549269    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"]
May 21 21:27:23.552938 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:27:23.552906    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e622826_a848_4e6d_8a6b_a41aab440a5b.slice/crio-ea2791f84360a11db868a0d5c85649897b3e0052955ccb0e1b8286795a9d3399 WatchSource:0}: Error finding container ea2791f84360a11db868a0d5c85649897b3e0052955ccb0e1b8286795a9d3399: Status 404 returned error can't find the container with id ea2791f84360a11db868a0d5c85649897b3e0052955ccb0e1b8286795a9d3399
May 21 21:27:23.986748 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:23.986666    2576 generic.go:358] "Generic (PLEG): container finished" podID="1e622826-a848-4e6d-8a6b-a41aab440a5b" containerID="542f5db1068cc07ec2a21f195f1d167b81c03befa4dbc5bba8bf2d1edad17dcd" exitCode=0
May 21 21:27:23.987167 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:23.986760    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5" event={"ID":"1e622826-a848-4e6d-8a6b-a41aab440a5b","Type":"ContainerDied","Data":"542f5db1068cc07ec2a21f195f1d167b81c03befa4dbc5bba8bf2d1edad17dcd"}
May 21 21:27:23.987167 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:23.986795    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5" event={"ID":"1e622826-a848-4e6d-8a6b-a41aab440a5b","Type":"ContainerStarted","Data":"ea2791f84360a11db868a0d5c85649897b3e0052955ccb0e1b8286795a9d3399"}
May 21 21:27:25.995869 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:25.995836    2576 generic.go:358] "Generic (PLEG): container finished" podID="1e622826-a848-4e6d-8a6b-a41aab440a5b" containerID="ae493961ed3f59b09ad26ec9598c227a6ee38ffcffdddb727c108806d4895218" exitCode=0
May 21 21:27:25.996287 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:25.995897    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5" event={"ID":"1e622826-a848-4e6d-8a6b-a41aab440a5b","Type":"ContainerDied","Data":"ae493961ed3f59b09ad26ec9598c227a6ee38ffcffdddb727c108806d4895218"}
May 21 21:27:27.000818 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.000779    2576 generic.go:358] "Generic (PLEG): container finished" podID="1e622826-a848-4e6d-8a6b-a41aab440a5b" containerID="235ab334670fc43490673c575962589d0f30430793976d619ce48a590384481b" exitCode=0
May 21 21:27:27.001210 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.000900    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5" event={"ID":"1e622826-a848-4e6d-8a6b-a41aab440a5b","Type":"ContainerDied","Data":"235ab334670fc43490673c575962589d0f30430793976d619ce48a590384481b"}
May 21 21:27:27.115039 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.114998    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl"]
May 21 21:27:27.118363 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.118338    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl"
May 21 21:27:27.122603 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.122578    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 21 21:27:27.124682 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.124653    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 21 21:27:27.126113 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.126094    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-5rrgx\""
May 21 21:27:27.160168 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.160133    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl"]
May 21 21:27:27.203418 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.203386    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2fa4b243-f6c1-4c69-a736-39cf213f4a0f-operator-config\") pod \"servicemesh-operator3-55f49c5f94-hhzhl\" (UID: \"2fa4b243-f6c1-4c69-a736-39cf213f4a0f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl"
May 21 21:27:27.203593 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.203424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wp58\" (UniqueName: \"kubernetes.io/projected/2fa4b243-f6c1-4c69-a736-39cf213f4a0f-kube-api-access-2wp58\") pod \"servicemesh-operator3-55f49c5f94-hhzhl\" (UID: \"2fa4b243-f6c1-4c69-a736-39cf213f4a0f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl"
May 21 21:27:27.303839 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.303808    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2fa4b243-f6c1-4c69-a736-39cf213f4a0f-operator-config\") pod \"servicemesh-operator3-55f49c5f94-hhzhl\" (UID: \"2fa4b243-f6c1-4c69-a736-39cf213f4a0f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl"
May 21 21:27:27.304045 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.303856    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wp58\" (UniqueName: \"kubernetes.io/projected/2fa4b243-f6c1-4c69-a736-39cf213f4a0f-kube-api-access-2wp58\") pod \"servicemesh-operator3-55f49c5f94-hhzhl\" (UID: \"2fa4b243-f6c1-4c69-a736-39cf213f4a0f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl"
May 21 21:27:27.306515 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.306481    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/2fa4b243-f6c1-4c69-a736-39cf213f4a0f-operator-config\") pod \"servicemesh-operator3-55f49c5f94-hhzhl\" (UID: \"2fa4b243-f6c1-4c69-a736-39cf213f4a0f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl"
May 21 21:27:27.318933 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.318897    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wp58\" (UniqueName: \"kubernetes.io/projected/2fa4b243-f6c1-4c69-a736-39cf213f4a0f-kube-api-access-2wp58\") pod \"servicemesh-operator3-55f49c5f94-hhzhl\" (UID: \"2fa4b243-f6c1-4c69-a736-39cf213f4a0f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl"
May 21 21:27:27.428410 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.428360    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl"
May 21 21:27:27.612083 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:27.612052    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl"]
May 21 21:27:27.612930 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:27:27.612901    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa4b243_f6c1_4c69_a736_39cf213f4a0f.slice/crio-db74e69350e309f52227f7659922f0696519baa4998f459a2de47bb0bbbace34 WatchSource:0}: Error finding container db74e69350e309f52227f7659922f0696519baa4998f459a2de47bb0bbbace34: Status 404 returned error can't find the container with id db74e69350e309f52227f7659922f0696519baa4998f459a2de47bb0bbbace34
May 21 21:27:28.005740 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:28.005648    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl" event={"ID":"2fa4b243-f6c1-4c69-a736-39cf213f4a0f","Type":"ContainerStarted","Data":"db74e69350e309f52227f7659922f0696519baa4998f459a2de47bb0bbbace34"}
May 21 21:27:28.115921 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:28.115898    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"
May 21 21:27:28.210837 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:28.210809    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sh4sv\" (UniqueName: \"kubernetes.io/projected/1e622826-a848-4e6d-8a6b-a41aab440a5b-kube-api-access-sh4sv\") pod \"1e622826-a848-4e6d-8a6b-a41aab440a5b\" (UID: \"1e622826-a848-4e6d-8a6b-a41aab440a5b\") "
May 21 21:27:28.211012 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:28.210874    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e622826-a848-4e6d-8a6b-a41aab440a5b-util\") pod \"1e622826-a848-4e6d-8a6b-a41aab440a5b\" (UID: \"1e622826-a848-4e6d-8a6b-a41aab440a5b\") "
May 21 21:27:28.211012 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:28.210901    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e622826-a848-4e6d-8a6b-a41aab440a5b-bundle\") pod \"1e622826-a848-4e6d-8a6b-a41aab440a5b\" (UID: \"1e622826-a848-4e6d-8a6b-a41aab440a5b\") "
May 21 21:27:28.211878 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:28.211853    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e622826-a848-4e6d-8a6b-a41aab440a5b-bundle" (OuterVolumeSpecName: "bundle") pod "1e622826-a848-4e6d-8a6b-a41aab440a5b" (UID: "1e622826-a848-4e6d-8a6b-a41aab440a5b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:27:28.212866 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:28.212846    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e622826-a848-4e6d-8a6b-a41aab440a5b-kube-api-access-sh4sv" (OuterVolumeSpecName: "kube-api-access-sh4sv") pod "1e622826-a848-4e6d-8a6b-a41aab440a5b" (UID: "1e622826-a848-4e6d-8a6b-a41aab440a5b"). InnerVolumeSpecName "kube-api-access-sh4sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:27:28.216717 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:28.216693    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e622826-a848-4e6d-8a6b-a41aab440a5b-util" (OuterVolumeSpecName: "util") pod "1e622826-a848-4e6d-8a6b-a41aab440a5b" (UID: "1e622826-a848-4e6d-8a6b-a41aab440a5b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:27:28.311455 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:28.311422    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e622826-a848-4e6d-8a6b-a41aab440a5b-bundle\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:27:28.311542 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:28.311455    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sh4sv\" (UniqueName: \"kubernetes.io/projected/1e622826-a848-4e6d-8a6b-a41aab440a5b-kube-api-access-sh4sv\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:27:28.311542 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:28.311473    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e622826-a848-4e6d-8a6b-a41aab440a5b-util\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:27:29.011412 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:29.011379    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5"
May 21 21:27:29.011820 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:29.011378    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a8tdp5" event={"ID":"1e622826-a848-4e6d-8a6b-a41aab440a5b","Type":"ContainerDied","Data":"ea2791f84360a11db868a0d5c85649897b3e0052955ccb0e1b8286795a9d3399"}
May 21 21:27:29.011820 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:29.011506    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea2791f84360a11db868a0d5c85649897b3e0052955ccb0e1b8286795a9d3399"
May 21 21:27:31.021155 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:31.021114    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl" event={"ID":"2fa4b243-f6c1-4c69-a736-39cf213f4a0f","Type":"ContainerStarted","Data":"c3406e95440735a002c566339dcd139b4c1cf2226e8ef79592b351a2b8be8117"}
May 21 21:27:31.021630 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:31.021250    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl"
May 21 21:27:31.195764 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:31.195733    2576 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8"
May 21 21:27:31.196157 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:31.196143    2576 scope.go:117] "RemoveContainer" containerID="f138ace44c8ca54f3d82c7c1c8215323052f09a36a49c4eed8f3d28131bf8636"
May 21 21:27:32.026713 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:32.026670    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8" event={"ID":"fc03edfe-7068-4195-95f8-400d668f6169","Type":"ContainerStarted","Data":"bad4cf1a23717e41cae48b8c9a5864b3dc05ff867c78b253fa5f756afa352e68"}
May 21 21:27:32.027148 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:32.027018    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8"
May 21 21:27:32.072550 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:32.072495    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl" podStartSLOduration=2.472375364 podStartE2EDuration="5.072477992s" podCreationTimestamp="2026-05-21 21:27:27 +0000 UTC" firstStartedPulling="2026-05-21 21:27:27.615462436 +0000 UTC m=+373.303837735" lastFinishedPulling="2026-05-21 21:27:30.215565045 +0000 UTC m=+375.903940363" observedRunningTime="2026-05-21 21:27:31.109136895 +0000 UTC m=+376.797512216" watchObservedRunningTime="2026-05-21 21:27:32.072477992 +0000 UTC m=+377.760853313"
May 21 21:27:32.072972 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:32.072946    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8" podStartSLOduration=2.498385636 podStartE2EDuration="22.072939352s" podCreationTimestamp="2026-05-21 21:27:10 +0000 UTC" firstStartedPulling="2026-05-21 21:27:11.926676451 +0000 UTC m=+357.615051764" lastFinishedPulling="2026-05-21 21:27:31.501230181 +0000 UTC m=+377.189605480" observedRunningTime="2026-05-21 21:27:32.070295302 +0000 UTC m=+377.758670605" watchObservedRunningTime="2026-05-21 21:27:32.072939352 +0000 UTC m=+377.761314677"
May 21 21:27:36.662551 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.662510    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"]
May 21 21:27:36.663037 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.662810    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e622826-a848-4e6d-8a6b-a41aab440a5b" containerName="extract"
May 21 21:27:36.663037 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.662822    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e622826-a848-4e6d-8a6b-a41aab440a5b" containerName="extract"
May 21 21:27:36.663037 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.662845    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e622826-a848-4e6d-8a6b-a41aab440a5b" containerName="util"
May 21 21:27:36.663037 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.662851    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e622826-a848-4e6d-8a6b-a41aab440a5b" containerName="util"
May 21 21:27:36.663037 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.662857    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e622826-a848-4e6d-8a6b-a41aab440a5b" containerName="pull"
May 21 21:27:36.663037 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.662862    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e622826-a848-4e6d-8a6b-a41aab440a5b" containerName="pull"
May 21 21:27:36.663037 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.662906    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="1e622826-a848-4e6d-8a6b-a41aab440a5b" containerName="extract"
May 21 21:27:36.665423 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.665406    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.669381 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.669349    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 21 21:27:36.669512 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.669385    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 21 21:27:36.669512 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.669398    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zg5ql\""
May 21 21:27:36.669703 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.669685    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 21:27:36.669810 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.669718    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 21 21:27:36.679494 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.679468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/285af562-70a3-44ec-9a64-1ff3bc80a58f-cacerts\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.679619 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.679499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdqqs\" (UniqueName: \"kubernetes.io/projected/285af562-70a3-44ec-9a64-1ff3bc80a58f-kube-api-access-sdqqs\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.679619 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.679519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/285af562-70a3-44ec-9a64-1ff3bc80a58f-local-certs\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.679619 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.679592    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/285af562-70a3-44ec-9a64-1ff3bc80a58f-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.679738 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.679626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/285af562-70a3-44ec-9a64-1ff3bc80a58f-istio-token\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.679738 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.679647    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/285af562-70a3-44ec-9a64-1ff3bc80a58f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.679738 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.679666    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/285af562-70a3-44ec-9a64-1ff3bc80a58f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.685692 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.685667    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"]
May 21 21:27:36.780428 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.780383    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/285af562-70a3-44ec-9a64-1ff3bc80a58f-cacerts\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.780428 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.780427    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdqqs\" (UniqueName: \"kubernetes.io/projected/285af562-70a3-44ec-9a64-1ff3bc80a58f-kube-api-access-sdqqs\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.780680 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.780447    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/285af562-70a3-44ec-9a64-1ff3bc80a58f-local-certs\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.780680 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.780493    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/285af562-70a3-44ec-9a64-1ff3bc80a58f-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.780680 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.780519    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/285af562-70a3-44ec-9a64-1ff3bc80a58f-istio-token\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.780680 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.780542    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/285af562-70a3-44ec-9a64-1ff3bc80a58f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.780680 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.780568    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/285af562-70a3-44ec-9a64-1ff3bc80a58f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.781271 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.781237    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/285af562-70a3-44ec-9a64-1ff3bc80a58f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.783000 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.782962    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/285af562-70a3-44ec-9a64-1ff3bc80a58f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.783124 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.783017    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/285af562-70a3-44ec-9a64-1ff3bc80a58f-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.783293 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.783270    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/285af562-70a3-44ec-9a64-1ff3bc80a58f-local-certs\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.783401 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.783384    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/285af562-70a3-44ec-9a64-1ff3bc80a58f-cacerts\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.796049 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.796015    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/285af562-70a3-44ec-9a64-1ff3bc80a58f-istio-token\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.797052 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.797027    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdqqs\" (UniqueName: \"kubernetes.io/projected/285af562-70a3-44ec-9a64-1ff3bc80a58f-kube-api-access-sdqqs\") pod \"istiod-openshift-gateway-798958bb55-lspb6\" (UID: \"285af562-70a3-44ec-9a64-1ff3bc80a58f\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:36.977088 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:36.976973    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:37.139082 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:37.139048    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"]
May 21 21:27:37.147342 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:27:37.147304    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285af562_70a3_44ec_9a64_1ff3bc80a58f.slice/crio-5aa9fb317e5c0f10abe151552fff121aee9d6c1efb7399473df83f7f49f8c410 WatchSource:0}: Error finding container 5aa9fb317e5c0f10abe151552fff121aee9d6c1efb7399473df83f7f49f8c410: Status 404 returned error can't find the container with id 5aa9fb317e5c0f10abe151552fff121aee9d6c1efb7399473df83f7f49f8c410
May 21 21:27:38.051095 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:38.051053    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6" event={"ID":"285af562-70a3-44ec-9a64-1ff3bc80a58f","Type":"ContainerStarted","Data":"5aa9fb317e5c0f10abe151552fff121aee9d6c1efb7399473df83f7f49f8c410"}
May 21 21:27:39.554825 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:39.554789    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 21 21:27:39.555107 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:39.554858    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
May 21 21:27:40.059955 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:40.059917    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6" event={"ID":"285af562-70a3-44ec-9a64-1ff3bc80a58f","Type":"ContainerStarted","Data":"333d3b8114b5d774ac2ab7d198dc635e6fde42de4e5f678ab2daaad2203123f3"}
May 21 21:27:40.059955 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:40.059965    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:40.061898 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:40.061871    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-lspb6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 21 21:27:40.062110 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:40.061926    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6" podUID="285af562-70a3-44ec-9a64-1ff3bc80a58f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 21:27:40.104919 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:40.104851    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6" podStartSLOduration=1.699449835 podStartE2EDuration="4.104829606s" podCreationTimestamp="2026-05-21 21:27:36 +0000 UTC" firstStartedPulling="2026-05-21 21:27:37.149170561 +0000 UTC m=+382.837545861" lastFinishedPulling="2026-05-21 21:27:39.554550322 +0000 UTC m=+385.242925632" observedRunningTime="2026-05-21 21:27:40.101830974 +0000 UTC m=+385.790206294" watchObservedRunningTime="2026-05-21 21:27:40.104829606 +0000 UTC m=+385.793204928"
May 21 21:27:41.070043 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:41.070007    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-lspb6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 21 21:27:41.070623 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:41.070595    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6" podUID="285af562-70a3-44ec-9a64-1ff3bc80a58f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 21:27:42.029836 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:42.029801    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-hhzhl"
May 21 21:27:43.032381 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:43.032339    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-tlvg8"
May 21 21:27:44.066549 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:44.066514    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-lspb6"
May 21 21:27:53.992205 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:27:53.992170    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-7r67b"
May 21 21:28:22.427642 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.427605    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"]
May 21 21:28:22.436410 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.436369    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"
May 21 21:28:22.439386 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.439360    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 21:28:22.440252 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.440229    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 21:28:22.440451 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.440253    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wprb5\""
May 21 21:28:22.443286 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.443261    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"]
May 21 21:28:22.574411 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.574365    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5807ab5e-6469-48e8-a123-3d91889cb5fd-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg\" (UID: \"5807ab5e-6469-48e8-a123-3d91889cb5fd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"
May 21 21:28:22.574411 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.574416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gb5k\" (UniqueName: \"kubernetes.io/projected/5807ab5e-6469-48e8-a123-3d91889cb5fd-kube-api-access-2gb5k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg\" (UID: \"5807ab5e-6469-48e8-a123-3d91889cb5fd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"
May 21 21:28:22.574685 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.574545    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5807ab5e-6469-48e8-a123-3d91889cb5fd-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg\" (UID: \"5807ab5e-6469-48e8-a123-3d91889cb5fd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"
May 21 21:28:22.675720 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.675672    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5807ab5e-6469-48e8-a123-3d91889cb5fd-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg\" (UID: \"5807ab5e-6469-48e8-a123-3d91889cb5fd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"
May 21 21:28:22.675910 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.675827    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5807ab5e-6469-48e8-a123-3d91889cb5fd-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg\" (UID: \"5807ab5e-6469-48e8-a123-3d91889cb5fd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"
May 21 21:28:22.675910 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.675865    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2gb5k\" (UniqueName: \"kubernetes.io/projected/5807ab5e-6469-48e8-a123-3d91889cb5fd-kube-api-access-2gb5k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg\" (UID: \"5807ab5e-6469-48e8-a123-3d91889cb5fd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"
May 21 21:28:22.676137 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.676111    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5807ab5e-6469-48e8-a123-3d91889cb5fd-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg\" (UID: \"5807ab5e-6469-48e8-a123-3d91889cb5fd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"
May 21 21:28:22.676197 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.676135    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5807ab5e-6469-48e8-a123-3d91889cb5fd-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg\" (UID: \"5807ab5e-6469-48e8-a123-3d91889cb5fd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"
May 21 21:28:22.689800 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.689724    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gb5k\" (UniqueName: \"kubernetes.io/projected/5807ab5e-6469-48e8-a123-3d91889cb5fd-kube-api-access-2gb5k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg\" (UID: \"5807ab5e-6469-48e8-a123-3d91889cb5fd\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"
May 21 21:28:22.748125 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.748081    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"
May 21 21:28:22.895926 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:22.895856    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"]
May 21 21:28:22.898433 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:28:22.898402    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5807ab5e_6469_48e8_a123_3d91889cb5fd.slice/crio-e531a246f9cbadb049cc41a4ab884e7b6aa82e171f918611459b59c1aeb2e1bb WatchSource:0}: Error finding container e531a246f9cbadb049cc41a4ab884e7b6aa82e171f918611459b59c1aeb2e1bb: Status 404 returned error can't find the container with id e531a246f9cbadb049cc41a4ab884e7b6aa82e171f918611459b59c1aeb2e1bb
May 21 21:28:23.214361 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.214278    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"]
May 21 21:28:23.216689 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.216672    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"
May 21 21:28:23.224112 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.224088    2576 generic.go:358] "Generic (PLEG): container finished" podID="5807ab5e-6469-48e8-a123-3d91889cb5fd" containerID="572c67816bb6c218b48488330be9255788038060417ad92b5098132bf74916d7" exitCode=0
May 21 21:28:23.224230 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.224142    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg" event={"ID":"5807ab5e-6469-48e8-a123-3d91889cb5fd","Type":"ContainerDied","Data":"572c67816bb6c218b48488330be9255788038060417ad92b5098132bf74916d7"}
May 21 21:28:23.224230 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.224165    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg" event={"ID":"5807ab5e-6469-48e8-a123-3d91889cb5fd","Type":"ContainerStarted","Data":"e531a246f9cbadb049cc41a4ab884e7b6aa82e171f918611459b59c1aeb2e1bb"}
May 21 21:28:23.228650 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.228618    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"]
May 21 21:28:23.382771 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.382727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d66f8106-fcbf-4680-9753-980b150a1b0e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x\" (UID: \"d66f8106-fcbf-4680-9753-980b150a1b0e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"
May 21 21:28:23.382945 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.382783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d66f8106-fcbf-4680-9753-980b150a1b0e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x\" (UID: \"d66f8106-fcbf-4680-9753-980b150a1b0e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"
May 21 21:28:23.382945 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.382809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brmv5\" (UniqueName: \"kubernetes.io/projected/d66f8106-fcbf-4680-9753-980b150a1b0e-kube-api-access-brmv5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x\" (UID: \"d66f8106-fcbf-4680-9753-980b150a1b0e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"
May 21 21:28:23.483885 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.483773    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d66f8106-fcbf-4680-9753-980b150a1b0e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x\" (UID: \"d66f8106-fcbf-4680-9753-980b150a1b0e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"
May 21 21:28:23.484369 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.483938    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d66f8106-fcbf-4680-9753-980b150a1b0e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x\" (UID: \"d66f8106-fcbf-4680-9753-980b150a1b0e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"
May 21 21:28:23.484369 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.483998    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brmv5\" (UniqueName: \"kubernetes.io/projected/d66f8106-fcbf-4680-9753-980b150a1b0e-kube-api-access-brmv5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x\" (UID: \"d66f8106-fcbf-4680-9753-980b150a1b0e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"
May 21 21:28:23.484369 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.484261    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d66f8106-fcbf-4680-9753-980b150a1b0e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x\" (UID: \"d66f8106-fcbf-4680-9753-980b150a1b0e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"
May 21 21:28:23.484369 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.484270    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d66f8106-fcbf-4680-9753-980b150a1b0e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x\" (UID: \"d66f8106-fcbf-4680-9753-980b150a1b0e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"
May 21 21:28:23.494019 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.493973    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brmv5\" (UniqueName: \"kubernetes.io/projected/d66f8106-fcbf-4680-9753-980b150a1b0e-kube-api-access-brmv5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x\" (UID: \"d66f8106-fcbf-4680-9753-980b150a1b0e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"
May 21 21:28:23.525808 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.525774    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"
May 21 21:28:23.666169 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.666145    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"]
May 21 21:28:23.668564 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:28:23.668539    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66f8106_fcbf_4680_9753_980b150a1b0e.slice/crio-cac02e6284c00116d916ac98067661d225c930fff6b1135ce9429b2dcb0dccf8 WatchSource:0}: Error finding container cac02e6284c00116d916ac98067661d225c930fff6b1135ce9429b2dcb0dccf8: Status 404 returned error can't find the container with id cac02e6284c00116d916ac98067661d225c930fff6b1135ce9429b2dcb0dccf8
May 21 21:28:23.836317 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.836284    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"]
May 21 21:28:23.838416 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.838398    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"
May 21 21:28:23.853864 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.853825    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"]
May 21 21:28:23.987527 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.987494    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7\" (UID: \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"
May 21 21:28:23.987703 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.987548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22d2c\" (UniqueName: \"kubernetes.io/projected/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-kube-api-access-22d2c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7\" (UID: \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"
May 21 21:28:23.987703 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:23.987607    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7\" (UID: \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"
May 21 21:28:24.088345 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.088240    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7\" (UID: \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"
May 21 21:28:24.088345 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.088290    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-22d2c\" (UniqueName: \"kubernetes.io/projected/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-kube-api-access-22d2c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7\" (UID: \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"
May 21 21:28:24.088345 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.088337    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7\" (UID: \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"
May 21 21:28:24.088717 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.088698    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7\" (UID: \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"
May 21 21:28:24.088784 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.088691    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7\" (UID: \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"
May 21 21:28:24.097968 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.097942    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22d2c\" (UniqueName: \"kubernetes.io/projected/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-kube-api-access-22d2c\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7\" (UID: \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"
May 21 21:28:24.147620 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.147584    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"
May 21 21:28:24.230572 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.230534    2576 generic.go:358] "Generic (PLEG): container finished" podID="d66f8106-fcbf-4680-9753-980b150a1b0e" containerID="11934b40ffa9fa9257f66fe674903e0281be0871e695d7b6aa4ca2e4d3700e86" exitCode=0
May 21 21:28:24.230729 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.230615    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x" event={"ID":"d66f8106-fcbf-4680-9753-980b150a1b0e","Type":"ContainerDied","Data":"11934b40ffa9fa9257f66fe674903e0281be0871e695d7b6aa4ca2e4d3700e86"}
May 21 21:28:24.230729 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.230689    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x" event={"ID":"d66f8106-fcbf-4680-9753-980b150a1b0e","Type":"ContainerStarted","Data":"cac02e6284c00116d916ac98067661d225c930fff6b1135ce9429b2dcb0dccf8"}
May 21 21:28:24.233330 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.233301    2576 generic.go:358] "Generic (PLEG): container finished" podID="5807ab5e-6469-48e8-a123-3d91889cb5fd" containerID="c099abe8bb2ebc45311b54a2bfbe22ee6deba16225ef0d09f6da054082f7cc10" exitCode=0
May 21 21:28:24.233623 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.233446    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg" event={"ID":"5807ab5e-6469-48e8-a123-3d91889cb5fd","Type":"ContainerDied","Data":"c099abe8bb2ebc45311b54a2bfbe22ee6deba16225ef0d09f6da054082f7cc10"}
May 21 21:28:24.234867 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.234843    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"]
May 21 21:28:24.237922 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.237903    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"
May 21 21:28:24.258653 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.258624    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"]
May 21 21:28:24.294251 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.294221    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"]
May 21 21:28:24.297336 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:28:24.297305    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb14506e_4b93_4a0d_b931_c1b17f0e8a3a.slice/crio-361a41b0520da1b2ae250086d04dc7b63d097f56f866a8c1e58c85fc0c3926c7 WatchSource:0}: Error finding container 361a41b0520da1b2ae250086d04dc7b63d097f56f866a8c1e58c85fc0c3926c7: Status 404 returned error can't find the container with id 361a41b0520da1b2ae250086d04dc7b63d097f56f866a8c1e58c85fc0c3926c7
May 21 21:28:24.390825 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.390777    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/147274ae-dca4-4084-bb26-d2d0e2e722a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh\" (UID: \"147274ae-dca4-4084-bb26-d2d0e2e722a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"
May 21 21:28:24.391069 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.390885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5hc6\" (UniqueName: \"kubernetes.io/projected/147274ae-dca4-4084-bb26-d2d0e2e722a7-kube-api-access-j5hc6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh\" (UID: \"147274ae-dca4-4084-bb26-d2d0e2e722a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"
May 21 21:28:24.391069 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.390976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/147274ae-dca4-4084-bb26-d2d0e2e722a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh\" (UID: \"147274ae-dca4-4084-bb26-d2d0e2e722a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"
May 21 21:28:24.492037 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.491969    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/147274ae-dca4-4084-bb26-d2d0e2e722a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh\" (UID: \"147274ae-dca4-4084-bb26-d2d0e2e722a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"
May 21 21:28:24.492409 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.492066    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/147274ae-dca4-4084-bb26-d2d0e2e722a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh\" (UID: \"147274ae-dca4-4084-bb26-d2d0e2e722a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"
May 21 21:28:24.492409 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.492100    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hc6\" (UniqueName: \"kubernetes.io/projected/147274ae-dca4-4084-bb26-d2d0e2e722a7-kube-api-access-j5hc6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh\" (UID: \"147274ae-dca4-4084-bb26-d2d0e2e722a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"
May 21 21:28:24.492409 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.492347    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/147274ae-dca4-4084-bb26-d2d0e2e722a7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh\" (UID: \"147274ae-dca4-4084-bb26-d2d0e2e722a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"
May 21 21:28:24.492409 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.492376    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/147274ae-dca4-4084-bb26-d2d0e2e722a7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh\" (UID: \"147274ae-dca4-4084-bb26-d2d0e2e722a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"
May 21 21:28:24.501657 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.501633    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5hc6\" (UniqueName: \"kubernetes.io/projected/147274ae-dca4-4084-bb26-d2d0e2e722a7-kube-api-access-j5hc6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh\" (UID: \"147274ae-dca4-4084-bb26-d2d0e2e722a7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"
May 21 21:28:24.549215 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.549176    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"
May 21 21:28:24.677003 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:24.676956    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"]
May 21 21:28:24.679150 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:28:24.679112    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147274ae_dca4_4084_bb26_d2d0e2e722a7.slice/crio-850173c94a6001c25558403eb19627c16c62e0350dfd6f12df460d442611e2b9 WatchSource:0}: Error finding container 850173c94a6001c25558403eb19627c16c62e0350dfd6f12df460d442611e2b9: Status 404 returned error can't find the container with id 850173c94a6001c25558403eb19627c16c62e0350dfd6f12df460d442611e2b9
May 21 21:28:25.238342 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:25.238243    2576 generic.go:358] "Generic (PLEG): container finished" podID="d66f8106-fcbf-4680-9753-980b150a1b0e" containerID="aeda0d57e92c0900186948aae95e4fd3d95c0b52540d3e219398aaa3c0a3f3e7" exitCode=0
May 21 21:28:25.238342 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:25.238324    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x" event={"ID":"d66f8106-fcbf-4680-9753-980b150a1b0e","Type":"ContainerDied","Data":"aeda0d57e92c0900186948aae95e4fd3d95c0b52540d3e219398aaa3c0a3f3e7"}
May 21 21:28:25.239771 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:25.239746    2576 generic.go:358] "Generic (PLEG): container finished" podID="147274ae-dca4-4084-bb26-d2d0e2e722a7" containerID="c2c97990a4377dc867dcea54973abd9737aa54ba3fef14d4dd652a436dff5e9a" exitCode=0
May 21 21:28:25.239905 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:25.239776    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh" event={"ID":"147274ae-dca4-4084-bb26-d2d0e2e722a7","Type":"ContainerDied","Data":"c2c97990a4377dc867dcea54973abd9737aa54ba3fef14d4dd652a436dff5e9a"}
May 21 21:28:25.239905 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:25.239810    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh" event={"ID":"147274ae-dca4-4084-bb26-d2d0e2e722a7","Type":"ContainerStarted","Data":"850173c94a6001c25558403eb19627c16c62e0350dfd6f12df460d442611e2b9"}
May 21 21:28:25.241806 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:25.241785    2576 generic.go:358] "Generic (PLEG): container finished" podID="5807ab5e-6469-48e8-a123-3d91889cb5fd" containerID="c29e622984a60f5bfcd81ef5e72723531d592a291eb177866cea944799adbc8d" exitCode=0
May 21 21:28:25.241953 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:25.241871    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg" event={"ID":"5807ab5e-6469-48e8-a123-3d91889cb5fd","Type":"ContainerDied","Data":"c29e622984a60f5bfcd81ef5e72723531d592a291eb177866cea944799adbc8d"}
May 21 21:28:25.243258 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:25.243234    2576 generic.go:358] "Generic (PLEG): container finished" podID="fb14506e-4b93-4a0d-b931-c1b17f0e8a3a" containerID="a5f4a415d157d032f0bc4921543e171abb4b6f22b8a9e86fdeb913aab5826b3b" exitCode=0
May 21 21:28:25.243364 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:25.243263    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7" event={"ID":"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a","Type":"ContainerDied","Data":"a5f4a415d157d032f0bc4921543e171abb4b6f22b8a9e86fdeb913aab5826b3b"}
May 21 21:28:25.243364 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:25.243291    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7" event={"ID":"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a","Type":"ContainerStarted","Data":"361a41b0520da1b2ae250086d04dc7b63d097f56f866a8c1e58c85fc0c3926c7"}
May 21 21:28:26.252034 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.251972    2576 generic.go:358] "Generic (PLEG): container finished" podID="d66f8106-fcbf-4680-9753-980b150a1b0e" containerID="d7524ab18474052aaebb8628708fcb6f8d71316888dd85639c153023fd93666d" exitCode=0
May 21 21:28:26.252442 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.252058    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x" event={"ID":"d66f8106-fcbf-4680-9753-980b150a1b0e","Type":"ContainerDied","Data":"d7524ab18474052aaebb8628708fcb6f8d71316888dd85639c153023fd93666d"}
May 21 21:28:26.253665 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.253640    2576 generic.go:358] "Generic (PLEG): container finished" podID="147274ae-dca4-4084-bb26-d2d0e2e722a7" containerID="14c8c26bee90883f3b5182fdfc214665ba80e7cd4ee9813b8e883ef11c2d2f83" exitCode=0
May 21 21:28:26.253745 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.253724    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh" event={"ID":"147274ae-dca4-4084-bb26-d2d0e2e722a7","Type":"ContainerDied","Data":"14c8c26bee90883f3b5182fdfc214665ba80e7cd4ee9813b8e883ef11c2d2f83"}
May 21 21:28:26.255612 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.255590    2576 generic.go:358] "Generic (PLEG): container finished" podID="fb14506e-4b93-4a0d-b931-c1b17f0e8a3a" containerID="33c8da678e1f838e029ed8336c26aa5d109bb0f109d1c1fbfb946ee418aaa331" exitCode=0
May 21 21:28:26.255749 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.255718    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7" event={"ID":"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a","Type":"ContainerDied","Data":"33c8da678e1f838e029ed8336c26aa5d109bb0f109d1c1fbfb946ee418aaa331"}
May 21 21:28:26.391259 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.391231    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"
May 21 21:28:26.413057 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.412959    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5807ab5e-6469-48e8-a123-3d91889cb5fd-util\") pod \"5807ab5e-6469-48e8-a123-3d91889cb5fd\" (UID: \"5807ab5e-6469-48e8-a123-3d91889cb5fd\") "
May 21 21:28:26.413057 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.413052    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gb5k\" (UniqueName: \"kubernetes.io/projected/5807ab5e-6469-48e8-a123-3d91889cb5fd-kube-api-access-2gb5k\") pod \"5807ab5e-6469-48e8-a123-3d91889cb5fd\" (UID: \"5807ab5e-6469-48e8-a123-3d91889cb5fd\") "
May 21 21:28:26.413297 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.413100    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5807ab5e-6469-48e8-a123-3d91889cb5fd-bundle\") pod \"5807ab5e-6469-48e8-a123-3d91889cb5fd\" (UID: \"5807ab5e-6469-48e8-a123-3d91889cb5fd\") "
May 21 21:28:26.414478 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.414254    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5807ab5e-6469-48e8-a123-3d91889cb5fd-bundle" (OuterVolumeSpecName: "bundle") pod "5807ab5e-6469-48e8-a123-3d91889cb5fd" (UID: "5807ab5e-6469-48e8-a123-3d91889cb5fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:28:26.417267 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.417216    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5807ab5e-6469-48e8-a123-3d91889cb5fd-kube-api-access-2gb5k" (OuterVolumeSpecName: "kube-api-access-2gb5k") pod "5807ab5e-6469-48e8-a123-3d91889cb5fd" (UID: "5807ab5e-6469-48e8-a123-3d91889cb5fd"). InnerVolumeSpecName "kube-api-access-2gb5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:28:26.420032 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.419999    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5807ab5e-6469-48e8-a123-3d91889cb5fd-util" (OuterVolumeSpecName: "util") pod "5807ab5e-6469-48e8-a123-3d91889cb5fd" (UID: "5807ab5e-6469-48e8-a123-3d91889cb5fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:28:26.514269 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.514181    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5807ab5e-6469-48e8-a123-3d91889cb5fd-util\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:28:26.514269 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.514213    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gb5k\" (UniqueName: \"kubernetes.io/projected/5807ab5e-6469-48e8-a123-3d91889cb5fd-kube-api-access-2gb5k\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:28:26.514269 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:26.514224    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5807ab5e-6469-48e8-a123-3d91889cb5fd-bundle\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:28:27.261558 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.261455    2576 generic.go:358] "Generic (PLEG): container finished" podID="fb14506e-4b93-4a0d-b931-c1b17f0e8a3a" containerID="ab23c22cb419ef29c5de30b8f86f6ca393fe6c568ab71114e238d96c7cbf12af" exitCode=0
May 21 21:28:27.261558 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.261505    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7" event={"ID":"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a","Type":"ContainerDied","Data":"ab23c22cb419ef29c5de30b8f86f6ca393fe6c568ab71114e238d96c7cbf12af"}
May 21 21:28:27.263558 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.263529    2576 generic.go:358] "Generic (PLEG): container finished" podID="147274ae-dca4-4084-bb26-d2d0e2e722a7" containerID="d605f0cb696554353d90424e93c83c1566682945f252be6b70faf6d29a135f1b" exitCode=0
May 21 21:28:27.263701 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.263588    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh" event={"ID":"147274ae-dca4-4084-bb26-d2d0e2e722a7","Type":"ContainerDied","Data":"d605f0cb696554353d90424e93c83c1566682945f252be6b70faf6d29a135f1b"}
May 21 21:28:27.265336 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.265313    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg" event={"ID":"5807ab5e-6469-48e8-a123-3d91889cb5fd","Type":"ContainerDied","Data":"e531a246f9cbadb049cc41a4ab884e7b6aa82e171f918611459b59c1aeb2e1bb"}
May 21 21:28:27.265412 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.265342    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e531a246f9cbadb049cc41a4ab884e7b6aa82e171f918611459b59c1aeb2e1bb"
May 21 21:28:27.265412 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.265372    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg"
May 21 21:28:27.397969 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.397941    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"
May 21 21:28:27.422260 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.422230    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d66f8106-fcbf-4680-9753-980b150a1b0e-util\") pod \"d66f8106-fcbf-4680-9753-980b150a1b0e\" (UID: \"d66f8106-fcbf-4680-9753-980b150a1b0e\") "
May 21 21:28:27.422454 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.422327    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d66f8106-fcbf-4680-9753-980b150a1b0e-bundle\") pod \"d66f8106-fcbf-4680-9753-980b150a1b0e\" (UID: \"d66f8106-fcbf-4680-9753-980b150a1b0e\") "
May 21 21:28:27.422454 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.422357    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brmv5\" (UniqueName: \"kubernetes.io/projected/d66f8106-fcbf-4680-9753-980b150a1b0e-kube-api-access-brmv5\") pod \"d66f8106-fcbf-4680-9753-980b150a1b0e\" (UID: \"d66f8106-fcbf-4680-9753-980b150a1b0e\") "
May 21 21:28:27.422823 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.422788    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66f8106-fcbf-4680-9753-980b150a1b0e-bundle" (OuterVolumeSpecName: "bundle") pod "d66f8106-fcbf-4680-9753-980b150a1b0e" (UID: "d66f8106-fcbf-4680-9753-980b150a1b0e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:28:27.424691 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.424654    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d66f8106-fcbf-4680-9753-980b150a1b0e-kube-api-access-brmv5" (OuterVolumeSpecName: "kube-api-access-brmv5") pod "d66f8106-fcbf-4680-9753-980b150a1b0e" (UID: "d66f8106-fcbf-4680-9753-980b150a1b0e"). InnerVolumeSpecName "kube-api-access-brmv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:28:27.428074 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.428043    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d66f8106-fcbf-4680-9753-980b150a1b0e-util" (OuterVolumeSpecName: "util") pod "d66f8106-fcbf-4680-9753-980b150a1b0e" (UID: "d66f8106-fcbf-4680-9753-980b150a1b0e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:28:27.523903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.523868    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d66f8106-fcbf-4680-9753-980b150a1b0e-bundle\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:28:27.523903 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.523902    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brmv5\" (UniqueName: \"kubernetes.io/projected/d66f8106-fcbf-4680-9753-980b150a1b0e-kube-api-access-brmv5\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:28:27.524139 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:27.523914    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d66f8106-fcbf-4680-9753-980b150a1b0e-util\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:28:28.270636 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.270606    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x"
May 21 21:28:28.270636 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.270605    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x" event={"ID":"d66f8106-fcbf-4680-9753-980b150a1b0e","Type":"ContainerDied","Data":"cac02e6284c00116d916ac98067661d225c930fff6b1135ce9429b2dcb0dccf8"}
May 21 21:28:28.271141 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.270654    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cac02e6284c00116d916ac98067661d225c930fff6b1135ce9429b2dcb0dccf8"
May 21 21:28:28.419253 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.419226    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"
May 21 21:28:28.422281 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.422253    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"
May 21 21:28:28.429835 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.429812    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/147274ae-dca4-4084-bb26-d2d0e2e722a7-bundle\") pod \"147274ae-dca4-4084-bb26-d2d0e2e722a7\" (UID: \"147274ae-dca4-4084-bb26-d2d0e2e722a7\") "
May 21 21:28:28.429945 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.429854    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/147274ae-dca4-4084-bb26-d2d0e2e722a7-util\") pod \"147274ae-dca4-4084-bb26-d2d0e2e722a7\" (UID: \"147274ae-dca4-4084-bb26-d2d0e2e722a7\") "
May 21 21:28:28.429945 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.429879    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-bundle\") pod \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\" (UID: \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\") "
May 21 21:28:28.429945 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.429926    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-util\") pod \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\" (UID: \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\") "
May 21 21:28:28.430127 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.429959    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22d2c\" (UniqueName: \"kubernetes.io/projected/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-kube-api-access-22d2c\") pod \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\" (UID: \"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a\") "
May 21 21:28:28.430127 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.430032    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5hc6\" (UniqueName: \"kubernetes.io/projected/147274ae-dca4-4084-bb26-d2d0e2e722a7-kube-api-access-j5hc6\") pod \"147274ae-dca4-4084-bb26-d2d0e2e722a7\" (UID: \"147274ae-dca4-4084-bb26-d2d0e2e722a7\") "
May 21 21:28:28.430468 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.430439    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-bundle" (OuterVolumeSpecName: "bundle") pod "fb14506e-4b93-4a0d-b931-c1b17f0e8a3a" (UID: "fb14506e-4b93-4a0d-b931-c1b17f0e8a3a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:28:28.430573 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.430445    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/147274ae-dca4-4084-bb26-d2d0e2e722a7-bundle" (OuterVolumeSpecName: "bundle") pod "147274ae-dca4-4084-bb26-d2d0e2e722a7" (UID: "147274ae-dca4-4084-bb26-d2d0e2e722a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:28:28.432101 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.432076    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-kube-api-access-22d2c" (OuterVolumeSpecName: "kube-api-access-22d2c") pod "fb14506e-4b93-4a0d-b931-c1b17f0e8a3a" (UID: "fb14506e-4b93-4a0d-b931-c1b17f0e8a3a"). InnerVolumeSpecName "kube-api-access-22d2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:28:28.432389 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.432372    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/147274ae-dca4-4084-bb26-d2d0e2e722a7-kube-api-access-j5hc6" (OuterVolumeSpecName: "kube-api-access-j5hc6") pod "147274ae-dca4-4084-bb26-d2d0e2e722a7" (UID: "147274ae-dca4-4084-bb26-d2d0e2e722a7"). InnerVolumeSpecName "kube-api-access-j5hc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:28:28.435685 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.435649    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-util" (OuterVolumeSpecName: "util") pod "fb14506e-4b93-4a0d-b931-c1b17f0e8a3a" (UID: "fb14506e-4b93-4a0d-b931-c1b17f0e8a3a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:28:28.436370 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.436352    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/147274ae-dca4-4084-bb26-d2d0e2e722a7-util" (OuterVolumeSpecName: "util") pod "147274ae-dca4-4084-bb26-d2d0e2e722a7" (UID: "147274ae-dca4-4084-bb26-d2d0e2e722a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:28:28.530729 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.530641    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5hc6\" (UniqueName: \"kubernetes.io/projected/147274ae-dca4-4084-bb26-d2d0e2e722a7-kube-api-access-j5hc6\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:28:28.530729 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.530674    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/147274ae-dca4-4084-bb26-d2d0e2e722a7-bundle\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:28:28.530729 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.530685    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/147274ae-dca4-4084-bb26-d2d0e2e722a7-util\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:28:28.530729 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.530694    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-bundle\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:28:28.530729 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.530702    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-util\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:28:28.530729 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:28.530711    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22d2c\" (UniqueName: \"kubernetes.io/projected/fb14506e-4b93-4a0d-b931-c1b17f0e8a3a-kube-api-access-22d2c\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:28:29.277999 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:29.277928    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7" event={"ID":"fb14506e-4b93-4a0d-b931-c1b17f0e8a3a","Type":"ContainerDied","Data":"361a41b0520da1b2ae250086d04dc7b63d097f56f866a8c1e58c85fc0c3926c7"}
May 21 21:28:29.277999 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:29.278003    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="361a41b0520da1b2ae250086d04dc7b63d097f56f866a8c1e58c85fc0c3926c7"
May 21 21:28:29.278537 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:29.278171    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7"
May 21 21:28:29.281392 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:29.281354    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh" event={"ID":"147274ae-dca4-4084-bb26-d2d0e2e722a7","Type":"ContainerDied","Data":"850173c94a6001c25558403eb19627c16c62e0350dfd6f12df460d442611e2b9"}
May 21 21:28:29.281392 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:29.281394    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="850173c94a6001c25558403eb19627c16c62e0350dfd6f12df460d442611e2b9"
May 21 21:28:29.281582 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:29.281405    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh"
May 21 21:28:34.156889 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.156845    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-26gcf"]
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157158    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5807ab5e-6469-48e8-a123-3d91889cb5fd" containerName="util"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157169    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5807ab5e-6469-48e8-a123-3d91889cb5fd" containerName="util"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157179    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="147274ae-dca4-4084-bb26-d2d0e2e722a7" containerName="util"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157184    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="147274ae-dca4-4084-bb26-d2d0e2e722a7" containerName="util"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157192    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb14506e-4b93-4a0d-b931-c1b17f0e8a3a" containerName="extract"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157198    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb14506e-4b93-4a0d-b931-c1b17f0e8a3a" containerName="extract"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157205    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb14506e-4b93-4a0d-b931-c1b17f0e8a3a" containerName="pull"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157209    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb14506e-4b93-4a0d-b931-c1b17f0e8a3a" containerName="pull"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157217    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb14506e-4b93-4a0d-b931-c1b17f0e8a3a" containerName="util"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157221    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb14506e-4b93-4a0d-b931-c1b17f0e8a3a" containerName="util"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157227    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="147274ae-dca4-4084-bb26-d2d0e2e722a7" containerName="pull"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157232    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="147274ae-dca4-4084-bb26-d2d0e2e722a7" containerName="pull"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157238    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="147274ae-dca4-4084-bb26-d2d0e2e722a7" containerName="extract"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157243    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="147274ae-dca4-4084-bb26-d2d0e2e722a7" containerName="extract"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157249    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5807ab5e-6469-48e8-a123-3d91889cb5fd" containerName="extract"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157254    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5807ab5e-6469-48e8-a123-3d91889cb5fd" containerName="extract"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157261    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d66f8106-fcbf-4680-9753-980b150a1b0e" containerName="util"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157266    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d66f8106-fcbf-4680-9753-980b150a1b0e" containerName="util"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157275    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d66f8106-fcbf-4680-9753-980b150a1b0e" containerName="pull"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157283    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d66f8106-fcbf-4680-9753-980b150a1b0e" containerName="pull"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157294    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5807ab5e-6469-48e8-a123-3d91889cb5fd" containerName="pull"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157301    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5807ab5e-6469-48e8-a123-3d91889cb5fd" containerName="pull"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157308    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d66f8106-fcbf-4680-9753-980b150a1b0e" containerName="extract"
May 21 21:28:34.157306 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157315    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d66f8106-fcbf-4680-9753-980b150a1b0e" containerName="extract"
May 21 21:28:34.157966 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157361    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="d66f8106-fcbf-4680-9753-980b150a1b0e" containerName="extract"
May 21 21:28:34.157966 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157371    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="147274ae-dca4-4084-bb26-d2d0e2e722a7" containerName="extract"
May 21 21:28:34.157966 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157377    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="5807ab5e-6469-48e8-a123-3d91889cb5fd" containerName="extract"
May 21 21:28:34.157966 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.157383    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="fb14506e-4b93-4a0d-b931-c1b17f0e8a3a" containerName="extract"
May 21 21:28:34.161530 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.161508    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-26gcf"
May 21 21:28:34.164107 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.164076    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 21:28:34.165064 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.165043    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bbgdw\""
May 21 21:28:34.165252 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.165237    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 21:28:34.173870 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.173842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lxg9\" (UniqueName: \"kubernetes.io/projected/1427290c-e2b0-4d95-88ac-838073feacd2-kube-api-access-9lxg9\") pod \"authorino-operator-657f44b778-26gcf\" (UID: \"1427290c-e2b0-4d95-88ac-838073feacd2\") " pod="kuadrant-system/authorino-operator-657f44b778-26gcf"
May 21 21:28:34.193781 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.193749    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-26gcf"]
May 21 21:28:34.275056 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.275015    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9lxg9\" (UniqueName: \"kubernetes.io/projected/1427290c-e2b0-4d95-88ac-838073feacd2-kube-api-access-9lxg9\") pod \"authorino-operator-657f44b778-26gcf\" (UID: \"1427290c-e2b0-4d95-88ac-838073feacd2\") " pod="kuadrant-system/authorino-operator-657f44b778-26gcf"
May 21 21:28:34.293810 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.293777    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lxg9\" (UniqueName: \"kubernetes.io/projected/1427290c-e2b0-4d95-88ac-838073feacd2-kube-api-access-9lxg9\") pod \"authorino-operator-657f44b778-26gcf\" (UID: \"1427290c-e2b0-4d95-88ac-838073feacd2\") " pod="kuadrant-system/authorino-operator-657f44b778-26gcf"
May 21 21:28:34.473010 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.472861    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-26gcf"
May 21 21:28:34.652314 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:34.652288    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-26gcf"]
May 21 21:28:34.654093 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:28:34.654059    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1427290c_e2b0_4d95_88ac_838073feacd2.slice/crio-5db8951ff013a25ba49c98424d827c32aed0d58d36ef051548d48e7d836936bf WatchSource:0}: Error finding container 5db8951ff013a25ba49c98424d827c32aed0d58d36ef051548d48e7d836936bf: Status 404 returned error can't find the container with id 5db8951ff013a25ba49c98424d827c32aed0d58d36ef051548d48e7d836936bf
May 21 21:28:35.304183 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:35.304144    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-26gcf" event={"ID":"1427290c-e2b0-4d95-88ac-838073feacd2","Type":"ContainerStarted","Data":"5db8951ff013a25ba49c98424d827c32aed0d58d36ef051548d48e7d836936bf"}
May 21 21:28:37.312881 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:37.312844    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-26gcf" event={"ID":"1427290c-e2b0-4d95-88ac-838073feacd2","Type":"ContainerStarted","Data":"d743adb47a359ba6348b075efcb4a77152f49b37772d77468f82b47ce25252b5"}
May 21 21:28:37.313300 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:37.312975    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-26gcf"
May 21 21:28:37.353346 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:37.353280    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-26gcf" podStartSLOduration=1.278612786 podStartE2EDuration="3.353259731s" podCreationTimestamp="2026-05-21 21:28:34 +0000 UTC" firstStartedPulling="2026-05-21 21:28:34.65606386 +0000 UTC m=+440.344439163" lastFinishedPulling="2026-05-21 21:28:36.730710809 +0000 UTC m=+442.419086108" observedRunningTime="2026-05-21 21:28:37.351395048 +0000 UTC m=+443.039770369" watchObservedRunningTime="2026-05-21 21:28:37.353259731 +0000 UTC m=+443.041635063"
May 21 21:28:41.275648 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:41.275614    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"]
May 21 21:28:41.278880 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:41.278863    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"
May 21 21:28:41.283874 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:41.283845    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lzdrl\""
May 21 21:28:41.295875 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:41.295852    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"]
May 21 21:28:41.346190 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:41.346150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87fc789a-12d6-4726-857a-07ddcb9225e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8kp5q\" (UID: \"87fc789a-12d6-4726-857a-07ddcb9225e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"
May 21 21:28:41.346190 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:41.346203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b9j6\" (UniqueName: \"kubernetes.io/projected/87fc789a-12d6-4726-857a-07ddcb9225e3-kube-api-access-4b9j6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8kp5q\" (UID: \"87fc789a-12d6-4726-857a-07ddcb9225e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"
May 21 21:28:41.447444 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:41.447409    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87fc789a-12d6-4726-857a-07ddcb9225e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8kp5q\" (UID: \"87fc789a-12d6-4726-857a-07ddcb9225e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"
May 21 21:28:41.447611 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:41.447449    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4b9j6\" (UniqueName: \"kubernetes.io/projected/87fc789a-12d6-4726-857a-07ddcb9225e3-kube-api-access-4b9j6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8kp5q\" (UID: \"87fc789a-12d6-4726-857a-07ddcb9225e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"
May 21 21:28:41.447867 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:41.447845    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87fc789a-12d6-4726-857a-07ddcb9225e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8kp5q\" (UID: \"87fc789a-12d6-4726-857a-07ddcb9225e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"
May 21 21:28:41.456375 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:41.456339    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b9j6\" (UniqueName: \"kubernetes.io/projected/87fc789a-12d6-4726-857a-07ddcb9225e3-kube-api-access-4b9j6\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8kp5q\" (UID: \"87fc789a-12d6-4726-857a-07ddcb9225e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"
May 21 21:28:41.588547 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:41.588461    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"
May 21 21:28:41.716919 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:41.716885    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"]
May 21 21:28:41.721032 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:28:41.720997    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87fc789a_12d6_4726_857a_07ddcb9225e3.slice/crio-70e007de7fbf1049944b2e5e486e498401e2ceb343977732efc8f95988fcdc90 WatchSource:0}: Error finding container 70e007de7fbf1049944b2e5e486e498401e2ceb343977732efc8f95988fcdc90: Status 404 returned error can't find the container with id 70e007de7fbf1049944b2e5e486e498401e2ceb343977732efc8f95988fcdc90
May 21 21:28:42.332222 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:42.332183    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q" event={"ID":"87fc789a-12d6-4726-857a-07ddcb9225e3","Type":"ContainerStarted","Data":"70e007de7fbf1049944b2e5e486e498401e2ceb343977732efc8f95988fcdc90"}
May 21 21:28:47.362745 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:47.362709    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q" event={"ID":"87fc789a-12d6-4726-857a-07ddcb9225e3","Type":"ContainerStarted","Data":"5d6ef1f220415422588b639d07d8cd3be82c377f147b91d5451ccd6a531874f4"}
May 21 21:28:47.363177 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:47.362813    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"
May 21 21:28:47.396010 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:47.395919    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q" podStartSLOduration=1.509200549 podStartE2EDuration="6.395904765s" podCreationTimestamp="2026-05-21 21:28:41 +0000 UTC" firstStartedPulling="2026-05-21 21:28:41.724146983 +0000 UTC m=+447.412522286" lastFinishedPulling="2026-05-21 21:28:46.610851203 +0000 UTC m=+452.299226502" observedRunningTime="2026-05-21 21:28:47.392474183 +0000 UTC m=+453.080849504" watchObservedRunningTime="2026-05-21 21:28:47.395904765 +0000 UTC m=+453.084280086"
May 21 21:28:48.318935 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:48.318905    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-26gcf"
May 21 21:28:58.369881 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:28:58.369840    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"
May 21 21:29:00.174544 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.174502    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"]
May 21 21:29:00.175150 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.174724    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q" podUID="87fc789a-12d6-4726-857a-07ddcb9225e3" containerName="manager" containerID="cri-o://5d6ef1f220415422588b639d07d8cd3be82c377f147b91d5451ccd6a531874f4" gracePeriod=2
May 21 21:29:00.177183 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.177147    2576 status_manager.go:895] "Failed to get status for pod" podUID="87fc789a-12d6-4726-857a-07ddcb9225e3" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8kp5q\" is forbidden: User \"system:node:ip-10-0-135-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-166.ec2.internal' and this object"
May 21 21:29:00.178378 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.178347    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"]
May 21 21:29:00.200913 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.200873    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"]
May 21 21:29:00.201289 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.201269    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87fc789a-12d6-4726-857a-07ddcb9225e3" containerName="manager"
May 21 21:29:00.201352 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.201291    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="87fc789a-12d6-4726-857a-07ddcb9225e3" containerName="manager"
May 21 21:29:00.201389 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.201363    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="87fc789a-12d6-4726-857a-07ddcb9225e3" containerName="manager"
May 21 21:29:00.204723 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.204698    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"
May 21 21:29:00.207375 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.207049    2576 status_manager.go:895] "Failed to get status for pod" podUID="87fc789a-12d6-4726-857a-07ddcb9225e3" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8kp5q\" is forbidden: User \"system:node:ip-10-0-135-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-166.ec2.internal' and this object"
May 21 21:29:00.219946 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.219912    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"]
May 21 21:29:00.308487 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.308432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tp7n\" (UniqueName: \"kubernetes.io/projected/b61d6fc5-f846-4929-aa67-76fb1c07f40e-kube-api-access-4tp7n\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wwpgr\" (UID: \"b61d6fc5-f846-4929-aa67-76fb1c07f40e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"
May 21 21:29:00.308659 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.308511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b61d6fc5-f846-4929-aa67-76fb1c07f40e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wwpgr\" (UID: \"b61d6fc5-f846-4929-aa67-76fb1c07f40e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"
May 21 21:29:00.409454 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.409416    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tp7n\" (UniqueName: \"kubernetes.io/projected/b61d6fc5-f846-4929-aa67-76fb1c07f40e-kube-api-access-4tp7n\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wwpgr\" (UID: \"b61d6fc5-f846-4929-aa67-76fb1c07f40e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"
May 21 21:29:00.409624 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.409478    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b61d6fc5-f846-4929-aa67-76fb1c07f40e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wwpgr\" (UID: \"b61d6fc5-f846-4929-aa67-76fb1c07f40e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"
May 21 21:29:00.409946 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.409917    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b61d6fc5-f846-4929-aa67-76fb1c07f40e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wwpgr\" (UID: \"b61d6fc5-f846-4929-aa67-76fb1c07f40e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"
May 21 21:29:00.412886 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.412856    2576 generic.go:358] "Generic (PLEG): container finished" podID="87fc789a-12d6-4726-857a-07ddcb9225e3" containerID="5d6ef1f220415422588b639d07d8cd3be82c377f147b91d5451ccd6a531874f4" exitCode=0
May 21 21:29:00.413023 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.412915    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70e007de7fbf1049944b2e5e486e498401e2ceb343977732efc8f95988fcdc90"
May 21 21:29:00.418103 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.418082    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"
May 21 21:29:00.420687 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.420661    2576 status_manager.go:895] "Failed to get status for pod" podUID="87fc789a-12d6-4726-857a-07ddcb9225e3" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-8kp5q\" is forbidden: User \"system:node:ip-10-0-135-166.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-166.ec2.internal' and this object"
May 21 21:29:00.426116 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.426047    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tp7n\" (UniqueName: \"kubernetes.io/projected/b61d6fc5-f846-4929-aa67-76fb1c07f40e-kube-api-access-4tp7n\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-wwpgr\" (UID: \"b61d6fc5-f846-4929-aa67-76fb1c07f40e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"
May 21 21:29:00.510040 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.509945    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87fc789a-12d6-4726-857a-07ddcb9225e3-extensions-socket-volume\") pod \"87fc789a-12d6-4726-857a-07ddcb9225e3\" (UID: \"87fc789a-12d6-4726-857a-07ddcb9225e3\") "
May 21 21:29:00.510250 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.510058    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b9j6\" (UniqueName: \"kubernetes.io/projected/87fc789a-12d6-4726-857a-07ddcb9225e3-kube-api-access-4b9j6\") pod \"87fc789a-12d6-4726-857a-07ddcb9225e3\" (UID: \"87fc789a-12d6-4726-857a-07ddcb9225e3\") "
May 21 21:29:00.510476 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.510451    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87fc789a-12d6-4726-857a-07ddcb9225e3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "87fc789a-12d6-4726-857a-07ddcb9225e3" (UID: "87fc789a-12d6-4726-857a-07ddcb9225e3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:29:00.512185 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.512159    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87fc789a-12d6-4726-857a-07ddcb9225e3-kube-api-access-4b9j6" (OuterVolumeSpecName: "kube-api-access-4b9j6") pod "87fc789a-12d6-4726-857a-07ddcb9225e3" (UID: "87fc789a-12d6-4726-857a-07ddcb9225e3"). InnerVolumeSpecName "kube-api-access-4b9j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:29:00.551550 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.551511    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"
May 21 21:29:00.611696 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.611655    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87fc789a-12d6-4726-857a-07ddcb9225e3-extensions-socket-volume\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:29:00.611696 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.611697    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b9j6\" (UniqueName: \"kubernetes.io/projected/87fc789a-12d6-4726-857a-07ddcb9225e3-kube-api-access-4b9j6\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:29:00.700375 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.700281    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"]
May 21 21:29:00.703896 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:29:00.703862    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb61d6fc5_f846_4929_aa67_76fb1c07f40e.slice/crio-71599ec7ade7335e4c56ba4beee18a08c57209263237fa580e77e4aeb76b2cae WatchSource:0}: Error finding container 71599ec7ade7335e4c56ba4beee18a08c57209263237fa580e77e4aeb76b2cae: Status 404 returned error can't find the container with id 71599ec7ade7335e4c56ba4beee18a08c57209263237fa580e77e4aeb76b2cae
May 21 21:29:00.812394 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:00.812359    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87fc789a-12d6-4726-857a-07ddcb9225e3" path="/var/lib/kubelet/pods/87fc789a-12d6-4726-857a-07ddcb9225e3/volumes"
May 21 21:29:01.418902 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:01.418869    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr" event={"ID":"b61d6fc5-f846-4929-aa67-76fb1c07f40e","Type":"ContainerStarted","Data":"9ac0f54b7aba002548ce46a915690f6464b7eb42f157d619641fe8c17ea2fbbb"}
May 21 21:29:01.419422 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:01.418913    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr" event={"ID":"b61d6fc5-f846-4929-aa67-76fb1c07f40e","Type":"ContainerStarted","Data":"71599ec7ade7335e4c56ba4beee18a08c57209263237fa580e77e4aeb76b2cae"}
May 21 21:29:01.419422 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:01.418885    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8kp5q"
May 21 21:29:01.419422 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:01.419010    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"
May 21 21:29:01.513893 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:01.513823    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr" podStartSLOduration=1.513802551 podStartE2EDuration="1.513802551s" podCreationTimestamp="2026-05-21 21:29:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:29:01.511050068 +0000 UTC m=+467.199425388" watchObservedRunningTime="2026-05-21 21:29:01.513802551 +0000 UTC m=+467.202177876"
May 21 21:29:12.426426 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:12.426388    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"
May 21 21:29:14.598180 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.598140    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cbc856f4-kbn9s"]
May 21 21:29:14.604583 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.604556    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.614051 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.614024    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cbc856f4-kbn9s"]
May 21 21:29:14.729596 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.729560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0db08a9-4c88-4db9-996e-6902d587deb4-console-serving-cert\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.729596 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.729596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0db08a9-4c88-4db9-996e-6902d587deb4-service-ca\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.729813 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.729620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0db08a9-4c88-4db9-996e-6902d587deb4-console-config\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.729813 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.729670    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0db08a9-4c88-4db9-996e-6902d587deb4-console-oauth-config\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.729813 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.729744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0db08a9-4c88-4db9-996e-6902d587deb4-oauth-serving-cert\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.729813 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.729796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mshnh\" (UniqueName: \"kubernetes.io/projected/a0db08a9-4c88-4db9-996e-6902d587deb4-kube-api-access-mshnh\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.729940 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.729823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0db08a9-4c88-4db9-996e-6902d587deb4-trusted-ca-bundle\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.830968 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.830934    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0db08a9-4c88-4db9-996e-6902d587deb4-console-serving-cert\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.830968 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.830971    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0db08a9-4c88-4db9-996e-6902d587deb4-service-ca\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.831205 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.831019    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0db08a9-4c88-4db9-996e-6902d587deb4-console-config\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.831205 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.831050    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0db08a9-4c88-4db9-996e-6902d587deb4-console-oauth-config\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.831205 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.831183    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0db08a9-4c88-4db9-996e-6902d587deb4-oauth-serving-cert\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.831339 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.831261    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mshnh\" (UniqueName: \"kubernetes.io/projected/a0db08a9-4c88-4db9-996e-6902d587deb4-kube-api-access-mshnh\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.831339 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.831306    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0db08a9-4c88-4db9-996e-6902d587deb4-trusted-ca-bundle\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.831895 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.831864    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0db08a9-4c88-4db9-996e-6902d587deb4-console-config\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.832056 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.831870    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0db08a9-4c88-4db9-996e-6902d587deb4-oauth-serving-cert\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.832056 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.831974    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0db08a9-4c88-4db9-996e-6902d587deb4-service-ca\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.832168 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.832098    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0db08a9-4c88-4db9-996e-6902d587deb4-trusted-ca-bundle\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.833594 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.833563    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0db08a9-4c88-4db9-996e-6902d587deb4-console-oauth-config\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.833699 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.833642    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0db08a9-4c88-4db9-996e-6902d587deb4-console-serving-cert\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.842878 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.842856    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mshnh\" (UniqueName: \"kubernetes.io/projected/a0db08a9-4c88-4db9-996e-6902d587deb4-kube-api-access-mshnh\") pod \"console-7cbc856f4-kbn9s\" (UID: \"a0db08a9-4c88-4db9-996e-6902d587deb4\") " pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:14.914185 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:14.914089    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:15.068302 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:15.068273    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cbc856f4-kbn9s"]
May 21 21:29:15.070088 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:29:15.070060    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0db08a9_4c88_4db9_996e_6902d587deb4.slice/crio-1bff37fdd54e8524eb2f3a9d5d01f1cb3171ccc07b6a75e3f6df40ba2f66f448 WatchSource:0}: Error finding container 1bff37fdd54e8524eb2f3a9d5d01f1cb3171ccc07b6a75e3f6df40ba2f66f448: Status 404 returned error can't find the container with id 1bff37fdd54e8524eb2f3a9d5d01f1cb3171ccc07b6a75e3f6df40ba2f66f448
May 21 21:29:15.474151 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:15.474117    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cbc856f4-kbn9s" event={"ID":"a0db08a9-4c88-4db9-996e-6902d587deb4","Type":"ContainerStarted","Data":"61f1bdb38db2ae49e564a5fc6325648a89176a53b224f2a37a429f4c35243343"}
May 21 21:29:15.474151 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:15.474154    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cbc856f4-kbn9s" event={"ID":"a0db08a9-4c88-4db9-996e-6902d587deb4","Type":"ContainerStarted","Data":"1bff37fdd54e8524eb2f3a9d5d01f1cb3171ccc07b6a75e3f6df40ba2f66f448"}
May 21 21:29:15.493277 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:15.493222    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7cbc856f4-kbn9s" podStartSLOduration=1.493203259 podStartE2EDuration="1.493203259s" podCreationTimestamp="2026-05-21 21:29:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:29:15.491424102 +0000 UTC m=+481.179799424" watchObservedRunningTime="2026-05-21 21:29:15.493203259 +0000 UTC m=+481.181578580"
May 21 21:29:24.914878 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:24.914837    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:24.914878 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:24.914878    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:24.919624 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:24.919599    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:25.515423 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:25.515391    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cbc856f4-kbn9s"
May 21 21:29:25.565955 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:25.565922    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57cbd86d98-r4vx5"]
May 21 21:29:27.846486 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:27.846446    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"]
May 21 21:29:27.846904 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:27.846715    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr" podUID="b61d6fc5-f846-4929-aa67-76fb1c07f40e" containerName="manager" containerID="cri-o://9ac0f54b7aba002548ce46a915690f6464b7eb42f157d619641fe8c17ea2fbbb" gracePeriod=10
May 21 21:29:28.095922 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.095891    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"
May 21 21:29:28.133618 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.133519    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b61d6fc5-f846-4929-aa67-76fb1c07f40e-extensions-socket-volume\") pod \"b61d6fc5-f846-4929-aa67-76fb1c07f40e\" (UID: \"b61d6fc5-f846-4929-aa67-76fb1c07f40e\") "
May 21 21:29:28.133618 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.133566    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tp7n\" (UniqueName: \"kubernetes.io/projected/b61d6fc5-f846-4929-aa67-76fb1c07f40e-kube-api-access-4tp7n\") pod \"b61d6fc5-f846-4929-aa67-76fb1c07f40e\" (UID: \"b61d6fc5-f846-4929-aa67-76fb1c07f40e\") "
May 21 21:29:28.133967 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.133938    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b61d6fc5-f846-4929-aa67-76fb1c07f40e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b61d6fc5-f846-4929-aa67-76fb1c07f40e" (UID: "b61d6fc5-f846-4929-aa67-76fb1c07f40e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:29:28.136351 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.136307    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b61d6fc5-f846-4929-aa67-76fb1c07f40e-kube-api-access-4tp7n" (OuterVolumeSpecName: "kube-api-access-4tp7n") pod "b61d6fc5-f846-4929-aa67-76fb1c07f40e" (UID: "b61d6fc5-f846-4929-aa67-76fb1c07f40e"). InnerVolumeSpecName "kube-api-access-4tp7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:29:28.138881 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.138849    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"]
May 21 21:29:28.139212 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.139199    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b61d6fc5-f846-4929-aa67-76fb1c07f40e" containerName="manager"
May 21 21:29:28.139251 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.139214    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b61d6fc5-f846-4929-aa67-76fb1c07f40e" containerName="manager"
May 21 21:29:28.139287 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.139267    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="b61d6fc5-f846-4929-aa67-76fb1c07f40e" containerName="manager"
May 21 21:29:28.142748 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.142727    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"
May 21 21:29:28.172731 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.172693    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"]
May 21 21:29:28.234451 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.234413    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56d1fbf1-61e6-4d71-a20d-876e8e94258f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-q4p54\" (UID: \"56d1fbf1-61e6-4d71-a20d-876e8e94258f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"
May 21 21:29:28.234658 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.234490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp2jm\" (UniqueName: \"kubernetes.io/projected/56d1fbf1-61e6-4d71-a20d-876e8e94258f-kube-api-access-jp2jm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-q4p54\" (UID: \"56d1fbf1-61e6-4d71-a20d-876e8e94258f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"
May 21 21:29:28.234658 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.234566    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b61d6fc5-f846-4929-aa67-76fb1c07f40e-extensions-socket-volume\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:29:28.234658 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.234581    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tp7n\" (UniqueName: \"kubernetes.io/projected/b61d6fc5-f846-4929-aa67-76fb1c07f40e-kube-api-access-4tp7n\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:29:28.335162 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.335113    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp2jm\" (UniqueName: \"kubernetes.io/projected/56d1fbf1-61e6-4d71-a20d-876e8e94258f-kube-api-access-jp2jm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-q4p54\" (UID: \"56d1fbf1-61e6-4d71-a20d-876e8e94258f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"
May 21 21:29:28.335340 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.335199    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56d1fbf1-61e6-4d71-a20d-876e8e94258f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-q4p54\" (UID: \"56d1fbf1-61e6-4d71-a20d-876e8e94258f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"
May 21 21:29:28.335549 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.335532    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56d1fbf1-61e6-4d71-a20d-876e8e94258f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-q4p54\" (UID: \"56d1fbf1-61e6-4d71-a20d-876e8e94258f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"
May 21 21:29:28.345073 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.345037    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp2jm\" (UniqueName: \"kubernetes.io/projected/56d1fbf1-61e6-4d71-a20d-876e8e94258f-kube-api-access-jp2jm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-q4p54\" (UID: \"56d1fbf1-61e6-4d71-a20d-876e8e94258f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"
May 21 21:29:28.453193 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.453090    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"
May 21 21:29:28.524895 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.524862    2576 generic.go:358] "Generic (PLEG): container finished" podID="b61d6fc5-f846-4929-aa67-76fb1c07f40e" containerID="9ac0f54b7aba002548ce46a915690f6464b7eb42f157d619641fe8c17ea2fbbb" exitCode=0
May 21 21:29:28.525084 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.524934    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"
May 21 21:29:28.525084 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.524943    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr" event={"ID":"b61d6fc5-f846-4929-aa67-76fb1c07f40e","Type":"ContainerDied","Data":"9ac0f54b7aba002548ce46a915690f6464b7eb42f157d619641fe8c17ea2fbbb"}
May 21 21:29:28.525084 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.525009    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr" event={"ID":"b61d6fc5-f846-4929-aa67-76fb1c07f40e","Type":"ContainerDied","Data":"71599ec7ade7335e4c56ba4beee18a08c57209263237fa580e77e4aeb76b2cae"}
May 21 21:29:28.525084 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.525029    2576 scope.go:117] "RemoveContainer" containerID="9ac0f54b7aba002548ce46a915690f6464b7eb42f157d619641fe8c17ea2fbbb"
May 21 21:29:28.535897 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.535874    2576 scope.go:117] "RemoveContainer" containerID="9ac0f54b7aba002548ce46a915690f6464b7eb42f157d619641fe8c17ea2fbbb"
May 21 21:29:28.536293 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:29:28.536266    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ac0f54b7aba002548ce46a915690f6464b7eb42f157d619641fe8c17ea2fbbb\": container with ID starting with 9ac0f54b7aba002548ce46a915690f6464b7eb42f157d619641fe8c17ea2fbbb not found: ID does not exist" containerID="9ac0f54b7aba002548ce46a915690f6464b7eb42f157d619641fe8c17ea2fbbb"
May 21 21:29:28.536399 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.536299    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ac0f54b7aba002548ce46a915690f6464b7eb42f157d619641fe8c17ea2fbbb"} err="failed to get container status \"9ac0f54b7aba002548ce46a915690f6464b7eb42f157d619641fe8c17ea2fbbb\": rpc error: code = NotFound desc = could not find container \"9ac0f54b7aba002548ce46a915690f6464b7eb42f157d619641fe8c17ea2fbbb\": container with ID starting with 9ac0f54b7aba002548ce46a915690f6464b7eb42f157d619641fe8c17ea2fbbb not found: ID does not exist"
May 21 21:29:28.551480 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.551443    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"]
May 21 21:29:28.555691 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.555656    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-wwpgr"]
May 21 21:29:28.601617 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.601592    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"]
May 21 21:29:28.603182 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:29:28.603154    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d1fbf1_61e6_4d71_a20d_876e8e94258f.slice/crio-0d910dd3a3dfc1d6dfe87687178309045f2a31a27b3a0ded8dea7573f0739b45 WatchSource:0}: Error finding container 0d910dd3a3dfc1d6dfe87687178309045f2a31a27b3a0ded8dea7573f0739b45: Status 404 returned error can't find the container with id 0d910dd3a3dfc1d6dfe87687178309045f2a31a27b3a0ded8dea7573f0739b45
May 21 21:29:28.806024 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:28.805971    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b61d6fc5-f846-4929-aa67-76fb1c07f40e" path="/var/lib/kubelet/pods/b61d6fc5-f846-4929-aa67-76fb1c07f40e/volumes"
May 21 21:29:29.530834 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:29.530796    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54" event={"ID":"56d1fbf1-61e6-4d71-a20d-876e8e94258f","Type":"ContainerStarted","Data":"26b439da67c953261a2adb46900891269e4ffd67454edc873daf5a9e4b8c1639"}
May 21 21:29:29.530834 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:29.530834    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54" event={"ID":"56d1fbf1-61e6-4d71-a20d-876e8e94258f","Type":"ContainerStarted","Data":"0d910dd3a3dfc1d6dfe87687178309045f2a31a27b3a0ded8dea7573f0739b45"}
May 21 21:29:29.531271 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:29.530954    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"
May 21 21:29:29.555521 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:29.555467    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54" podStartSLOduration=1.555450913 podStartE2EDuration="1.555450913s" podCreationTimestamp="2026-05-21 21:29:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:29:29.553415661 +0000 UTC m=+495.241790981" watchObservedRunningTime="2026-05-21 21:29:29.555450913 +0000 UTC m=+495.243826234"
May 21 21:29:40.536369 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:40.536337    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"
May 21 21:29:50.585837 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.585764    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-57cbd86d98-r4vx5" podUID="1063ce57-0422-4291-89a9-865847734622" containerName="console" containerID="cri-o://7d2b3dff140bc6a6004cbff365f8291ca4f5e0fd44a9daf0ab1652b68cb18822" gracePeriod=15
May 21 21:29:50.830101 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.830075    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57cbd86d98-r4vx5_1063ce57-0422-4291-89a9-865847734622/console/0.log"
May 21 21:29:50.830245 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.830142    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:29:50.929972 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.929859    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1063ce57-0422-4291-89a9-865847734622-console-serving-cert\") pod \"1063ce57-0422-4291-89a9-865847734622\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") "
May 21 21:29:50.929972 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.929911    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-service-ca\") pod \"1063ce57-0422-4291-89a9-865847734622\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") "
May 21 21:29:50.929972 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.929944    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-trusted-ca-bundle\") pod \"1063ce57-0422-4291-89a9-865847734622\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") "
May 21 21:29:50.930295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.930111    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-oauth-serving-cert\") pod \"1063ce57-0422-4291-89a9-865847734622\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") "
May 21 21:29:50.930295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.930160    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-console-config\") pod \"1063ce57-0422-4291-89a9-865847734622\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") "
May 21 21:29:50.930295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.930221    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hckhf\" (UniqueName: \"kubernetes.io/projected/1063ce57-0422-4291-89a9-865847734622-kube-api-access-hckhf\") pod \"1063ce57-0422-4291-89a9-865847734622\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") "
May 21 21:29:50.930295 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.930267    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1063ce57-0422-4291-89a9-865847734622-console-oauth-config\") pod \"1063ce57-0422-4291-89a9-865847734622\" (UID: \"1063ce57-0422-4291-89a9-865847734622\") "
May 21 21:29:50.930494 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.930439    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-service-ca" (OuterVolumeSpecName: "service-ca") pod "1063ce57-0422-4291-89a9-865847734622" (UID: "1063ce57-0422-4291-89a9-865847734622"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:29:50.930549 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.930489    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1063ce57-0422-4291-89a9-865847734622" (UID: "1063ce57-0422-4291-89a9-865847734622"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:29:50.930549 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.930516    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1063ce57-0422-4291-89a9-865847734622" (UID: "1063ce57-0422-4291-89a9-865847734622"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:29:50.930648 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.930557    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-console-config" (OuterVolumeSpecName: "console-config") pod "1063ce57-0422-4291-89a9-865847734622" (UID: "1063ce57-0422-4291-89a9-865847734622"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 21:29:50.930648 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.930634    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-service-ca\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:29:50.930749 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.930654    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-trusted-ca-bundle\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:29:50.930749 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.930671    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-oauth-serving-cert\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:29:50.930749 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.930681    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1063ce57-0422-4291-89a9-865847734622-console-config\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:29:50.932253 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.932228    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1063ce57-0422-4291-89a9-865847734622-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1063ce57-0422-4291-89a9-865847734622" (UID: "1063ce57-0422-4291-89a9-865847734622"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:29:50.932394 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.932366    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1063ce57-0422-4291-89a9-865847734622-kube-api-access-hckhf" (OuterVolumeSpecName: "kube-api-access-hckhf") pod "1063ce57-0422-4291-89a9-865847734622" (UID: "1063ce57-0422-4291-89a9-865847734622"). InnerVolumeSpecName "kube-api-access-hckhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:29:50.932456 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:50.932430    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1063ce57-0422-4291-89a9-865847734622-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1063ce57-0422-4291-89a9-865847734622" (UID: "1063ce57-0422-4291-89a9-865847734622"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 21:29:51.031095 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:51.031054    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hckhf\" (UniqueName: \"kubernetes.io/projected/1063ce57-0422-4291-89a9-865847734622-kube-api-access-hckhf\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:29:51.031095 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:51.031086    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1063ce57-0422-4291-89a9-865847734622-console-oauth-config\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:29:51.031095 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:51.031096    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1063ce57-0422-4291-89a9-865847734622-console-serving-cert\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:29:51.614320 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:51.614292    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57cbd86d98-r4vx5_1063ce57-0422-4291-89a9-865847734622/console/0.log"
May 21 21:29:51.614763 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:51.614333    2576 generic.go:358] "Generic (PLEG): container finished" podID="1063ce57-0422-4291-89a9-865847734622" containerID="7d2b3dff140bc6a6004cbff365f8291ca4f5e0fd44a9daf0ab1652b68cb18822" exitCode=2
May 21 21:29:51.614763 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:51.614408    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cbd86d98-r4vx5" event={"ID":"1063ce57-0422-4291-89a9-865847734622","Type":"ContainerDied","Data":"7d2b3dff140bc6a6004cbff365f8291ca4f5e0fd44a9daf0ab1652b68cb18822"}
May 21 21:29:51.614763 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:51.614446    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57cbd86d98-r4vx5" event={"ID":"1063ce57-0422-4291-89a9-865847734622","Type":"ContainerDied","Data":"ac97871596b1532308d33fcc8af4ce9c46b5d808fb768b3c57335fcbdfa25523"}
May 21 21:29:51.614763 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:51.614462    2576 scope.go:117] "RemoveContainer" containerID="7d2b3dff140bc6a6004cbff365f8291ca4f5e0fd44a9daf0ab1652b68cb18822"
May 21 21:29:51.614763 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:51.614421    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57cbd86d98-r4vx5"
May 21 21:29:51.623241 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:51.623222    2576 scope.go:117] "RemoveContainer" containerID="7d2b3dff140bc6a6004cbff365f8291ca4f5e0fd44a9daf0ab1652b68cb18822"
May 21 21:29:51.623520 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:29:51.623498    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d2b3dff140bc6a6004cbff365f8291ca4f5e0fd44a9daf0ab1652b68cb18822\": container with ID starting with 7d2b3dff140bc6a6004cbff365f8291ca4f5e0fd44a9daf0ab1652b68cb18822 not found: ID does not exist" containerID="7d2b3dff140bc6a6004cbff365f8291ca4f5e0fd44a9daf0ab1652b68cb18822"
May 21 21:29:51.623584 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:51.623535    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d2b3dff140bc6a6004cbff365f8291ca4f5e0fd44a9daf0ab1652b68cb18822"} err="failed to get container status \"7d2b3dff140bc6a6004cbff365f8291ca4f5e0fd44a9daf0ab1652b68cb18822\": rpc error: code = NotFound desc = could not find container \"7d2b3dff140bc6a6004cbff365f8291ca4f5e0fd44a9daf0ab1652b68cb18822\": container with ID starting with 7d2b3dff140bc6a6004cbff365f8291ca4f5e0fd44a9daf0ab1652b68cb18822 not found: ID does not exist"
May 21 21:29:51.637942 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:51.637913    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57cbd86d98-r4vx5"]
May 21 21:29:51.642703 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:51.642676    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57cbd86d98-r4vx5"]
May 21 21:29:52.806614 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:29:52.806579    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1063ce57-0422-4291-89a9-865847734622" path="/var/lib/kubelet/pods/1063ce57-0422-4291-89a9-865847734622/volumes"
May 21 21:30:27.849392 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:27.849350    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74c44d59db-bzbpl"]
May 21 21:30:27.850182 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:27.849806    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1063ce57-0422-4291-89a9-865847734622" containerName="console"
May 21 21:30:27.850182 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:27.849827    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1063ce57-0422-4291-89a9-865847734622" containerName="console"
May 21 21:30:27.850182 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:27.849903    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="1063ce57-0422-4291-89a9-865847734622" containerName="console"
May 21 21:30:27.854433 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:27.854409    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c44d59db-bzbpl"
May 21 21:30:27.857810 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:27.857776    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 21:30:27.857941 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:27.857881    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rz97v\""
May 21 21:30:27.867821 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:27.867793    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74c44d59db-bzbpl"]
May 21 21:30:27.933259 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:27.933224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsb7p\" (UniqueName: \"kubernetes.io/projected/bba75dff-6980-4778-94fc-4b9b7dc51086-kube-api-access-hsb7p\") pod \"maas-controller-74c44d59db-bzbpl\" (UID: \"bba75dff-6980-4778-94fc-4b9b7dc51086\") " pod="opendatahub/maas-controller-74c44d59db-bzbpl"
May 21 21:30:27.997897 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:27.997848    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cdcbfbfb6-8rqwk"]
May 21 21:30:28.001352 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:28.001326    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk"
May 21 21:30:28.010893 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:28.010864    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cdcbfbfb6-8rqwk"]
May 21 21:30:28.033678 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:28.033642    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsb7p\" (UniqueName: \"kubernetes.io/projected/bba75dff-6980-4778-94fc-4b9b7dc51086-kube-api-access-hsb7p\") pod \"maas-controller-74c44d59db-bzbpl\" (UID: \"bba75dff-6980-4778-94fc-4b9b7dc51086\") " pod="opendatahub/maas-controller-74c44d59db-bzbpl"
May 21 21:30:28.033862 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:28.033719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljpgg\" (UniqueName: \"kubernetes.io/projected/fe64435f-a351-4035-a943-7c50b9e78242-kube-api-access-ljpgg\") pod \"maas-controller-5cdcbfbfb6-8rqwk\" (UID: \"fe64435f-a351-4035-a943-7c50b9e78242\") " pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk"
May 21 21:30:28.043095 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:28.043069    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsb7p\" (UniqueName: \"kubernetes.io/projected/bba75dff-6980-4778-94fc-4b9b7dc51086-kube-api-access-hsb7p\") pod \"maas-controller-74c44d59db-bzbpl\" (UID: \"bba75dff-6980-4778-94fc-4b9b7dc51086\") " pod="opendatahub/maas-controller-74c44d59db-bzbpl"
May 21 21:30:28.135193 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:28.135095    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ljpgg\" (UniqueName: \"kubernetes.io/projected/fe64435f-a351-4035-a943-7c50b9e78242-kube-api-access-ljpgg\") pod \"maas-controller-5cdcbfbfb6-8rqwk\" (UID: \"fe64435f-a351-4035-a943-7c50b9e78242\") " pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk"
May 21 21:30:28.149700 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:28.149664    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljpgg\" (UniqueName: \"kubernetes.io/projected/fe64435f-a351-4035-a943-7c50b9e78242-kube-api-access-ljpgg\") pod \"maas-controller-5cdcbfbfb6-8rqwk\" (UID: \"fe64435f-a351-4035-a943-7c50b9e78242\") " pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk"
May 21 21:30:28.164636 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:28.164597    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c44d59db-bzbpl"
May 21 21:30:28.312975 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:28.312931    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk"
May 21 21:30:28.334662 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:28.334622    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74c44d59db-bzbpl"]
May 21 21:30:28.338503 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:30:28.338448    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba75dff_6980_4778_94fc_4b9b7dc51086.slice/crio-496dbd126f969133eda0b7941157ace435ad2da2692e52e400eabcf73dccb25c WatchSource:0}: Error finding container 496dbd126f969133eda0b7941157ace435ad2da2692e52e400eabcf73dccb25c: Status 404 returned error can't find the container with id 496dbd126f969133eda0b7941157ace435ad2da2692e52e400eabcf73dccb25c
May 21 21:30:28.481463 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:28.481434    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cdcbfbfb6-8rqwk"]
May 21 21:30:28.484100 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:30:28.484068    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe64435f_a351_4035_a943_7c50b9e78242.slice/crio-e3f8a04605c697732743451503efc8be32ac6563c90d6380da444c7251bd3132 WatchSource:0}: Error finding container e3f8a04605c697732743451503efc8be32ac6563c90d6380da444c7251bd3132: Status 404 returned error can't find the container with id e3f8a04605c697732743451503efc8be32ac6563c90d6380da444c7251bd3132
May 21 21:30:28.767911 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:28.767868    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk" event={"ID":"fe64435f-a351-4035-a943-7c50b9e78242","Type":"ContainerStarted","Data":"e3f8a04605c697732743451503efc8be32ac6563c90d6380da444c7251bd3132"}
May 21 21:30:28.768996 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:28.768952    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c44d59db-bzbpl" event={"ID":"bba75dff-6980-4778-94fc-4b9b7dc51086","Type":"ContainerStarted","Data":"496dbd126f969133eda0b7941157ace435ad2da2692e52e400eabcf73dccb25c"}
May 21 21:30:31.785852 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:31.785815    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk" event={"ID":"fe64435f-a351-4035-a943-7c50b9e78242","Type":"ContainerStarted","Data":"f1154b6c8253d7d7080f129293e31f1f922577e64710560bac1587387a4aeec4"}
May 21 21:30:31.786319 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:31.785888    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk"
May 21 21:30:31.787360 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:31.787335    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c44d59db-bzbpl" event={"ID":"bba75dff-6980-4778-94fc-4b9b7dc51086","Type":"ContainerStarted","Data":"0634151318b8a2fbea084aba95f5938986a399f028190f6e54f4b4534818fc01"}
May 21 21:30:31.787503 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:31.787452    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74c44d59db-bzbpl"
May 21 21:30:31.816034 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:31.815967    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk" podStartSLOduration=2.159288293 podStartE2EDuration="4.815949923s" podCreationTimestamp="2026-05-21 21:30:27 +0000 UTC" firstStartedPulling="2026-05-21 21:30:28.485572295 +0000 UTC m=+554.173947597" lastFinishedPulling="2026-05-21 21:30:31.142233914 +0000 UTC m=+556.830609227" observedRunningTime="2026-05-21 21:30:31.814824043 +0000 UTC m=+557.503199363" watchObservedRunningTime="2026-05-21 21:30:31.815949923 +0000 UTC m=+557.504325244"
May 21 21:30:31.842283 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:31.842219    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-74c44d59db-bzbpl" podStartSLOduration=2.051031391 podStartE2EDuration="4.842202262s" podCreationTimestamp="2026-05-21 21:30:27 +0000 UTC" firstStartedPulling="2026-05-21 21:30:28.339552717 +0000 UTC m=+554.027928016" lastFinishedPulling="2026-05-21 21:30:31.130723571 +0000 UTC m=+556.819098887" observedRunningTime="2026-05-21 21:30:31.840196753 +0000 UTC m=+557.528572073" watchObservedRunningTime="2026-05-21 21:30:31.842202262 +0000 UTC m=+557.530577583"
May 21 21:30:42.797188 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:42.797154    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74c44d59db-bzbpl"
May 21 21:30:42.797571 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:42.797457    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk"
May 21 21:30:42.855374 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:42.855339    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74c44d59db-bzbpl"]
May 21 21:30:42.855599 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:42.855550    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-74c44d59db-bzbpl" podUID="bba75dff-6980-4778-94fc-4b9b7dc51086" containerName="manager" containerID="cri-o://0634151318b8a2fbea084aba95f5938986a399f028190f6e54f4b4534818fc01" gracePeriod=30
May 21 21:30:43.098830 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:43.098802    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c44d59db-bzbpl"
May 21 21:30:43.163471 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:43.163433    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsb7p\" (UniqueName: \"kubernetes.io/projected/bba75dff-6980-4778-94fc-4b9b7dc51086-kube-api-access-hsb7p\") pod \"bba75dff-6980-4778-94fc-4b9b7dc51086\" (UID: \"bba75dff-6980-4778-94fc-4b9b7dc51086\") "
May 21 21:30:43.165641 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:43.165605    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bba75dff-6980-4778-94fc-4b9b7dc51086-kube-api-access-hsb7p" (OuterVolumeSpecName: "kube-api-access-hsb7p") pod "bba75dff-6980-4778-94fc-4b9b7dc51086" (UID: "bba75dff-6980-4778-94fc-4b9b7dc51086"). InnerVolumeSpecName "kube-api-access-hsb7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:30:43.264397 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:43.264350    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsb7p\" (UniqueName: \"kubernetes.io/projected/bba75dff-6980-4778-94fc-4b9b7dc51086-kube-api-access-hsb7p\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:30:43.831449 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:43.831412    2576 generic.go:358] "Generic (PLEG): container finished" podID="bba75dff-6980-4778-94fc-4b9b7dc51086" containerID="0634151318b8a2fbea084aba95f5938986a399f028190f6e54f4b4534818fc01" exitCode=0
May 21 21:30:43.831920 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:43.831497    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74c44d59db-bzbpl"
May 21 21:30:43.831920 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:43.831494    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c44d59db-bzbpl" event={"ID":"bba75dff-6980-4778-94fc-4b9b7dc51086","Type":"ContainerDied","Data":"0634151318b8a2fbea084aba95f5938986a399f028190f6e54f4b4534818fc01"}
May 21 21:30:43.831920 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:43.831606    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74c44d59db-bzbpl" event={"ID":"bba75dff-6980-4778-94fc-4b9b7dc51086","Type":"ContainerDied","Data":"496dbd126f969133eda0b7941157ace435ad2da2692e52e400eabcf73dccb25c"}
May 21 21:30:43.831920 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:43.831624    2576 scope.go:117] "RemoveContainer" containerID="0634151318b8a2fbea084aba95f5938986a399f028190f6e54f4b4534818fc01"
May 21 21:30:43.840556 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:43.840539    2576 scope.go:117] "RemoveContainer" containerID="0634151318b8a2fbea084aba95f5938986a399f028190f6e54f4b4534818fc01"
May 21 21:30:43.840831 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:30:43.840814    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0634151318b8a2fbea084aba95f5938986a399f028190f6e54f4b4534818fc01\": container with ID starting with 0634151318b8a2fbea084aba95f5938986a399f028190f6e54f4b4534818fc01 not found: ID does not exist" containerID="0634151318b8a2fbea084aba95f5938986a399f028190f6e54f4b4534818fc01"
May 21 21:30:43.840879 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:43.840843    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0634151318b8a2fbea084aba95f5938986a399f028190f6e54f4b4534818fc01"} err="failed to get container status \"0634151318b8a2fbea084aba95f5938986a399f028190f6e54f4b4534818fc01\": rpc error: code = NotFound desc = could not find container \"0634151318b8a2fbea084aba95f5938986a399f028190f6e54f4b4534818fc01\": container with ID starting with 0634151318b8a2fbea084aba95f5938986a399f028190f6e54f4b4534818fc01 not found: ID does not exist"
May 21 21:30:43.854792 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:43.854762    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74c44d59db-bzbpl"]
May 21 21:30:43.862789 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:43.862277    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74c44d59db-bzbpl"]
May 21 21:30:44.807136 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:44.807098    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bba75dff-6980-4778-94fc-4b9b7dc51086" path="/var/lib/kubelet/pods/bba75dff-6980-4778-94fc-4b9b7dc51086/volumes"
May 21 21:30:59.825201 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:59.825154    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-859d7b7bc-z585s"]
May 21 21:30:59.825642 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:59.825479    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bba75dff-6980-4778-94fc-4b9b7dc51086" containerName="manager"
May 21 21:30:59.825642 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:59.825490    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bba75dff-6980-4778-94fc-4b9b7dc51086" containerName="manager"
May 21 21:30:59.825642 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:59.825549    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="bba75dff-6980-4778-94fc-4b9b7dc51086" containerName="manager"
May 21 21:30:59.832036 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:59.831972    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-859d7b7bc-z585s"
May 21 21:30:59.834814 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:59.834784    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-dw59m\""
May 21 21:30:59.835682 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:59.835662    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 21 21:30:59.853631 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:30:59.853593    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-859d7b7bc-z585s"]
May 21 21:31:00.004159 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.004120    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96457\" (UniqueName: \"kubernetes.io/projected/b4878087-9d17-4fde-a576-7516402c186a-kube-api-access-96457\") pod \"maas-api-859d7b7bc-z585s\" (UID: \"b4878087-9d17-4fde-a576-7516402c186a\") " pod="opendatahub/maas-api-859d7b7bc-z585s"
May 21 21:31:00.004327 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.004168    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4878087-9d17-4fde-a576-7516402c186a-maas-api-tls\") pod \"maas-api-859d7b7bc-z585s\" (UID: \"b4878087-9d17-4fde-a576-7516402c186a\") " pod="opendatahub/maas-api-859d7b7bc-z585s"
May 21 21:31:00.105825 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.105728    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-96457\" (UniqueName: \"kubernetes.io/projected/b4878087-9d17-4fde-a576-7516402c186a-kube-api-access-96457\") pod \"maas-api-859d7b7bc-z585s\" (UID: \"b4878087-9d17-4fde-a576-7516402c186a\") " pod="opendatahub/maas-api-859d7b7bc-z585s"
May 21 21:31:00.105825 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.105796    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4878087-9d17-4fde-a576-7516402c186a-maas-api-tls\") pod \"maas-api-859d7b7bc-z585s\" (UID: \"b4878087-9d17-4fde-a576-7516402c186a\") " pod="opendatahub/maas-api-859d7b7bc-z585s"
May 21 21:31:00.108669 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.108635    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4878087-9d17-4fde-a576-7516402c186a-maas-api-tls\") pod \"maas-api-859d7b7bc-z585s\" (UID: \"b4878087-9d17-4fde-a576-7516402c186a\") " pod="opendatahub/maas-api-859d7b7bc-z585s"
May 21 21:31:00.125875 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.125844    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96457\" (UniqueName: \"kubernetes.io/projected/b4878087-9d17-4fde-a576-7516402c186a-kube-api-access-96457\") pod \"maas-api-859d7b7bc-z585s\" (UID: \"b4878087-9d17-4fde-a576-7516402c186a\") " pod="opendatahub/maas-api-859d7b7bc-z585s"
May 21 21:31:00.142560 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.142527    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-859d7b7bc-z585s"
May 21 21:31:00.261613 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.261579    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-bph74"]
May 21 21:31:00.266120 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.266094    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-bph74"
May 21 21:31:00.269937 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.269911    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-blkzq\""
May 21 21:31:00.270121 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.269952    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 21 21:31:00.283087 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.283053    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-bph74"]
May 21 21:31:00.306481 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.306453    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-859d7b7bc-z585s"]
May 21 21:31:00.306614 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:31:00.306554    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4878087_9d17_4fde_a576_7516402c186a.slice/crio-b67bd4dfb5bfa6e3120c2897ee72d2978d490575d5192e13ba8e3b54afc4db52 WatchSource:0}: Error finding container b67bd4dfb5bfa6e3120c2897ee72d2978d490575d5192e13ba8e3b54afc4db52: Status 404 returned error can't find the container with id b67bd4dfb5bfa6e3120c2897ee72d2978d490575d5192e13ba8e3b54afc4db52
May 21 21:31:00.408691 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.408593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp7fq\" (UniqueName: \"kubernetes.io/projected/07c62045-9ac0-46db-8ff0-341f436cd1af-kube-api-access-bp7fq\") pod \"payload-processing-58b6c8fdc7-bph74\" (UID: \"07c62045-9ac0-46db-8ff0-341f436cd1af\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-bph74"
May 21 21:31:00.510033 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.509957    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bp7fq\" (UniqueName: \"kubernetes.io/projected/07c62045-9ac0-46db-8ff0-341f436cd1af-kube-api-access-bp7fq\") pod \"payload-processing-58b6c8fdc7-bph74\" (UID: \"07c62045-9ac0-46db-8ff0-341f436cd1af\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-bph74"
May 21 21:31:00.520753 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.520722    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp7fq\" (UniqueName: \"kubernetes.io/projected/07c62045-9ac0-46db-8ff0-341f436cd1af-kube-api-access-bp7fq\") pod \"payload-processing-58b6c8fdc7-bph74\" (UID: \"07c62045-9ac0-46db-8ff0-341f436cd1af\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-bph74"
May 21 21:31:00.577614 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.577573    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-bph74"
May 21 21:31:00.725198 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.725166    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-bph74"]
May 21 21:31:00.726849 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:31:00.726825    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07c62045_9ac0_46db_8ff0_341f436cd1af.slice/crio-21cbd8aa2f3b74c4b371c501c5a032a621b0f1a8d0310cdf81dd50a1198009da WatchSource:0}: Error finding container 21cbd8aa2f3b74c4b371c501c5a032a621b0f1a8d0310cdf81dd50a1198009da: Status 404 returned error can't find the container with id 21cbd8aa2f3b74c4b371c501c5a032a621b0f1a8d0310cdf81dd50a1198009da
May 21 21:31:00.899512 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.899476    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-bph74" event={"ID":"07c62045-9ac0-46db-8ff0-341f436cd1af","Type":"ContainerStarted","Data":"21cbd8aa2f3b74c4b371c501c5a032a621b0f1a8d0310cdf81dd50a1198009da"}
May 21 21:31:00.900638 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:00.900611    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-859d7b7bc-z585s" event={"ID":"b4878087-9d17-4fde-a576-7516402c186a","Type":"ContainerStarted","Data":"b67bd4dfb5bfa6e3120c2897ee72d2978d490575d5192e13ba8e3b54afc4db52"}
May 21 21:31:02.910450 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:02.910416    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-859d7b7bc-z585s" event={"ID":"b4878087-9d17-4fde-a576-7516402c186a","Type":"ContainerStarted","Data":"07473daf6dadfa3cb1f380441fa9e821cdea4e7059de193caeadbf70bfa24206"}
May 21 21:31:02.911167 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:02.910529    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-859d7b7bc-z585s"
May 21 21:31:02.911964 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:02.911939    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-bph74" event={"ID":"07c62045-9ac0-46db-8ff0-341f436cd1af","Type":"ContainerStarted","Data":"7d75e6f772a3310b40809ac0b4476b795de9a82b236270ae086631f99c2c7cd1"}
May 21 21:31:02.930180 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:02.930130    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-859d7b7bc-z585s" podStartSLOduration=2.017437003 podStartE2EDuration="3.930114385s" podCreationTimestamp="2026-05-21 21:30:59 +0000 UTC" firstStartedPulling="2026-05-21 21:31:00.307806918 +0000 UTC m=+585.996182216" lastFinishedPulling="2026-05-21 21:31:02.220484294 +0000 UTC m=+587.908859598" observedRunningTime="2026-05-21 21:31:02.927297803 +0000 UTC m=+588.615673136" watchObservedRunningTime="2026-05-21 21:31:02.930114385 +0000 UTC m=+588.618489704"
May 21 21:31:02.944471 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:02.944418    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-bph74" podStartSLOduration=1.409288908 podStartE2EDuration="2.944402828s" podCreationTimestamp="2026-05-21 21:31:00 +0000 UTC" firstStartedPulling="2026-05-21 21:31:00.728733028 +0000 UTC m=+586.417108330" lastFinishedPulling="2026-05-21 21:31:02.263846936 +0000 UTC m=+587.952222250" observedRunningTime="2026-05-21 21:31:02.942848156 +0000 UTC m=+588.631223477" watchObservedRunningTime="2026-05-21 21:31:02.944402828 +0000 UTC m=+588.632778149"
May 21 21:31:03.916126 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:03.916087    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-bph74"
May 21 21:31:08.921681 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:08.921648    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-859d7b7bc-z585s"
May 21 21:31:14.921451 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:14.921415    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-bph74"
May 21 21:31:27.032088 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.032047    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"]
May 21 21:31:27.037107 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.037078    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.040897 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.040875    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p5j97\""
May 21 21:31:27.041054 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.040876    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 21:31:27.041054 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.040877    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 21:31:27.041054 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.040909    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 21 21:31:27.047149 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.047119    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"]
May 21 21:31:27.122087 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.122042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c3cff5-61a9-48f5-a9c7-84681b0da829-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.122275 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.122107    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b8c3cff5-61a9-48f5-a9c7-84681b0da829-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.122275 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.122130    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c3cff5-61a9-48f5-a9c7-84681b0da829-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.122275 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.122147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkv4b\" (UniqueName: \"kubernetes.io/projected/b8c3cff5-61a9-48f5-a9c7-84681b0da829-kube-api-access-pkv4b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.122275 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.122166    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c3cff5-61a9-48f5-a9c7-84681b0da829-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.122275 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.122236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c3cff5-61a9-48f5-a9c7-84681b0da829-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.223513 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.223473    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c3cff5-61a9-48f5-a9c7-84681b0da829-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.223723 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.223536    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b8c3cff5-61a9-48f5-a9c7-84681b0da829-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.223723 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.223563    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c3cff5-61a9-48f5-a9c7-84681b0da829-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.223723 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.223587    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pkv4b\" (UniqueName: \"kubernetes.io/projected/b8c3cff5-61a9-48f5-a9c7-84681b0da829-kube-api-access-pkv4b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.223723 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.223617    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c3cff5-61a9-48f5-a9c7-84681b0da829-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.223723 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.223658    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c3cff5-61a9-48f5-a9c7-84681b0da829-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.224091 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.224068    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8c3cff5-61a9-48f5-a9c7-84681b0da829-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.224164 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.224072    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b8c3cff5-61a9-48f5-a9c7-84681b0da829-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.224164 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.224142    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8c3cff5-61a9-48f5-a9c7-84681b0da829-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.226047 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.226023    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8c3cff5-61a9-48f5-a9c7-84681b0da829-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.226238 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.226217    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8c3cff5-61a9-48f5-a9c7-84681b0da829-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.233914 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.233882    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkv4b\" (UniqueName: \"kubernetes.io/projected/b8c3cff5-61a9-48f5-a9c7-84681b0da829-kube-api-access-pkv4b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74\" (UID: \"b8c3cff5-61a9-48f5-a9c7-84681b0da829\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.349706 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.349611    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:27.497824 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:27.497793    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"]
May 21 21:31:27.499820 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:31:27.499778    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c3cff5_61a9_48f5_a9c7_84681b0da829.slice/crio-b6d16b7ac36130006388292b88d340633eae5b4251e58837fe03d0e27946f76c WatchSource:0}: Error finding container b6d16b7ac36130006388292b88d340633eae5b4251e58837fe03d0e27946f76c: Status 404 returned error can't find the container with id b6d16b7ac36130006388292b88d340633eae5b4251e58837fe03d0e27946f76c
May 21 21:31:28.011367 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:28.011326    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74" event={"ID":"b8c3cff5-61a9-48f5-a9c7-84681b0da829","Type":"ContainerStarted","Data":"b6d16b7ac36130006388292b88d340633eae5b4251e58837fe03d0e27946f76c"}
May 21 21:31:35.041644 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:35.041598    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74" event={"ID":"b8c3cff5-61a9-48f5-a9c7-84681b0da829","Type":"ContainerStarted","Data":"08d5cd0dc932afaa13040c0e7b1a8438a16a8cd38d6e740e75f3e45e46973305"}
May 21 21:31:41.064888 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:41.064847    2576 generic.go:358] "Generic (PLEG): container finished" podID="b8c3cff5-61a9-48f5-a9c7-84681b0da829" containerID="08d5cd0dc932afaa13040c0e7b1a8438a16a8cd38d6e740e75f3e45e46973305" exitCode=0
May 21 21:31:41.065313 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:41.064921    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74" event={"ID":"b8c3cff5-61a9-48f5-a9c7-84681b0da829","Type":"ContainerDied","Data":"08d5cd0dc932afaa13040c0e7b1a8438a16a8cd38d6e740e75f3e45e46973305"}
May 21 21:31:41.065729 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:41.065707    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 21:31:43.075716 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:43.075674    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74" event={"ID":"b8c3cff5-61a9-48f5-a9c7-84681b0da829","Type":"ContainerStarted","Data":"4c85eb6873f3ab089f3e23bfb35a72c289507a38d2bb63436d43d56c69fd9b9e"}
May 21 21:31:43.076176 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:43.075899    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:43.095405 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:43.095351    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74" podStartSLOduration=1.368989312 podStartE2EDuration="16.095334863s" podCreationTimestamp="2026-05-21 21:31:27 +0000 UTC" firstStartedPulling="2026-05-21 21:31:27.50190013 +0000 UTC m=+613.190275433" lastFinishedPulling="2026-05-21 21:31:42.228245682 +0000 UTC m=+627.916620984" observedRunningTime="2026-05-21 21:31:43.094446286 +0000 UTC m=+628.782821608" watchObservedRunningTime="2026-05-21 21:31:43.095334863 +0000 UTC m=+628.783710184"
May 21 21:31:49.618508 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.618472    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"]
May 21 21:31:49.623171 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.623144    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.625707 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.625684    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 21 21:31:49.634861 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.634833    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"]
May 21 21:31:49.738614 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.738571    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd7ec588-4d28-437a-ab98-aca87dc90fb4-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.738813 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.738646    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd7ec588-4d28-437a-ab98-aca87dc90fb4-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.738813 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.738707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd7ec588-4d28-437a-ab98-aca87dc90fb4-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.738813 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.738766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd7ec588-4d28-437a-ab98-aca87dc90fb4-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.738941 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.738811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmlrj\" (UniqueName: \"kubernetes.io/projected/bd7ec588-4d28-437a-ab98-aca87dc90fb4-kube-api-access-mmlrj\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.738941 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.738846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bd7ec588-4d28-437a-ab98-aca87dc90fb4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.839623 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.839580    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd7ec588-4d28-437a-ab98-aca87dc90fb4-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.839623 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.839624    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd7ec588-4d28-437a-ab98-aca87dc90fb4-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.839892 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.839642    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmlrj\" (UniqueName: \"kubernetes.io/projected/bd7ec588-4d28-437a-ab98-aca87dc90fb4-kube-api-access-mmlrj\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.839892 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.839666    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bd7ec588-4d28-437a-ab98-aca87dc90fb4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.839892 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.839694    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd7ec588-4d28-437a-ab98-aca87dc90fb4-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.839892 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.839751    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd7ec588-4d28-437a-ab98-aca87dc90fb4-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.840137 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.840097    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd7ec588-4d28-437a-ab98-aca87dc90fb4-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.840192 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.840142    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bd7ec588-4d28-437a-ab98-aca87dc90fb4-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.840250 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.840197    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd7ec588-4d28-437a-ab98-aca87dc90fb4-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.842102 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.842082    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd7ec588-4d28-437a-ab98-aca87dc90fb4-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.842374 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.842357    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd7ec588-4d28-437a-ab98-aca87dc90fb4-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.848524 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.848492    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmlrj\" (UniqueName: \"kubernetes.io/projected/bd7ec588-4d28-437a-ab98-aca87dc90fb4-kube-api-access-mmlrj\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx\" (UID: \"bd7ec588-4d28-437a-ab98-aca87dc90fb4\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:49.935835 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:49.935734    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:50.089115 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:50.089023    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"]
May 21 21:31:50.091515 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:31:50.091484    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd7ec588_4d28_437a_ab98_aca87dc90fb4.slice/crio-1a6d81d49cd982b06ff3f1d1ca1c4233dc6c0e4a3e863d79d4fa36c79bb36a26 WatchSource:0}: Error finding container 1a6d81d49cd982b06ff3f1d1ca1c4233dc6c0e4a3e863d79d4fa36c79bb36a26: Status 404 returned error can't find the container with id 1a6d81d49cd982b06ff3f1d1ca1c4233dc6c0e4a3e863d79d4fa36c79bb36a26
May 21 21:31:50.106852 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:50.106799    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx" event={"ID":"bd7ec588-4d28-437a-ab98-aca87dc90fb4","Type":"ContainerStarted","Data":"1a6d81d49cd982b06ff3f1d1ca1c4233dc6c0e4a3e863d79d4fa36c79bb36a26"}
May 21 21:31:51.112963 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:51.112923    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx" event={"ID":"bd7ec588-4d28-437a-ab98-aca87dc90fb4","Type":"ContainerStarted","Data":"ac266bf146fc25ce3c0f65a14a484efe31cbb335696feeaf802944abb4114af8"}
May 21 21:31:54.096092 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:54.096046    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74"
May 21 21:31:56.136222 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:56.136180    2576 generic.go:358] "Generic (PLEG): container finished" podID="bd7ec588-4d28-437a-ab98-aca87dc90fb4" containerID="ac266bf146fc25ce3c0f65a14a484efe31cbb335696feeaf802944abb4114af8" exitCode=0
May 21 21:31:56.136622 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:56.136255    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx" event={"ID":"bd7ec588-4d28-437a-ab98-aca87dc90fb4","Type":"ContainerDied","Data":"ac266bf146fc25ce3c0f65a14a484efe31cbb335696feeaf802944abb4114af8"}
May 21 21:31:57.141949 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:57.141916    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx" event={"ID":"bd7ec588-4d28-437a-ab98-aca87dc90fb4","Type":"ContainerStarted","Data":"8cb053b75ee34674328bbdc1a6e6c79671bc26950ebd1f1efcf76c237e151540"}
May 21 21:31:57.142378 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:57.142153    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:31:57.164462 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:31:57.164406    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx" podStartSLOduration=7.961032223 podStartE2EDuration="8.164386585s" podCreationTimestamp="2026-05-21 21:31:49 +0000 UTC" firstStartedPulling="2026-05-21 21:31:56.136925483 +0000 UTC m=+641.825300783" lastFinishedPulling="2026-05-21 21:31:56.340279842 +0000 UTC m=+642.028655145" observedRunningTime="2026-05-21 21:31:57.162065057 +0000 UTC m=+642.850440381" watchObservedRunningTime="2026-05-21 21:31:57.164386585 +0000 UTC m=+642.852761956"
May 21 21:32:08.158411 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:32:08.158375    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx"
May 21 21:33:47.722456 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:47.722418    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cdcbfbfb6-8rqwk"]
May 21 21:33:47.722974 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:47.722659    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk" podUID="fe64435f-a351-4035-a943-7c50b9e78242" containerName="manager" containerID="cri-o://f1154b6c8253d7d7080f129293e31f1f922577e64710560bac1587387a4aeec4" gracePeriod=30
May 21 21:33:47.967846 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:47.967821    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk"
May 21 21:33:47.989103 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:47.989019    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljpgg\" (UniqueName: \"kubernetes.io/projected/fe64435f-a351-4035-a943-7c50b9e78242-kube-api-access-ljpgg\") pod \"fe64435f-a351-4035-a943-7c50b9e78242\" (UID: \"fe64435f-a351-4035-a943-7c50b9e78242\") "
May 21 21:33:47.991595 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:47.991556    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe64435f-a351-4035-a943-7c50b9e78242-kube-api-access-ljpgg" (OuterVolumeSpecName: "kube-api-access-ljpgg") pod "fe64435f-a351-4035-a943-7c50b9e78242" (UID: "fe64435f-a351-4035-a943-7c50b9e78242"). InnerVolumeSpecName "kube-api-access-ljpgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:33:48.090057 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:48.090026    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljpgg\" (UniqueName: \"kubernetes.io/projected/fe64435f-a351-4035-a943-7c50b9e78242-kube-api-access-ljpgg\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:33:48.606067 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:48.606029    2576 generic.go:358] "Generic (PLEG): container finished" podID="fe64435f-a351-4035-a943-7c50b9e78242" containerID="f1154b6c8253d7d7080f129293e31f1f922577e64710560bac1587387a4aeec4" exitCode=0
May 21 21:33:48.606286 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:48.606095    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk"
May 21 21:33:48.606286 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:48.606115    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk" event={"ID":"fe64435f-a351-4035-a943-7c50b9e78242","Type":"ContainerDied","Data":"f1154b6c8253d7d7080f129293e31f1f922577e64710560bac1587387a4aeec4"}
May 21 21:33:48.606286 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:48.606165    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdcbfbfb6-8rqwk" event={"ID":"fe64435f-a351-4035-a943-7c50b9e78242","Type":"ContainerDied","Data":"e3f8a04605c697732743451503efc8be32ac6563c90d6380da444c7251bd3132"}
May 21 21:33:48.606286 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:48.606184    2576 scope.go:117] "RemoveContainer" containerID="f1154b6c8253d7d7080f129293e31f1f922577e64710560bac1587387a4aeec4"
May 21 21:33:48.616123 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:48.616100    2576 scope.go:117] "RemoveContainer" containerID="f1154b6c8253d7d7080f129293e31f1f922577e64710560bac1587387a4aeec4"
May 21 21:33:48.616386 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:33:48.616367    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1154b6c8253d7d7080f129293e31f1f922577e64710560bac1587387a4aeec4\": container with ID starting with f1154b6c8253d7d7080f129293e31f1f922577e64710560bac1587387a4aeec4 not found: ID does not exist" containerID="f1154b6c8253d7d7080f129293e31f1f922577e64710560bac1587387a4aeec4"
May 21 21:33:48.616439 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:48.616394    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1154b6c8253d7d7080f129293e31f1f922577e64710560bac1587387a4aeec4"} err="failed to get container status \"f1154b6c8253d7d7080f129293e31f1f922577e64710560bac1587387a4aeec4\": rpc error: code = NotFound desc = could not find container \"f1154b6c8253d7d7080f129293e31f1f922577e64710560bac1587387a4aeec4\": container with ID starting with f1154b6c8253d7d7080f129293e31f1f922577e64710560bac1587387a4aeec4 not found: ID does not exist"
May 21 21:33:48.630738 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:48.630703    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5cdcbfbfb6-8rqwk"]
May 21 21:33:48.638661 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:48.638625    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5cdcbfbfb6-8rqwk"]
May 21 21:33:48.807466 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:48.807425    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe64435f-a351-4035-a943-7c50b9e78242" path="/var/lib/kubelet/pods/fe64435f-a351-4035-a943-7c50b9e78242/volumes"
May 21 21:33:49.364460 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:49.364383    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5cdcbfbfb6-nxnzc"]
May 21 21:33:49.365082 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:49.365054    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe64435f-a351-4035-a943-7c50b9e78242" containerName="manager"
May 21 21:33:49.365082 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:49.365076    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe64435f-a351-4035-a943-7c50b9e78242" containerName="manager"
May 21 21:33:49.365249 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:49.365147    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="fe64435f-a351-4035-a943-7c50b9e78242" containerName="manager"
May 21 21:33:49.369561 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:49.369536    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdcbfbfb6-nxnzc"
May 21 21:33:49.372251 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:49.372221    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 21:33:49.373235 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:49.373206    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rz97v\""
May 21 21:33:49.376645 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:49.376617    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cdcbfbfb6-nxnzc"]
May 21 21:33:49.402358 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:49.402314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmnsw\" (UniqueName: \"kubernetes.io/projected/96902507-e73f-4462-b75f-b598609f93b9-kube-api-access-cmnsw\") pod \"maas-controller-5cdcbfbfb6-nxnzc\" (UID: \"96902507-e73f-4462-b75f-b598609f93b9\") " pod="opendatahub/maas-controller-5cdcbfbfb6-nxnzc"
May 21 21:33:49.503328 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:49.503294    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cmnsw\" (UniqueName: \"kubernetes.io/projected/96902507-e73f-4462-b75f-b598609f93b9-kube-api-access-cmnsw\") pod \"maas-controller-5cdcbfbfb6-nxnzc\" (UID: \"96902507-e73f-4462-b75f-b598609f93b9\") " pod="opendatahub/maas-controller-5cdcbfbfb6-nxnzc"
May 21 21:33:49.512888 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:49.512853    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmnsw\" (UniqueName: \"kubernetes.io/projected/96902507-e73f-4462-b75f-b598609f93b9-kube-api-access-cmnsw\") pod \"maas-controller-5cdcbfbfb6-nxnzc\" (UID: \"96902507-e73f-4462-b75f-b598609f93b9\") " pod="opendatahub/maas-controller-5cdcbfbfb6-nxnzc"
May 21 21:33:49.682615 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:49.682511    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5cdcbfbfb6-nxnzc"
May 21 21:33:49.819341 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:49.819309    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5cdcbfbfb6-nxnzc"]
May 21 21:33:49.822520 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:33:49.822493    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96902507_e73f_4462_b75f_b598609f93b9.slice/crio-9d0239ab6995a2ac1c52fc237ca18d353f0839a822b8bf2d517743f1f54b16f5 WatchSource:0}: Error finding container 9d0239ab6995a2ac1c52fc237ca18d353f0839a822b8bf2d517743f1f54b16f5: Status 404 returned error can't find the container with id 9d0239ab6995a2ac1c52fc237ca18d353f0839a822b8bf2d517743f1f54b16f5
May 21 21:33:50.616771 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:50.616735    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdcbfbfb6-nxnzc" event={"ID":"96902507-e73f-4462-b75f-b598609f93b9","Type":"ContainerStarted","Data":"e8d1ac35282ec8537b3804affcb547ddcd134e48f617bf4766fcc773274f3088"}
May 21 21:33:50.616771 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:50.616775    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5cdcbfbfb6-nxnzc" event={"ID":"96902507-e73f-4462-b75f-b598609f93b9","Type":"ContainerStarted","Data":"9d0239ab6995a2ac1c52fc237ca18d353f0839a822b8bf2d517743f1f54b16f5"}
May 21 21:33:50.616997 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:50.616790    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5cdcbfbfb6-nxnzc"
May 21 21:33:50.635586 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:33:50.635537    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5cdcbfbfb6-nxnzc" podStartSLOduration=1.26400771 podStartE2EDuration="1.635520552s" podCreationTimestamp="2026-05-21 21:33:49 +0000 UTC" firstStartedPulling="2026-05-21 21:33:49.823861489 +0000 UTC m=+755.512236792" lastFinishedPulling="2026-05-21 21:33:50.195374326 +0000 UTC m=+755.883749634" observedRunningTime="2026-05-21 21:33:50.632913991 +0000 UTC m=+756.321289314" watchObservedRunningTime="2026-05-21 21:33:50.635520552 +0000 UTC m=+756.323895878"
May 21 21:34:01.627509 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:34:01.627478    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5cdcbfbfb6-nxnzc"
May 21 21:35:14.758662 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:35:14.758629    2576 scope.go:117] "RemoveContainer" containerID="5d6ef1f220415422588b639d07d8cd3be82c377f147b91d5451ccd6a531874f4"
May 21 21:44:05.764481 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:05.764443    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"]
May 21 21:44:05.766701 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:05.764708    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54" podUID="56d1fbf1-61e6-4d71-a20d-876e8e94258f" containerName="manager" containerID="cri-o://26b439da67c953261a2adb46900891269e4ffd67454edc873daf5a9e4b8c1639" gracePeriod=10
May 21 21:44:06.814877 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:06.814848    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"
May 21 21:44:06.938063 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:06.937948    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp2jm\" (UniqueName: \"kubernetes.io/projected/56d1fbf1-61e6-4d71-a20d-876e8e94258f-kube-api-access-jp2jm\") pod \"56d1fbf1-61e6-4d71-a20d-876e8e94258f\" (UID: \"56d1fbf1-61e6-4d71-a20d-876e8e94258f\") "
May 21 21:44:06.938221 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:06.938088    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56d1fbf1-61e6-4d71-a20d-876e8e94258f-extensions-socket-volume\") pod \"56d1fbf1-61e6-4d71-a20d-876e8e94258f\" (UID: \"56d1fbf1-61e6-4d71-a20d-876e8e94258f\") "
May 21 21:44:06.938487 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:06.938464    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56d1fbf1-61e6-4d71-a20d-876e8e94258f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "56d1fbf1-61e6-4d71-a20d-876e8e94258f" (UID: "56d1fbf1-61e6-4d71-a20d-876e8e94258f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 21:44:06.940146 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:06.940123    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56d1fbf1-61e6-4d71-a20d-876e8e94258f-kube-api-access-jp2jm" (OuterVolumeSpecName: "kube-api-access-jp2jm") pod "56d1fbf1-61e6-4d71-a20d-876e8e94258f" (UID: "56d1fbf1-61e6-4d71-a20d-876e8e94258f"). InnerVolumeSpecName "kube-api-access-jp2jm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 21:44:07.013559 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:07.013525    2576 generic.go:358] "Generic (PLEG): container finished" podID="56d1fbf1-61e6-4d71-a20d-876e8e94258f" containerID="26b439da67c953261a2adb46900891269e4ffd67454edc873daf5a9e4b8c1639" exitCode=0
May 21 21:44:07.013713 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:07.013585    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"
May 21 21:44:07.013713 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:07.013611    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54" event={"ID":"56d1fbf1-61e6-4d71-a20d-876e8e94258f","Type":"ContainerDied","Data":"26b439da67c953261a2adb46900891269e4ffd67454edc873daf5a9e4b8c1639"}
May 21 21:44:07.013713 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:07.013653    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54" event={"ID":"56d1fbf1-61e6-4d71-a20d-876e8e94258f","Type":"ContainerDied","Data":"0d910dd3a3dfc1d6dfe87687178309045f2a31a27b3a0ded8dea7573f0739b45"}
May 21 21:44:07.013713 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:07.013672    2576 scope.go:117] "RemoveContainer" containerID="26b439da67c953261a2adb46900891269e4ffd67454edc873daf5a9e4b8c1639"
May 21 21:44:07.023179 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:07.023162    2576 scope.go:117] "RemoveContainer" containerID="26b439da67c953261a2adb46900891269e4ffd67454edc873daf5a9e4b8c1639"
May 21 21:44:07.023429 ip-10-0-135-166 kubenswrapper[2576]: E0521 21:44:07.023409    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26b439da67c953261a2adb46900891269e4ffd67454edc873daf5a9e4b8c1639\": container with ID starting with 26b439da67c953261a2adb46900891269e4ffd67454edc873daf5a9e4b8c1639 not found: ID does not exist" containerID="26b439da67c953261a2adb46900891269e4ffd67454edc873daf5a9e4b8c1639"
May 21 21:44:07.023494 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:07.023442    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26b439da67c953261a2adb46900891269e4ffd67454edc873daf5a9e4b8c1639"} err="failed to get container status \"26b439da67c953261a2adb46900891269e4ffd67454edc873daf5a9e4b8c1639\": rpc error: code = NotFound desc = could not find container \"26b439da67c953261a2adb46900891269e4ffd67454edc873daf5a9e4b8c1639\": container with ID starting with 26b439da67c953261a2adb46900891269e4ffd67454edc873daf5a9e4b8c1639 not found: ID does not exist"
May 21 21:44:07.035819 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:07.035795    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"]
May 21 21:44:07.039107 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:07.039080    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56d1fbf1-61e6-4d71-a20d-876e8e94258f-extensions-socket-volume\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:44:07.039107 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:07.039103    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp2jm\" (UniqueName: \"kubernetes.io/projected/56d1fbf1-61e6-4d71-a20d-876e8e94258f-kube-api-access-jp2jm\") on node \"ip-10-0-135-166.ec2.internal\" DevicePath \"\""
May 21 21:44:07.040224 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:07.040206    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-q4p54"]
May 21 21:44:08.807088 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:44:08.807051    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56d1fbf1-61e6-4d71-a20d-876e8e94258f" path="/var/lib/kubelet/pods/56d1fbf1-61e6-4d71-a20d-876e8e94258f/volumes"
May 21 21:45:11.850701 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:11.850660    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m"]
May 21 21:45:11.851305 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:11.851016    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56d1fbf1-61e6-4d71-a20d-876e8e94258f" containerName="manager"
May 21 21:45:11.851305 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:11.851029    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="56d1fbf1-61e6-4d71-a20d-876e8e94258f" containerName="manager"
May 21 21:45:11.851305 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:11.851125    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="56d1fbf1-61e6-4d71-a20d-876e8e94258f" containerName="manager"
May 21 21:45:11.855793 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:11.855770    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m"
May 21 21:45:11.858875 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:11.858852    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lzdrl\""
May 21 21:45:11.866347 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:11.866319    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m"]
May 21 21:45:11.994649 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:11.994599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ca9852-ba12-4a8a-a074-b1cd406db51b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nqh6m\" (UID: \"56ca9852-ba12-4a8a-a074-b1cd406db51b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m"
May 21 21:45:11.994840 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:11.994677    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mgpx\" (UniqueName: \"kubernetes.io/projected/56ca9852-ba12-4a8a-a074-b1cd406db51b-kube-api-access-8mgpx\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nqh6m\" (UID: \"56ca9852-ba12-4a8a-a074-b1cd406db51b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m"
May 21 21:45:12.096106 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:12.096063    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ca9852-ba12-4a8a-a074-b1cd406db51b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nqh6m\" (UID: \"56ca9852-ba12-4a8a-a074-b1cd406db51b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m"
May 21 21:45:12.096281 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:12.096124    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mgpx\" (UniqueName: \"kubernetes.io/projected/56ca9852-ba12-4a8a-a074-b1cd406db51b-kube-api-access-8mgpx\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nqh6m\" (UID: \"56ca9852-ba12-4a8a-a074-b1cd406db51b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m"
May 21 21:45:12.096493 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:12.096472    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ca9852-ba12-4a8a-a074-b1cd406db51b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nqh6m\" (UID: \"56ca9852-ba12-4a8a-a074-b1cd406db51b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m"
May 21 21:45:12.110631 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:12.110565    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mgpx\" (UniqueName: \"kubernetes.io/projected/56ca9852-ba12-4a8a-a074-b1cd406db51b-kube-api-access-8mgpx\") pod \"kuadrant-operator-controller-manager-55c7f4c975-nqh6m\" (UID: \"56ca9852-ba12-4a8a-a074-b1cd406db51b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m"
May 21 21:45:12.166930 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:12.166876    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m"
May 21 21:45:12.322046 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:12.322019    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m"]
May 21 21:45:12.324188 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:45:12.324158    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ca9852_ba12_4a8a_a074_b1cd406db51b.slice/crio-9af5852faba1baea018c252b8d7a9ba614b8b03dcf41b2a39fa09456eeedd2e6 WatchSource:0}: Error finding container 9af5852faba1baea018c252b8d7a9ba614b8b03dcf41b2a39fa09456eeedd2e6: Status 404 returned error can't find the container with id 9af5852faba1baea018c252b8d7a9ba614b8b03dcf41b2a39fa09456eeedd2e6
May 21 21:45:12.327028 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:12.327007    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 21:45:13.284225 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:13.284185    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m" event={"ID":"56ca9852-ba12-4a8a-a074-b1cd406db51b","Type":"ContainerStarted","Data":"8ab61c6f3d0f5c8bee1a9894a70bc437fdd542ea298cbd3ff7fa995ab1d4971d"}
May 21 21:45:13.284225 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:13.284227    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m" event={"ID":"56ca9852-ba12-4a8a-a074-b1cd406db51b","Type":"ContainerStarted","Data":"9af5852faba1baea018c252b8d7a9ba614b8b03dcf41b2a39fa09456eeedd2e6"}
May 21 21:45:13.284750 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:13.284270    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m"
May 21 21:45:13.304115 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:13.304047    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m" podStartSLOduration=2.304027464 podStartE2EDuration="2.304027464s" podCreationTimestamp="2026-05-21 21:45:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:45:13.30275106 +0000 UTC m=+1438.991126382" watchObservedRunningTime="2026-05-21 21:45:13.304027464 +0000 UTC m=+1438.992402786"
May 21 21:45:24.291526 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:45:24.291492    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-nqh6m"
May 21 21:55:01.904662 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:01.904633    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-7r67b_7c64c3fc-7aa9-4694-9a52-16ab60693020/manager/0.log"
May 21 21:55:02.015773 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:02.015741    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-859d7b7bc-z585s_b4878087-9d17-4fde-a576-7516402c186a/maas-api/0.log"
May 21 21:55:02.128937 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:02.128906    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cdcbfbfb6-nxnzc_96902507-e73f-4462-b75f-b598609f93b9/manager/0.log"
May 21 21:55:02.246034 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:02.245922    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-tlvg8_fc03edfe-7068-4195-95f8-400d668f6169/manager/2.log"
May 21 21:55:02.472230 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:02.472197    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79646d69f8-q2wg4_65845bff-99c6-42a0-bc0c-be602df9b59c/manager/0.log"
May 21 21:55:03.443191 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:03.443156    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x_d66f8106-fcbf-4680-9753-980b150a1b0e/util/0.log"
May 21 21:55:03.450477 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:03.450453    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x_d66f8106-fcbf-4680-9753-980b150a1b0e/pull/0.log"
May 21 21:55:03.456633 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:03.456610    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x_d66f8106-fcbf-4680-9753-980b150a1b0e/extract/0.log"
May 21 21:55:03.560755 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:03.560725    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7_fb14506e-4b93-4a0d-b931-c1b17f0e8a3a/util/0.log"
May 21 21:55:03.566496 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:03.566470    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7_fb14506e-4b93-4a0d-b931-c1b17f0e8a3a/pull/0.log"
May 21 21:55:03.572302 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:03.572276    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7_fb14506e-4b93-4a0d-b931-c1b17f0e8a3a/extract/0.log"
May 21 21:55:03.681822 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:03.681793    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg_5807ab5e-6469-48e8-a123-3d91889cb5fd/util/0.log"
May 21 21:55:03.688456 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:03.688428    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg_5807ab5e-6469-48e8-a123-3d91889cb5fd/pull/0.log"
May 21 21:55:03.695079 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:03.695014    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg_5807ab5e-6469-48e8-a123-3d91889cb5fd/extract/0.log"
May 21 21:55:03.802464 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:03.802438    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh_147274ae-dca4-4084-bb26-d2d0e2e722a7/util/0.log"
May 21 21:55:03.809629 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:03.809602    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh_147274ae-dca4-4084-bb26-d2d0e2e722a7/pull/0.log"
May 21 21:55:03.817231 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:03.817207    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh_147274ae-dca4-4084-bb26-d2d0e2e722a7/extract/0.log"
May 21 21:55:04.041007 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:04.040945    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-26gcf_1427290c-e2b0-4d95-88ac-838073feacd2/manager/0.log"
May 21 21:55:04.490764 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:04.490683    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-nqh6m_56ca9852-ba12-4a8a-a074-b1cd406db51b/manager/0.log"
May 21 21:55:05.172505 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:05.172472    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-lspb6_285af562-70a3-44ec-9a64-1ff3bc80a58f/discovery/0.log"
May 21 21:55:05.386037 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:05.386009    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8bb597df6-dvsj6_4e343953-5321-49fd-a659-4cd684761421/kube-auth-proxy/0.log"
May 21 21:55:05.609911 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:05.609875    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-bph74_07c62045-9ac0-46db-8ff0-341f436cd1af/payload-processing/0.log"
May 21 21:55:06.166407 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:06.166376    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx_bd7ec588-4d28-437a-ab98-aca87dc90fb4/storage-initializer/0.log"
May 21 21:55:06.173746 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:06.173726    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-kqjnx_bd7ec588-4d28-437a-ab98-aca87dc90fb4/main/0.log"
May 21 21:55:06.398410 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:06.398380    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74_b8c3cff5-61a9-48f5-a9c7-84681b0da829/storage-initializer/0.log"
May 21 21:55:06.406176 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:06.406151    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcckvg74_b8c3cff5-61a9-48f5-a9c7-84681b0da829/main/0.log"
May 21 21:55:12.876087 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:12.876053    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z2fpm_c17c1b66-c3b4-4a15-be33-d8febf18700d/global-pull-secret-syncer/0.log"
May 21 21:55:13.122388 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:13.122358    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-r6zvj_186342af-27e9-4ba1-b631-3bbc2d944659/konnectivity-agent/0.log"
May 21 21:55:13.185487 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:13.185407    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-166.ec2.internal_fe6111d74f5d482969b74b3d8e3e3529/haproxy/0.log"
May 21 21:55:16.354472 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:16.354436    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x_d66f8106-fcbf-4680-9753-980b150a1b0e/extract/0.log"
May 21 21:55:16.384645 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:16.384611    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x_d66f8106-fcbf-4680-9753-980b150a1b0e/util/0.log"
May 21 21:55:16.413067 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:16.413036    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759qt47x_d66f8106-fcbf-4680-9753-980b150a1b0e/pull/0.log"
May 21 21:55:16.444436 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:16.444406    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7_fb14506e-4b93-4a0d-b931-c1b17f0e8a3a/extract/0.log"
May 21 21:55:16.464515 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:16.464486    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7_fb14506e-4b93-4a0d-b931-c1b17f0e8a3a/util/0.log"
May 21 21:55:16.492353 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:16.492310    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cmfv7_fb14506e-4b93-4a0d-b931-c1b17f0e8a3a/pull/0.log"
May 21 21:55:16.522058 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:16.522025    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg_5807ab5e-6469-48e8-a123-3d91889cb5fd/extract/0.log"
May 21 21:55:16.549063 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:16.549034    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg_5807ab5e-6469-48e8-a123-3d91889cb5fd/util/0.log"
May 21 21:55:16.569473 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:16.569427    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73gt5wg_5807ab5e-6469-48e8-a123-3d91889cb5fd/pull/0.log"
May 21 21:55:16.595791 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:16.595757    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh_147274ae-dca4-4084-bb26-d2d0e2e722a7/extract/0.log"
May 21 21:55:16.620552 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:16.620454    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh_147274ae-dca4-4084-bb26-d2d0e2e722a7/util/0.log"
May 21 21:55:16.646128 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:16.646101    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef12lbmh_147274ae-dca4-4084-bb26-d2d0e2e722a7/pull/0.log"
May 21 21:55:16.939311 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:16.939214    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-26gcf_1427290c-e2b0-4d95-88ac-838073feacd2/manager/0.log"
May 21 21:55:17.147173 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:17.147135    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-nqh6m_56ca9852-ba12-4a8a-a074-b1cd406db51b/manager/0.log"
May 21 21:55:19.052010 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:19.051953    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-6rrsj_e58c47e6-e31d-479a-887f-0ac09a4f296a/kube-state-metrics/0.log"
May 21 21:55:19.078355 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:19.078298    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-6rrsj_e58c47e6-e31d-479a-887f-0ac09a4f296a/kube-rbac-proxy-main/0.log"
May 21 21:55:19.106767 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:19.106720    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-6rrsj_e58c47e6-e31d-479a-887f-0ac09a4f296a/kube-rbac-proxy-self/0.log"
May 21 21:55:19.355659 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:19.355565    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b7tdj_5f5d86a3-efd0-4ab7-860f-a9bfd78b974f/node-exporter/0.log"
May 21 21:55:19.379395 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:19.379369    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b7tdj_5f5d86a3-efd0-4ab7-860f-a9bfd78b974f/kube-rbac-proxy/0.log"
May 21 21:55:19.400858 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:19.400832    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b7tdj_5f5d86a3-efd0-4ab7-860f-a9bfd78b974f/init-textfile/0.log"
May 21 21:55:21.569836 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.569802    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"]
May 21 21:55:21.573640 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.573614    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.575799 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.575773    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zzm8x\"/\"default-dockercfg-jrd2s\""
May 21 21:55:21.575940 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.575874    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zzm8x\"/\"openshift-service-ca.crt\""
May 21 21:55:21.576768 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.576750    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zzm8x\"/\"kube-root-ca.crt\""
May 21 21:55:21.580729 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.580689    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"]
May 21 21:55:21.699808 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.699753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de505165-304e-4cc4-a195-94299637746c-proc\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.699808 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.699813    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgd2v\" (UniqueName: \"kubernetes.io/projected/de505165-304e-4cc4-a195-94299637746c-kube-api-access-cgd2v\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.700069 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.699893    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de505165-304e-4cc4-a195-94299637746c-podres\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.700069 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.699925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de505165-304e-4cc4-a195-94299637746c-sys\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.700069 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.699959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de505165-304e-4cc4-a195-94299637746c-lib-modules\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.800894 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.800850    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de505165-304e-4cc4-a195-94299637746c-proc\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.801086 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.800910    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cgd2v\" (UniqueName: \"kubernetes.io/projected/de505165-304e-4cc4-a195-94299637746c-kube-api-access-cgd2v\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.801086 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.800940    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de505165-304e-4cc4-a195-94299637746c-podres\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.801086 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.800959    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de505165-304e-4cc4-a195-94299637746c-sys\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.801086 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.800990    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de505165-304e-4cc4-a195-94299637746c-proc\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.801086 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.801001    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de505165-304e-4cc4-a195-94299637746c-lib-modules\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.801086 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.801078    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de505165-304e-4cc4-a195-94299637746c-sys\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.801293 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.801128    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de505165-304e-4cc4-a195-94299637746c-lib-modules\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.801293 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.801129    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de505165-304e-4cc4-a195-94299637746c-podres\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.809366 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.809334    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgd2v\" (UniqueName: \"kubernetes.io/projected/de505165-304e-4cc4-a195-94299637746c-kube-api-access-cgd2v\") pod \"perf-node-gather-daemonset-s66cd\" (UID: \"de505165-304e-4cc4-a195-94299637746c\") " pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:21.885589 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:21.885493    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:22.024505 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:22.024352    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"]
May 21 21:55:22.027451 ip-10-0-135-166 kubenswrapper[2576]: W0521 21:55:22.027417    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podde505165_304e_4cc4_a195_94299637746c.slice/crio-17b512ee9ec590bc02691b51bb3df8cc05670e36060b4183c52f1689be837c81 WatchSource:0}: Error finding container 17b512ee9ec590bc02691b51bb3df8cc05670e36060b4183c52f1689be837c81: Status 404 returned error can't find the container with id 17b512ee9ec590bc02691b51bb3df8cc05670e36060b4183c52f1689be837c81
May 21 21:55:22.029248 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:22.029229    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 21:55:22.139021 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:22.138914    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7cbc856f4-kbn9s_a0db08a9-4c88-4db9-996e-6902d587deb4/console/0.log"
May 21 21:55:22.665338 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:22.665297    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd" event={"ID":"de505165-304e-4cc4-a195-94299637746c","Type":"ContainerStarted","Data":"5709e2f2d0641ba88bcfbff2d3b38f9e070c9f29aad4bc7db7443743d2988d2e"}
May 21 21:55:22.665338 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:22.665342    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd" event={"ID":"de505165-304e-4cc4-a195-94299637746c","Type":"ContainerStarted","Data":"17b512ee9ec590bc02691b51bb3df8cc05670e36060b4183c52f1689be837c81"}
May 21 21:55:22.665835 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:22.665374    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:22.684047 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:22.683975    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd" podStartSLOduration=1.6839606790000001 podStartE2EDuration="1.683960679s" podCreationTimestamp="2026-05-21 21:55:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 21:55:22.681781829 +0000 UTC m=+2048.370157151" watchObservedRunningTime="2026-05-21 21:55:22.683960679 +0000 UTC m=+2048.372335999"
May 21 21:55:23.579946 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:23.579912    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2wxsq_9354592a-23e0-44c3-a67c-64cf57490f9e/dns/0.log"
May 21 21:55:23.600512 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:23.600484    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2wxsq_9354592a-23e0-44c3-a67c-64cf57490f9e/kube-rbac-proxy/0.log"
May 21 21:55:23.686348 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:23.686319    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k7cdj_abd86fab-2669-4fe7-b5f0-25d4b3311ca1/dns-node-resolver/0.log"
May 21 21:55:24.205415 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:24.205385    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4m8zj_8959993d-94c0-4577-a84b-345a567afd85/node-ca/0.log"
May 21 21:55:25.183650 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:25.183617    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-lspb6_285af562-70a3-44ec-9a64-1ff3bc80a58f/discovery/0.log"
May 21 21:55:25.228174 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:25.228140    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8bb597df6-dvsj6_4e343953-5321-49fd-a659-4cd684761421/kube-auth-proxy/0.log"
May 21 21:55:25.341889 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:25.341856    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-bph74_07c62045-9ac0-46db-8ff0-341f436cd1af/payload-processing/0.log"
May 21 21:55:25.932933 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:25.932903    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xff2c_f976c3bf-c462-4143-afdf-d41bb38742e5/serve-healthcheck-canary/0.log"
May 21 21:55:26.542995 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:26.542964    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s7z78_4a972374-4882-4306-835c-5879be26a155/kube-rbac-proxy/0.log"
May 21 21:55:26.563375 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:26.563351    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s7z78_4a972374-4882-4306-835c-5879be26a155/exporter/0.log"
May 21 21:55:26.583559 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:26.583530    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s7z78_4a972374-4882-4306-835c-5879be26a155/extractor/0.log"
May 21 21:55:28.430685 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:28.430648    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-7r67b_7c64c3fc-7aa9-4694-9a52-16ab60693020/manager/0.log"
May 21 21:55:28.468643 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:28.468609    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-859d7b7bc-z585s_b4878087-9d17-4fde-a576-7516402c186a/maas-api/0.log"
May 21 21:55:28.531102 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:28.531067    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5cdcbfbfb6-nxnzc_96902507-e73f-4462-b75f-b598609f93b9/manager/0.log"
May 21 21:55:28.552397 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:28.552372    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-tlvg8_fc03edfe-7068-4195-95f8-400d668f6169/manager/1.log"
May 21 21:55:28.563101 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:28.563078    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-tlvg8_fc03edfe-7068-4195-95f8-400d668f6169/manager/2.log"
May 21 21:55:28.611369 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:28.611342    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79646d69f8-q2wg4_65845bff-99c6-42a0-bc0c-be602df9b59c/manager/0.log"
May 21 21:55:28.678031 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:28.678007    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zzm8x/perf-node-gather-daemonset-s66cd"
May 21 21:55:36.119346 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:36.119275    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xclmm_d10c924d-f6bc-4673-94e7-ea20e5b2d1e4/kube-multus-additional-cni-plugins/0.log"
May 21 21:55:36.142128 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:36.142098    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xclmm_d10c924d-f6bc-4673-94e7-ea20e5b2d1e4/egress-router-binary-copy/0.log"
May 21 21:55:36.163305 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:36.163275    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xclmm_d10c924d-f6bc-4673-94e7-ea20e5b2d1e4/cni-plugins/0.log"
May 21 21:55:36.182879 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:36.182844    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xclmm_d10c924d-f6bc-4673-94e7-ea20e5b2d1e4/bond-cni-plugin/0.log"
May 21 21:55:36.207881 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:36.207854    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xclmm_d10c924d-f6bc-4673-94e7-ea20e5b2d1e4/routeoverride-cni/0.log"
May 21 21:55:36.229052 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:36.229029    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xclmm_d10c924d-f6bc-4673-94e7-ea20e5b2d1e4/whereabouts-cni-bincopy/0.log"
May 21 21:55:36.247774 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:36.247754    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xclmm_d10c924d-f6bc-4673-94e7-ea20e5b2d1e4/whereabouts-cni/0.log"
May 21 21:55:36.332534 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:36.332504    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lx2l5_ed2b98d3-2df0-46ce-b5a2-d9ff5f834719/kube-multus/0.log"
May 21 21:55:36.448218 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:36.448135    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-scfdw_9f8199a0-fb92-4453-82c2-a9613c455612/network-metrics-daemon/0.log"
May 21 21:55:36.467449 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:36.467424    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-scfdw_9f8199a0-fb92-4453-82c2-a9613c455612/kube-rbac-proxy/0.log"
May 21 21:55:37.883520 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:37.883098    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2klb_0ee54fa9-ffda-46f3-a939-ea782030cb96/ovn-controller/0.log"
May 21 21:55:37.908320 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:37.908291    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2klb_0ee54fa9-ffda-46f3-a939-ea782030cb96/ovn-acl-logging/0.log"
May 21 21:55:37.926747 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:37.926716    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2klb_0ee54fa9-ffda-46f3-a939-ea782030cb96/kube-rbac-proxy-node/0.log"
May 21 21:55:37.946831 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:37.946796    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2klb_0ee54fa9-ffda-46f3-a939-ea782030cb96/kube-rbac-proxy-ovn-metrics/0.log"
May 21 21:55:37.964140 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:37.964112    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2klb_0ee54fa9-ffda-46f3-a939-ea782030cb96/northd/0.log"
May 21 21:55:37.983613 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:37.983582    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2klb_0ee54fa9-ffda-46f3-a939-ea782030cb96/nbdb/0.log"
May 21 21:55:38.008266 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:38.008239    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2klb_0ee54fa9-ffda-46f3-a939-ea782030cb96/sbdb/0.log"
May 21 21:55:38.110463 ip-10-0-135-166 kubenswrapper[2576]: I0521 21:55:38.110429    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2klb_0ee54fa9-ffda-46f3-a939-ea782030cb96/ovnkube-controller/0.log"