Jun 03 01:37:20.720956 ip-10-0-128-28 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 03 01:37:20.720965 ip-10-0-128-28 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 03 01:37:20.720972 ip-10-0-128-28 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 03 01:37:20.721204 ip-10-0-128-28 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 03 01:37:30.926575 ip-10-0-128-28 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 03 01:37:30.926593 ip-10-0-128-28 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 9aaca1b4b47e4a07a74280ac7b4a4467 --
Jun 03 01:39:53.823730 ip-10-0-128-28 systemd[1]: Starting Kubernetes Kubelet...
Jun 03 01:39:54.232538 ip-10-0-128-28 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 01:39:54.232538 ip-10-0-128-28 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 03 01:39:54.232538 ip-10-0-128-28 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 01:39:54.232538 ip-10-0-128-28 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 03 01:39:54.232538 ip-10-0-128-28 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 01:39:54.234595 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.234508    2575 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 03 01:39:54.238796 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238782    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 01:39:54.238796 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238796    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238800    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238804    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238807    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238810    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238813    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238816    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238819    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238821    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238824    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238827    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238834    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238837    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238840    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238842    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238845    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238847    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238850    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238853    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238855    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 01:39:54.238859 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238858    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238861    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238864    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238866    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238869    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238872    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238875    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238877    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238879    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238882    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238886    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238889    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238892    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238895    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238898    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238900    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238903    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238905    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238908    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 01:39:54.239326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238910    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238913    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238916    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238918    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238920    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238923    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238926    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238928    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238932    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238936    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238939    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238943    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238946    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238948    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238951    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238955    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238958    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238960    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238963    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 01:39:54.239860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238965    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238968    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238970    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238973    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238975    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238978    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238980    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238983    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238985    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238988    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238991    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238993    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238996    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.238998    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239000    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239003    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239005    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239008    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239010    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239012    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 01:39:54.240313 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239015    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239017    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239019    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239022    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239024    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239027    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239029    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239429    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239435    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239439    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239443    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239446    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239449    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239452    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239454    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239457    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239459    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239462    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239464    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239482    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 01:39:54.240813 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239484    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239488    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239491    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239494    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239496    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239498    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239501    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239503    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239506    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239508    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239511    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239513    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239516    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239518    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239521    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239523    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239526    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239528    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239531    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239534    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 01:39:54.241286 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239538    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239540    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239543    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239545    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239548    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239550    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239553    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239555    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239558    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239560    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239564    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239567    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239570    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239572    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239575    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239578    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239580    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239582    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239585    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239587    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 01:39:54.241781 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239590    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239592    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239594    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239597    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239599    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239605    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239608    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239610    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239613    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239615    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239617    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239620    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239623    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239626    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239628    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239631    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239633    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239636    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239638    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 01:39:54.242267 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239641    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239643    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239646    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239648    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239652    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239654    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239657    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239659    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239662    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239664    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239667    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239669    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239672    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.239674    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240867    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240876    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240884    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240888    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240893    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240896    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240901    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 03 01:39:54.242776 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240905    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240908    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240911    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240914    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240918    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240921    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240924    2575 flags.go:64] FLAG: --cgroup-root=""
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240927    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240929    2575 flags.go:64] FLAG: --client-ca-file=""
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240932    2575 flags.go:64] FLAG: --cloud-config=""
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240935    2575 flags.go:64] FLAG: --cloud-provider="external"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240937    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240942    2575 flags.go:64] FLAG: --cluster-domain=""
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240945    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240948    2575 flags.go:64] FLAG: --config-dir=""
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240950    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240953    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240957    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240960    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240963    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240967    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240970    2575 flags.go:64] FLAG: --contention-profiling="false"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240973    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240976    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240979    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 03 01:39:54.243276 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240982    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240986    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240988    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240991    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240994    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.240998    2575 flags.go:64] FLAG: --enable-server="true"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241001    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241006    2575 flags.go:64] FLAG: --event-burst="100"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241009    2575 flags.go:64] FLAG: --event-qps="50"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241011    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241014    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241018    2575 flags.go:64] FLAG: --eviction-hard=""
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241022    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241024    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241027    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241030    2575 flags.go:64] FLAG: --eviction-soft=""
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241033    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241036    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241038    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241041    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241044    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241046    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241049    2575 flags.go:64] FLAG: --feature-gates=""
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241053    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241056    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 03 01:39:54.243905 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241059    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241062    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241065    2575 flags.go:64] FLAG: --healthz-port="10248"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241068    2575 flags.go:64] FLAG: --help="false"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241071    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241074    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241077    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241080    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241083    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241086    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241089    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241092    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241095    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241098    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241101    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241103    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241106    2575 flags.go:64] FLAG: --kube-reserved=""
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241109    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241112    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241115    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241118    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241121    2575 flags.go:64] FLAG: --lock-file=""
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241124    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241127    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 03 01:39:54.244517 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241129    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241134    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241137    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241140    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241143    2575 flags.go:64] FLAG: --logging-format="text"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241145    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241148    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241151    2575 flags.go:64] FLAG: --manifest-url=""
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241154    2575 flags.go:64] FLAG: --manifest-url-header=""
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241158    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241161    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241165    2575 flags.go:64] FLAG: --max-pods="110"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241168    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241171    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241174    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241177    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241180    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241183    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241185    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241193    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241196    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241199    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241202    2575 flags.go:64] FLAG: --pod-cidr=""
Jun 03 01:39:54.245104 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241204    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241210    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241213    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241216    2575 flags.go:64] FLAG: --pods-per-core="0"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241220    2575 flags.go:64] FLAG: --port="10250"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241223    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241226    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-030786f4506378407"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241229    2575 flags.go:64] FLAG: --qos-reserved=""
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241232    2575 flags.go:64] FLAG: --read-only-port="10255"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241235    2575 flags.go:64] FLAG: --register-node="true"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241237    2575 flags.go:64] FLAG: --register-schedulable="true"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241240    2575 flags.go:64] FLAG: --register-with-taints=""
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241244    2575 flags.go:64] FLAG: --registry-burst="10"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241247    2575 flags.go:64] FLAG: --registry-qps="5"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241250    2575 flags.go:64] FLAG: --reserved-cpus=""
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241252    2575 flags.go:64] FLAG: --reserved-memory=""
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241256    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241259    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241262    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241265    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241267    2575 flags.go:64] FLAG: --runonce="false"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241270    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241274    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241277    2575 flags.go:64] FLAG: --seccomp-default="false"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241281    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241284    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 03 01:39:54.245667 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241287    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241290    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241293    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241296    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241299    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241302    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241305    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241308    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241311    2575 flags.go:64] FLAG: --system-cgroups=""
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241314    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241319    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241322    2575 flags.go:64] FLAG: --tls-cert-file=""
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241324    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241328    2575 flags.go:64] FLAG: --tls-min-version=""
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241331    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241334    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241337    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241339    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241351    2575 flags.go:64] FLAG: --v="2"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241356    2575 flags.go:64] FLAG: --version="false"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241360    2575 flags.go:64] FLAG: --vmodule=""
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241365    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.241368    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241498    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 01:39:54.246283 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241504    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241507    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241510    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241512    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241515    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241518    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241523    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241526    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241528    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241531    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241533    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241536    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241538    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241541    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241544    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241546    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241548    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241551    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241554    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241558    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 01:39:54.246867 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241561    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241564    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241567    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241569    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241572    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241575    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241577    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241580    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241582    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241585    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241587    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241591    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241595    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241598    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241600    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241603    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241606    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241608    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241613    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241616    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 01:39:54.247411 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241619    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241621    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241624    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241626    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241629    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241633    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241635    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241638    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241640    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241643    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241645    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241648    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241650    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241653    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241655    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241658    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241660    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241662    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241665    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241667    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 01:39:54.247932 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241670    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241672    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241675    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241678    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241680    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241682    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241685    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241687    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241690    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241692    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241696    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241699    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241702    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241704    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241707    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241709    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241712    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241715    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241718    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 01:39:54.248423 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241720    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241723    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241725    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241728    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241730    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.241733    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.242407    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.248728    2575 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.248744    2575 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248792    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248797    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248801    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248804    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248807    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248809    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 01:39:54.248917 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248812    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248815    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248817    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248820    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248822    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248825    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248827    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248830    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248832    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248835    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248837    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248840    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248843    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248845    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248848    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248850    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248853    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248856    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248858    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248861    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 01:39:54.249288 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248863    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248865    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248868    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248870    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248873    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248877    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248879    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248882    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248884    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248886    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248889    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248891    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248893    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248896    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248898    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248900    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248903    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248905    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248907    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248910    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 01:39:54.249874 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248912    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248915    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248917    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248920    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248923    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248926    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248928    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248931    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248934    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248937    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248939    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248942    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248944    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248946    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248949    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248951    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248954    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248957    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248960    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248962    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 01:39:54.250362 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248965    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248967    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248970    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248972    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248975    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248978    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248980    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248983    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248985    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248988    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248990    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248993    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.248996    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249001    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249004    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249006    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249009    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249012    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249016    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 01:39:54.250901 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249019    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.249025    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249134    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249139    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249142    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249145    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249148    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249151    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249154    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249159    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249162    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249164    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249168    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249170    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249173    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 01:39:54.251363 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249175    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249178    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249180    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249183    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249186    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249189    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249191    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249194    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249196    2575 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249199    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249201    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249204    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249206    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249208    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249211    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249213    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249216    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249218    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249220    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249223    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 01:39:54.251752 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249225    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249228    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249230    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249232    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249235    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249239    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249242    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249245    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249248    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249250    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249254    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249256    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249259    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249262    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249264    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249267    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249269    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249272    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249274    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 01:39:54.252321 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249277    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249279    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249281    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249284    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249286    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249288    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249291    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249293    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249296    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249299    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249301    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249303    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249306    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249308    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249310    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249313    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249315    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249318    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249320    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249323    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 01:39:54.252811 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249325    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249327    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249330    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249332    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249335    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249337    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249339    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249342    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249345    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249347    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249349    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249352    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249354    2575 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:54.249356    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.249361    2575 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 01:39:54.253302 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.249461    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 03 01:39:54.253693 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.251919    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 03 01:39:54.253693 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.252860    2575 server.go:1019] "Starting client certificate rotation"
Jun 03 01:39:54.253693 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.252965    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 01:39:54.253693 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.253374    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 01:39:54.277261 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.277238    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 01:39:54.282812 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.282784    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 01:39:54.295499 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.295458    2575 log.go:25] "Validated CRI v1 runtime API"
Jun 03 01:39:54.301203 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.301189    2575 log.go:25] "Validated CRI v1 image API"
Jun 03 01:39:54.302583 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.302567    2575 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 03 01:39:54.306812 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.306778    2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a5169dd4-9c30-464e-bc29-b4c07c7f3234:/dev/nvme0n1p4 f68e1b69-5dff-4690-9cc9-2dc295a99696:/dev/nvme0n1p3]
Jun 03 01:39:54.306812 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.306805    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 03 01:39:54.308422 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.308406    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 01:39:54.311452 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.311345    2575 manager.go:217] Machine: {Timestamp:2026-06-03 01:39:54.310863905 +0000 UTC m=+0.377454495 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105966 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ba304a21ffa5289a2a36ecec47a2d SystemUUID:ec2ba304-a21f-fa52-89a2-a36ecec47a2d BootID:9aaca1b4-b47e-4a07-a742-80ac7b4a4467 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6e:e0:15:a2:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6e:e0:15:a2:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:41:b7:55:31:49 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 03 01:39:54.312174 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.312163    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 03 01:39:54.312266 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.312248    2575 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 03 01:39:54.313875 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.313851    2575 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 03 01:39:54.314018 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.313877    2575 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-28.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 03 01:39:54.314061 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.314028    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jun 03 01:39:54.314061 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.314036    2575 container_manager_linux.go:306] "Creating device plugin manager"
Jun 03 01:39:54.314061 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.314044    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 01:39:54.315515 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.315504    2575 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 01:39:54.316270 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.316261    2575 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 01:39:54.316380 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.316371    2575 server.go:1267] "Using root directory" path="/var/lib/kubelet"
Jun 03 01:39:54.318634 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.318625    2575 kubelet.go:491] "Attempting to sync node with API server"
Jun 03 01:39:54.318673 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.318638    2575 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 03 01:39:54.318673 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.318649    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 03 01:39:54.318673 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.318657    2575 kubelet.go:397] "Adding apiserver pod source"
Jun 03 01:39:54.318673 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.318664    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 03 01:39:54.319741 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.319729    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 01:39:54.322238 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.319747    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 01:39:54.322896 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.322877    2575 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
Jun 03 01:39:54.324759 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.324747    2575 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 03 01:39:54.327145 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.327131    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 03 01:39:54.327231 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.327224    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 03 01:39:54.327292 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.327285    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 03 01:39:54.327343 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.327338    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 03 01:39:54.327392 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.327387    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 03 01:39:54.327439 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.327434    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 03 01:39:54.327501 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.327495    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 03 01:39:54.327550 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.327544    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 03 01:39:54.327665 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.327649    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 03 01:39:54.327665 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.327662    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 03 01:39:54.327787 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.327672    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 03 01:39:54.327787 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.327679    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 03 01:39:54.328589 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.328579    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 03 01:39:54.328589 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.328589    2575 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 03 01:39:54.330420 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.330391    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 03 01:39:54.330541 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.330523    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 03 01:39:54.332044 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.332030    2575 watchdog_linux.go:99] "Systemd watchdog is not enabled"
Jun 03 01:39:54.332117 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.332108    2575 server.go:1295] "Started kubelet"
Jun 03 01:39:54.332181 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.332156    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 03 01:39:54.332265 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.332214    2575 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 03 01:39:54.332312 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.332287    2575 server_v1.go:47] "podresources" method="list" useActivePods=true
Jun 03 01:39:54.332844 ip-10-0-128-28 systemd[1]: Started Kubernetes Kubelet.
Jun 03 01:39:54.333581 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.333568    2575 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 03 01:39:54.333952 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.333934    2575 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-28.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 03 01:39:54.334187 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.334175    2575 server.go:317] "Adding debug handlers to kubelet server"
Jun 03 01:39:54.337091 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.337057    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 03 01:39:54.337570 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.337554    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 03 01:39:54.337746 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.337730    2575 volume_manager.go:295] "The desired_state_of_world populator starts"
Jun 03 01:39:54.337746 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.337746    2575 volume_manager.go:297] "Starting Kubelet Volume Manager"
Jun 03 01:39:54.337897 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.337886    2575 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
Jun 03 01:39:54.337957 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.337950    2575 reconstruct.go:97] "Volume reconstruction finished"
Jun 03 01:39:54.338005 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.337958    2575 reconciler.go:26] "Reconciler: start to sync state"
Jun 03 01:39:54.338961 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.338942    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:54.341953 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.341937    2575 factory.go:153] Registering CRI-O factory
Jun 03 01:39:54.341953 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.341956    2575 factory.go:223] Registration of the crio container factory successfully
Jun 03 01:39:54.342077 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.342008    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 03 01:39:54.342077 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.342017    2575 factory.go:55] Registering systemd factory
Jun 03 01:39:54.342077 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.342025    2575 factory.go:223] Registration of the systemd container factory successfully
Jun 03 01:39:54.342077 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.342040    2575 factory.go:103] Registering Raw factory
Jun 03 01:39:54.342077 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.342054    2575 manager.go:1196] Started watching for new ooms in manager
Jun 03 01:39:54.342423 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.342410    2575 manager.go:319] Starting recovery of all containers
Jun 03 01:39:54.344098 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.344054    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 03 01:39:54.344225 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.344120    2575 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 03 01:39:54.344394 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.344373    2575 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 03 01:39:54.345218 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.344175    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-28.ec2.internal.18b56e9070393a84  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-28.ec2.internal,UID:ip-10-0-128-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-28.ec2.internal,},FirstTimestamp:2026-06-03 01:39:54.332043908 +0000 UTC m=+0.398634497,LastTimestamp:2026-06-03 01:39:54.332043908 +0000 UTC m=+0.398634497,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-28.ec2.internal,}"
Jun 03 01:39:54.353762 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.353743    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-74zt8"
Jun 03 01:39:54.354655 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.354640    2575 manager.go:324] Recovery completed
Jun 03 01:39:54.360014 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.360001    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 01:39:54.360514 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.360495    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-74zt8"
Jun 03 01:39:54.362289 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.362270    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 01:39:54.362367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.362303    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 01:39:54.362367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.362318    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientPID"
Jun 03 01:39:54.362877 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.362863    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 03 01:39:54.362877 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.362876    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 03 01:39:54.362959 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.362891    2575 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 01:39:54.364334 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.364272    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-28.ec2.internal.18b56e907206b3bf  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-28.ec2.internal,UID:ip-10-0-128-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-28.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-28.ec2.internal,},FirstTimestamp:2026-06-03 01:39:54.362287039 +0000 UTC m=+0.428877627,LastTimestamp:2026-06-03 01:39:54.362287039 +0000 UTC m=+0.428877627,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-28.ec2.internal,}"
Jun 03 01:39:54.364755 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.364744    2575 policy_none.go:49] "None policy: Start"
Jun 03 01:39:54.364791 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.364760    2575 memory_manager.go:186] "Starting memorymanager" policy="None"
Jun 03 01:39:54.364791 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.364770    2575 state_mem.go:35] "Initializing new in-memory state store"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.406456    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.407151    2575 manager.go:341] "Starting Device Plugin manager"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.407185    2575 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.407199    2575 server.go:85] "Starting device plugin registration server"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.407452    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.407465    2575 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.407594    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.407678    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.407688    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.407933    2575 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.407953    2575 status_manager.go:230] "Starting to sync pod status with apiserver"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.407973    2575 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.407983    2575 kubelet.go:2451] "Starting kubelet main sync loop"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.408059    2575 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.408312    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.408349    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:54.412531 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.412014    2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 01:39:54.508528 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.508408    2575 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal"]
Jun 03 01:39:54.508528 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.508421    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 01:39:54.508746 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.508546    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 01:39:54.509542 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.509523    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 01:39:54.509542 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.509537    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 01:39:54.509691 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.509557    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 01:39:54.509691 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.509574    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientPID"
Jun 03 01:39:54.509691 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.509559    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 01:39:54.509691 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.509637    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientPID"
Jun 03 01:39:54.509691 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.509662    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.510661 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.510648    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 01:39:54.510795 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.510781    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.510842 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.510811    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 01:39:54.511302 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.511272    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 01:39:54.511302 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.511296    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 01:39:54.511302 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.511305    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientPID"
Jun 03 01:39:54.511500 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.511307    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 01:39:54.511500 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.511327    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 01:39:54.511500 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.511341    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientPID"
Jun 03 01:39:54.512281 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.512264    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.512358 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.512292    2575 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 01:39:54.512916 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.512903    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 01:39:54.512979 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.512927    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 01:39:54.512979 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.512941    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeHasSufficientPID"
Jun 03 01:39:54.518014 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.518001    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.518078 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.518019    2575 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-28.ec2.internal\": node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:54.532335 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.532313    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:54.545251 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.545234    2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-28.ec2.internal\" not found" node="ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.549626 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.549612    2575 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-28.ec2.internal\" not found" node="ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.633086 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.633060    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:54.638750 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.638729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d9a94fe0fb6badc03a89f43c34129d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal\" (UID: \"60d9a94fe0fb6badc03a89f43c34129d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.638809 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.638770    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23d8c441f7d9cf4fc58ff38513145034-config\") pod \"kube-apiserver-proxy-ip-10-0-128-28.ec2.internal\" (UID: \"23d8c441f7d9cf4fc58ff38513145034\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.638850 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.638838    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60d9a94fe0fb6badc03a89f43c34129d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal\" (UID: \"60d9a94fe0fb6badc03a89f43c34129d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.733894 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.733841    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:54.739090 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.739070    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60d9a94fe0fb6badc03a89f43c34129d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal\" (UID: \"60d9a94fe0fb6badc03a89f43c34129d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.739141 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.739100    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d9a94fe0fb6badc03a89f43c34129d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal\" (UID: \"60d9a94fe0fb6badc03a89f43c34129d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.739173 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.739159    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23d8c441f7d9cf4fc58ff38513145034-config\") pod \"kube-apiserver-proxy-ip-10-0-128-28.ec2.internal\" (UID: \"23d8c441f7d9cf4fc58ff38513145034\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.739208 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.739182    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60d9a94fe0fb6badc03a89f43c34129d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal\" (UID: \"60d9a94fe0fb6badc03a89f43c34129d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.739240 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.739186    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d9a94fe0fb6badc03a89f43c34129d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal\" (UID: \"60d9a94fe0fb6badc03a89f43c34129d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.739240 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.739233    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/23d8c441f7d9cf4fc58ff38513145034-config\") pod \"kube-apiserver-proxy-ip-10-0-128-28.ec2.internal\" (UID: \"23d8c441f7d9cf4fc58ff38513145034\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.834505 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.834442    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:54.847833 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.847812    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.852206 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:54.852188    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:54.935020 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:54.934853    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:55.035308 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:55.035270    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:55.135826 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:55.135752    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:55.236264 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:55.236242    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:55.252709 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.252684    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 03 01:39:55.252834 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.252817    2575 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 01:39:55.331228 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:55.331197    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d8c441f7d9cf4fc58ff38513145034.slice/crio-32dbc4862b22592a9e08c558b3113208505fd96e437ae4d1a11d0532a2a91783 WatchSource:0}: Error finding container 32dbc4862b22592a9e08c558b3113208505fd96e437ae4d1a11d0532a2a91783: Status 404 returned error can't find the container with id 32dbc4862b22592a9e08c558b3113208505fd96e437ae4d1a11d0532a2a91783
Jun 03 01:39:55.331436 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:55.331414    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d9a94fe0fb6badc03a89f43c34129d.slice/crio-1fd992cb2ae57b8e4b60e01f3bd636a5b3eac21545668e509c7e7e6dbd71d574 WatchSource:0}: Error finding container 1fd992cb2ae57b8e4b60e01f3bd636a5b3eac21545668e509c7e7e6dbd71d574: Status 404 returned error can't find the container with id 1fd992cb2ae57b8e4b60e01f3bd636a5b3eac21545668e509c7e7e6dbd71d574
Jun 03 01:39:55.334665 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.334651    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 01:39:55.336398 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:55.336381    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:55.337142 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.337130    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 03 01:39:55.354577 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.354556    2575 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 01:39:55.361973 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.361950    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 01:34:54 +0000 UTC" deadline="2028-01-09 03:42:44.31965206 +0000 UTC"
Jun 03 01:39:55.361973 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.361973    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14042h2m48.957681701s"
Jun 03 01:39:55.369260 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.369239    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-64bx2"
Jun 03 01:39:55.378558 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.378543    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-64bx2"
Jun 03 01:39:55.410756 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.410666    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" event={"ID":"60d9a94fe0fb6badc03a89f43c34129d","Type":"ContainerStarted","Data":"1fd992cb2ae57b8e4b60e01f3bd636a5b3eac21545668e509c7e7e6dbd71d574"}
Jun 03 01:39:55.411665 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.411647    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal" event={"ID":"23d8c441f7d9cf4fc58ff38513145034","Type":"ContainerStarted","Data":"32dbc4862b22592a9e08c558b3113208505fd96e437ae4d1a11d0532a2a91783"}
Jun 03 01:39:55.436878 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:55.436859    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:55.442581 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.442565    2575 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 01:39:55.537698 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:55.537653    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:55.638139 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:55.638109    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:55.738608 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:55.738525    2575 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-28.ec2.internal\" not found"
Jun 03 01:39:55.741345 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.741324    2575 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 01:39:55.795084 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.795059    2575 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 01:39:55.839299 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.839268    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:55.851361 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.851335    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 01:39:55.852283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.852269    2575 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal"
Jun 03 01:39:55.865540 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:55.865510    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 01:39:56.319036 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.319002    2575 apiserver.go:52] "Watching apiserver"
Jun 03 01:39:56.327000 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.326963    2575 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 03 01:39:56.327359 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.327330    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-8bp44","openshift-network-operator/iptables-alerter-pct4r","kube-system/konnectivity-agent-mtm54","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh","openshift-cluster-node-tuning-operator/tuned-67cd5","openshift-image-registry/node-ca-v6pmr","openshift-multus/multus-dpfst","openshift-multus/network-metrics-daemon-gnbxx","openshift-network-diagnostics/network-check-target-2w4c2","openshift-ovn-kubernetes/ovnkube-node-j8jxk","kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal"]
Jun 03 01:39:56.329419 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.329397    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.330552 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.330529    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pct4r"
Jun 03 01:39:56.332123 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.331707    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 03 01:39:56.332123 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.331768    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mtm54"
Jun 03 01:39:56.332123 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.331919    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 03 01:39:56.332123 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.332018    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 03 01:39:56.332123 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.332106    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 03 01:39:56.332403 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.332232    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8dvff\""
Jun 03 01:39:56.333389 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.333066    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.333389 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.333184    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 03 01:39:56.333389 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.333242    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 03 01:39:56.333389 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.333373    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 03 01:39:56.333969 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.333950    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 03 01:39:56.334042 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.333984    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tqcnl\""
Jun 03 01:39:56.334119 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.334096    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 03 01:39:56.334219 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.334175    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 03 01:39:56.334219 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.334205    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rq42d\""
Jun 03 01:39:56.334885 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.334595    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.336079 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.335618    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 03 01:39:56.336079 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.335681    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 03 01:39:56.336079 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.335805    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6nbmn\""
Jun 03 01:39:56.336079 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.335864    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 03 01:39:56.336641 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.336624    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4nwjk\""
Jun 03 01:39:56.336641 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.336649    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 03 01:39:56.336819 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.336649    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 03 01:39:56.337004 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.336987    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v6pmr"
Jun 03 01:39:56.339012 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.338200    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.339121 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.339099    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 03 01:39:56.339214 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.339155    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 03 01:39:56.339214 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.339168    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vpv4k\""
Jun 03 01:39:56.339214 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.339189    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 03 01:39:56.340093 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.340077    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:39:56.340218 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:56.340148    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:39:56.340863 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.340847    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 03 01:39:56.341002 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.340990    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:39:56.341192 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:56.341177    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:39:56.341614 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.341600    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qjpvl\""
Jun 03 01:39:56.344010 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.343988    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.346382 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.346359    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 03 01:39:56.347833 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.347804    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 03 01:39:56.347928 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.347910    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 03 01:39:56.348010 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.347995    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 03 01:39:56.348133 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.347782    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 03 01:39:56.348245 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348229    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4b4gr\""
Jun 03 01:39:56.348317 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348299    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 03 01:39:56.348527 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348508    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-device-dir\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.348610 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348543    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-modprobe-d\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.348610 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sjxg\" (UniqueName: \"kubernetes.io/projected/5b26d3b3-77af-4cf9-890a-062403a387ca-kube-api-access-7sjxg\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.348610 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348592    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.348759 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-multus-socket-dir-parent\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.348759 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-hostroot\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.348759 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-multus-conf-dir\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.348759 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-etc-selinux\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.348759 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcs29\" (UniqueName: \"kubernetes.io/projected/2cadf093-a6b4-412a-9ee2-1b283f148143-kube-api-access-wcs29\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.348909 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-systemd\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.348909 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348808    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-system-cni-dir\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.348909 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348831    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-run-multus-certs\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.348909 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-lib-modules\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.348909 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348868    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-host\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.348909 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:39:56.349147 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348925    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-os-release\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.349147 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fd99af95-239e-443d-9728-d39e3d460a6a-multus-daemon-config\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.349147 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.348978    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.349147 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.349074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-system-cni-dir\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.351897 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.351854    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.351996 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.351913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f36f4552-c791-4a58-b739-2778fb425e57-iptables-alerter-script\") pod \"iptables-alerter-pct4r\" (UID: \"f36f4552-c791-4a58-b739-2778fb425e57\") " pod="openshift-network-operator/iptables-alerter-pct4r"
Jun 03 01:39:56.351996 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.351938    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1bb080f-a4e1-4cbc-8954-ddd6a29939f0-host\") pod \"node-ca-v6pmr\" (UID: \"d1bb080f-a4e1-4cbc-8954-ddd6a29939f0\") " pod="openshift-image-registry/node-ca-v6pmr"
Jun 03 01:39:56.351996 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.351960    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-cnibin\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.352126 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352000    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-sysctl-d\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.352126 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352030    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-var-lib-kubelet\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.352126 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352057    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-cni-binary-copy\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.352273 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-run\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.352273 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352208    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a94e5062-a17b-4233-a08c-815d443426ae-konnectivity-ca\") pod \"konnectivity-agent-mtm54\" (UID: \"a94e5062-a17b-4233-a08c-815d443426ae\") " pod="kube-system/konnectivity-agent-mtm54"
Jun 03 01:39:56.352273 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352232    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-var-lib-cni-bin\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.352273 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352260    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-kubernetes\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.352446 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-etc-kubernetes\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.352446 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352337    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-registration-dir\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.352446 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352360    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-sys\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.352446 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352382    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqt2w\" (UniqueName: \"kubernetes.io/projected/d1bb080f-a4e1-4cbc-8954-ddd6a29939f0-kube-api-access-hqt2w\") pod \"node-ca-v6pmr\" (UID: \"d1bb080f-a4e1-4cbc-8954-ddd6a29939f0\") " pod="openshift-image-registry/node-ca-v6pmr"
Jun 03 01:39:56.352446 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcfzq\" (UniqueName: \"kubernetes.io/projected/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-kube-api-access-zcfzq\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.352446 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352436    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-var-lib-kubelet\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.352755 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352462    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-sys-fs\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.352755 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352504    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwb5l\" (UniqueName: \"kubernetes.io/projected/0986221d-f836-4f45-983e-f6aa7b4b7b1d-kube-api-access-rwb5l\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:39:56.352755 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-var-lib-cni-multus\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.352755 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352563    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-sysctl-conf\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.352755 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352591    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f36f4552-c791-4a58-b739-2778fb425e57-host-slash\") pod \"iptables-alerter-pct4r\" (UID: \"f36f4552-c791-4a58-b739-2778fb425e57\") " pod="openshift-network-operator/iptables-alerter-pct4r"
Jun 03 01:39:56.352755 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b26d3b3-77af-4cf9-890a-062403a387ca-tmp\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.352755 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352659    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56hck\" (UniqueName: \"kubernetes.io/projected/f36f4552-c791-4a58-b739-2778fb425e57-kube-api-access-56hck\") pod \"iptables-alerter-pct4r\" (UID: \"f36f4552-c791-4a58-b739-2778fb425e57\") " pod="openshift-network-operator/iptables-alerter-pct4r"
Jun 03 01:39:56.352755 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352694    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-socket-dir\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.352755 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-os-release\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.352755 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352752    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a94e5062-a17b-4233-a08c-815d443426ae-agent-certs\") pod \"konnectivity-agent-mtm54\" (UID: \"a94e5062-a17b-4233-a08c-815d443426ae\") " pod="kube-system/konnectivity-agent-mtm54"
Jun 03 01:39:56.353165 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352773    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1bb080f-a4e1-4cbc-8954-ddd6a29939f0-serviceca\") pod \"node-ca-v6pmr\" (UID: \"d1bb080f-a4e1-4cbc-8954-ddd6a29939f0\") " pod="openshift-image-registry/node-ca-v6pmr"
Jun 03 01:39:56.353165 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-run-k8s-cni-cncf-io\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.353165 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352831    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-tuned\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.353165 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352846    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-cnibin\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.353165 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-sysconfig\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.353165 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352892    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.353165 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352915    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-multus-cni-dir\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.353165 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352938    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd99af95-239e-443d-9728-d39e3d460a6a-cni-binary-copy\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.353165 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352958    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-run-netns\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.353165 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.352982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw2rx\" (UniqueName: \"kubernetes.io/projected/fd99af95-239e-443d-9728-d39e3d460a6a-kube-api-access-gw2rx\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.379238 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.379212    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 01:34:55 +0000 UTC" deadline="2027-11-11 01:12:43.756789752 +0000 UTC"
Jun 03 01:39:56.379316 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.379237    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12623h32m47.377555743s"
Jun 03 01:39:56.438738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.438714    2575 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
Jun 03 01:39:56.454164 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454126    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-os-release\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.454305 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454171    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fd99af95-239e-443d-9728-d39e3d460a6a-multus-daemon-config\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.454305 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454195    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.454305 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454217    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-system-cni-dir\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.454305 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454240    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.454305 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454261    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f36f4552-c791-4a58-b739-2778fb425e57-iptables-alerter-script\") pod \"iptables-alerter-pct4r\" (UID: \"f36f4552-c791-4a58-b739-2778fb425e57\") " pod="openshift-network-operator/iptables-alerter-pct4r"
Jun 03 01:39:56.454305 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454264    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-os-release\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.454305 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454280    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1bb080f-a4e1-4cbc-8954-ddd6a29939f0-host\") pod \"node-ca-v6pmr\" (UID: \"d1bb080f-a4e1-4cbc-8954-ddd6a29939f0\") " pod="openshift-image-registry/node-ca-v6pmr"
Jun 03 01:39:56.454305 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454302    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-cnibin\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454311    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-system-cni-dir\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454344    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-sysctl-d\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454360    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454370    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-var-lib-kubelet\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454395    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-cni-binary-copy\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-run-netns\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454452    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-run\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454532    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a94e5062-a17b-4233-a08c-815d443426ae-konnectivity-ca\") pod \"konnectivity-agent-mtm54\" (UID: \"a94e5062-a17b-4233-a08c-815d443426ae\") " pod="kube-system/konnectivity-agent-mtm54"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454562    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-slash\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454587    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-run-openvswitch\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-run-ovn\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454622    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454636    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-var-lib-cni-bin\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454661    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-kubernetes\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454679    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-var-lib-kubelet\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-node-log\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.454769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454712    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-etc-kubernetes\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454755    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-run\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454765    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-etc-kubernetes\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454785    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-registration-dir\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454806    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fd99af95-239e-443d-9728-d39e3d460a6a-multus-daemon-config\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454808    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f36f4552-c791-4a58-b739-2778fb425e57-iptables-alerter-script\") pod \"iptables-alerter-pct4r\" (UID: \"f36f4552-c791-4a58-b739-2778fb425e57\") " pod="openshift-network-operator/iptables-alerter-pct4r"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454856    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-sys\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454859    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-cnibin\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454859    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-kubernetes\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454887    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1bb080f-a4e1-4cbc-8954-ddd6a29939f0-host\") pod \"node-ca-v6pmr\" (UID: \"d1bb080f-a4e1-4cbc-8954-ddd6a29939f0\") " pod="openshift-image-registry/node-ca-v6pmr"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454897    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-sys\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454926    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqt2w\" (UniqueName: \"kubernetes.io/projected/d1bb080f-a4e1-4cbc-8954-ddd6a29939f0-kube-api-access-hqt2w\") pod \"node-ca-v6pmr\" (UID: \"d1bb080f-a4e1-4cbc-8954-ddd6a29939f0\") " pod="openshift-image-registry/node-ca-v6pmr"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tz49\" (UniqueName: \"kubernetes.io/projected/8609ed51-6f91-4a98-877b-082601476a8b-kube-api-access-7tz49\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454981    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zcfzq\" (UniqueName: \"kubernetes.io/projected/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-kube-api-access-zcfzq\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454988    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-cni-binary-copy\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454927    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-var-lib-cni-bin\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455007    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-var-lib-kubelet\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.455590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.454994    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-registration-dir\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455043    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-sys-fs\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455065    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwb5l\" (UniqueName: \"kubernetes.io/projected/0986221d-f836-4f45-983e-f6aa7b4b7b1d-kube-api-access-rwb5l\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455084    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-var-lib-cni-multus\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455084    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-sys-fs\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455099    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-sysctl-conf\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455045    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-var-lib-kubelet\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455121    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f36f4552-c791-4a58-b739-2778fb425e57-host-slash\") pod \"iptables-alerter-pct4r\" (UID: \"f36f4552-c791-4a58-b739-2778fb425e57\") " pod="openshift-network-operator/iptables-alerter-pct4r"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455149    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f36f4552-c791-4a58-b739-2778fb425e57-host-slash\") pod \"iptables-alerter-pct4r\" (UID: \"f36f4552-c791-4a58-b739-2778fb425e57\") " pod="openshift-network-operator/iptables-alerter-pct4r"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455161    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-run-systemd\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455189    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-log-socket\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455209    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-var-lib-cni-multus\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455220    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b26d3b3-77af-4cf9-890a-062403a387ca-tmp\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455233    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a94e5062-a17b-4233-a08c-815d443426ae-konnectivity-ca\") pod \"konnectivity-agent-mtm54\" (UID: \"a94e5062-a17b-4233-a08c-815d443426ae\") " pod="kube-system/konnectivity-agent-mtm54"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455247    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455270    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56hck\" (UniqueName: \"kubernetes.io/projected/f36f4552-c791-4a58-b739-2778fb425e57-kube-api-access-56hck\") pod \"iptables-alerter-pct4r\" (UID: \"f36f4552-c791-4a58-b739-2778fb425e57\") " pod="openshift-network-operator/iptables-alerter-pct4r"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455292    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-socket-dir\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.456267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455318    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-os-release\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455324    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-sysctl-conf\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455341    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a94e5062-a17b-4233-a08c-815d443426ae-agent-certs\") pod \"konnectivity-agent-mtm54\" (UID: \"a94e5062-a17b-4233-a08c-815d443426ae\") " pod="kube-system/konnectivity-agent-mtm54"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455364    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1bb080f-a4e1-4cbc-8954-ddd6a29939f0-serviceca\") pod \"node-ca-v6pmr\" (UID: \"d1bb080f-a4e1-4cbc-8954-ddd6a29939f0\") " pod="openshift-image-registry/node-ca-v6pmr"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455388    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8609ed51-6f91-4a98-877b-082601476a8b-env-overrides\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8609ed51-6f91-4a98-877b-082601476a8b-ovn-node-metrics-cert\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455428    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-socket-dir\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455431    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-os-release\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455447    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455443    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-run-k8s-cni-cncf-io\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455520    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-run-k8s-cni-cncf-io\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455528    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-tuned\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455550    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-cnibin\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455567    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54qzs\" (UniqueName: \"kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs\") pod \"network-check-target-2w4c2\" (UID: \"93e979a5-f2c5-4ba7-baae-859678f21bcf\") " pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455586    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-kubelet\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455610    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-cni-netd\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455625    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-cnibin\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.457268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455635    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-sysconfig\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455670    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455752    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-sysconfig\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455795    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-var-lib-openvswitch\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8609ed51-6f91-4a98-877b-082601476a8b-ovnkube-script-lib\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455839    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1bb080f-a4e1-4cbc-8954-ddd6a29939f0-serviceca\") pod \"node-ca-v6pmr\" (UID: \"d1bb080f-a4e1-4cbc-8954-ddd6a29939f0\") " pod="openshift-image-registry/node-ca-v6pmr"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455858    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-multus-cni-dir\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455900    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd99af95-239e-443d-9728-d39e3d460a6a-cni-binary-copy\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455918    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-multus-cni-dir\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455931    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-run-netns\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-cni-bin\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.455986    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gw2rx\" (UniqueName: \"kubernetes.io/projected/fd99af95-239e-443d-9728-d39e3d460a6a-kube-api-access-gw2rx\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456007    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-run-netns\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456076    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-device-dir\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456009    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-device-dir\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456099    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456119    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-modprobe-d\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.458030 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456241    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sjxg\" (UniqueName: \"kubernetes.io/projected/5b26d3b3-77af-4cf9-890a-062403a387ca-kube-api-access-7sjxg\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456262    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-modprobe-d\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456274    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456306    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-multus-socket-dir-parent\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456332    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-hostroot\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456342    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd99af95-239e-443d-9728-d39e3d460a6a-cni-binary-copy\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456356    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-multus-conf-dir\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456379    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-etc-selinux\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456406    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-multus-socket-dir-parent\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456411    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-hostroot\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456437    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2cadf093-a6b4-412a-9ee2-1b283f148143-etc-selinux\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456453    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-multus-conf-dir\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456489    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcs29\" (UniqueName: \"kubernetes.io/projected/2cadf093-a6b4-412a-9ee2-1b283f148143-kube-api-access-wcs29\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456519    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-systemd\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456548    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456578    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-systemd\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456736    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8609ed51-6f91-4a98-877b-082601476a8b-ovnkube-config\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.458779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456770    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-system-cni-dir\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456785    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456797    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-run-multus-certs\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456822    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-lib-modules\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456829    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-sysctl-d\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456848    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-system-cni-dir\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456848    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-host\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456866    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fd99af95-239e-443d-9728-d39e3d460a6a-host-run-multus-certs\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456886    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456892    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-host\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456914    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-systemd-units\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.456939    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5b26d3b3-77af-4cf9-890a-062403a387ca-lib-modules\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:56.456979    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.457035    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-etc-openvswitch\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.459226 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:56.457087    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs podName:0986221d-f836-4f45-983e-f6aa7b4b7b1d nodeName:}" failed. No retries permitted until 2026-06-03 01:39:56.957063527 +0000 UTC m=+3.023654122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs") pod "network-metrics-daemon-gnbxx" (UID: "0986221d-f836-4f45-983e-f6aa7b4b7b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:39:56.459694 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.459673    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5b26d3b3-77af-4cf9-890a-062403a387ca-tmp\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.459748 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.459716    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5b26d3b3-77af-4cf9-890a-062403a387ca-etc-tuned\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.459933 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.459916    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a94e5062-a17b-4233-a08c-815d443426ae-agent-certs\") pod \"konnectivity-agent-mtm54\" (UID: \"a94e5062-a17b-4233-a08c-815d443426ae\") " pod="kube-system/konnectivity-agent-mtm54"
Jun 03 01:39:56.463627 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.463541    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwb5l\" (UniqueName: \"kubernetes.io/projected/0986221d-f836-4f45-983e-f6aa7b4b7b1d-kube-api-access-rwb5l\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:39:56.463727 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.463680    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56hck\" (UniqueName: \"kubernetes.io/projected/f36f4552-c791-4a58-b739-2778fb425e57-kube-api-access-56hck\") pod \"iptables-alerter-pct4r\" (UID: \"f36f4552-c791-4a58-b739-2778fb425e57\") " pod="openshift-network-operator/iptables-alerter-pct4r"
Jun 03 01:39:56.463951 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.463933    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcfzq\" (UniqueName: \"kubernetes.io/projected/d1e17d65-b640-4e47-8a9c-48b82f1c5d19-kube-api-access-zcfzq\") pod \"multus-additional-cni-plugins-8bp44\" (UID: \"d1e17d65-b640-4e47-8a9c-48b82f1c5d19\") " pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.464034 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.464013    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqt2w\" (UniqueName: \"kubernetes.io/projected/d1bb080f-a4e1-4cbc-8954-ddd6a29939f0-kube-api-access-hqt2w\") pod \"node-ca-v6pmr\" (UID: \"d1bb080f-a4e1-4cbc-8954-ddd6a29939f0\") " pod="openshift-image-registry/node-ca-v6pmr"
Jun 03 01:39:56.464735 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.464687    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw2rx\" (UniqueName: \"kubernetes.io/projected/fd99af95-239e-443d-9728-d39e3d460a6a-kube-api-access-gw2rx\") pod \"multus-dpfst\" (UID: \"fd99af95-239e-443d-9728-d39e3d460a6a\") " pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.465799 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.465779    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcs29\" (UniqueName: \"kubernetes.io/projected/2cadf093-a6b4-412a-9ee2-1b283f148143-kube-api-access-wcs29\") pod \"aws-ebs-csi-driver-node-d8zsh\" (UID: \"2cadf093-a6b4-412a-9ee2-1b283f148143\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.466132 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.466096    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sjxg\" (UniqueName: \"kubernetes.io/projected/5b26d3b3-77af-4cf9-890a-062403a387ca-kube-api-access-7sjxg\") pod \"tuned-67cd5\" (UID: \"5b26d3b3-77af-4cf9-890a-062403a387ca\") " pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.558055 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558006    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8609ed51-6f91-4a98-877b-082601476a8b-env-overrides\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558055 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558047    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8609ed51-6f91-4a98-877b-082601476a8b-ovn-node-metrics-cert\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558299 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558067    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54qzs\" (UniqueName: \"kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs\") pod \"network-check-target-2w4c2\" (UID: \"93e979a5-f2c5-4ba7-baae-859678f21bcf\") " pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:39:56.558299 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558101    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-kubelet\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558299 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558118    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-cni-netd\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558299 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558180    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-cni-netd\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558299 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558219    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-var-lib-openvswitch\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558299 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558222    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-kubelet\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558299 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558250    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8609ed51-6f91-4a98-877b-082601476a8b-ovnkube-script-lib\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558299 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558276    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-cni-bin\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558299 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558278    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-var-lib-openvswitch\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558308    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558337    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-cni-bin\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558365    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8609ed51-6f91-4a98-877b-082601476a8b-ovnkube-config\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558406    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-systemd-units\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558388    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558432    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-etc-openvswitch\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558461    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-systemd-units\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558485    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-run-netns\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558527    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-run-netns\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558531    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-etc-openvswitch\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558528    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-slash\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558554    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-slash\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558585    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8609ed51-6f91-4a98-877b-082601476a8b-env-overrides\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558585    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-run-openvswitch\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558618    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-run-openvswitch\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558634    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-run-ovn\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.558738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558661    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-node-log\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.559686 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558689    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7tz49\" (UniqueName: \"kubernetes.io/projected/8609ed51-6f91-4a98-877b-082601476a8b-kube-api-access-7tz49\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.559686 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558720    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-run-systemd\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.559686 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558725    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-run-ovn\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.559686 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558742    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-node-log\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.559686 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558746    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-log-socket\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.559686 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558786    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-log-socket\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.559686 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558789    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.559686 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558824    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-run-systemd\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.559686 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558861    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8609ed51-6f91-4a98-877b-082601476a8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.559686 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.558920    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8609ed51-6f91-4a98-877b-082601476a8b-ovnkube-config\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.559686 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.559285    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8609ed51-6f91-4a98-877b-082601476a8b-ovnkube-script-lib\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.560924 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.560903    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8609ed51-6f91-4a98-877b-082601476a8b-ovn-node-metrics-cert\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.564966 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:56.564947    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:39:56.565070 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:56.564970    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:39:56.565070 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:56.564985    2575 projected.go:194] Error preparing data for projected volume kube-api-access-54qzs for pod openshift-network-diagnostics/network-check-target-2w4c2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:39:56.565070 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:56.565055    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs podName:93e979a5-f2c5-4ba7-baae-859678f21bcf nodeName:}" failed. No retries permitted until 2026-06-03 01:39:57.065038139 +0000 UTC m=+3.131628721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-54qzs" (UniqueName: "kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs") pod "network-check-target-2w4c2" (UID: "93e979a5-f2c5-4ba7-baae-859678f21bcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:39:56.566740 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.566722    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tz49\" (UniqueName: \"kubernetes.io/projected/8609ed51-6f91-4a98-877b-082601476a8b-kube-api-access-7tz49\") pod \"ovnkube-node-j8jxk\" (UID: \"8609ed51-6f91-4a98-877b-082601476a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.642775 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.642702    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8bp44"
Jun 03 01:39:56.652393 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.652370    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pct4r"
Jun 03 01:39:56.660921 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.660905    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mtm54"
Jun 03 01:39:56.667513 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.667495    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh"
Jun 03 01:39:56.676076 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.676058    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-67cd5"
Jun 03 01:39:56.682577 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.682558    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v6pmr"
Jun 03 01:39:56.690133 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.690114    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dpfst"
Jun 03 01:39:56.695734 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.695715    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:39:56.779773 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.779747    2575 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 01:39:56.901315 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:56.901285    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b26d3b3_77af_4cf9_890a_062403a387ca.slice/crio-6414de4a68b7bf80537a2289774b0bd612a4177004d288da65fb456cf731f291 WatchSource:0}: Error finding container 6414de4a68b7bf80537a2289774b0bd612a4177004d288da65fb456cf731f291: Status 404 returned error can't find the container with id 6414de4a68b7bf80537a2289774b0bd612a4177004d288da65fb456cf731f291
Jun 03 01:39:56.903078 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:56.903048    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cadf093_a6b4_412a_9ee2_1b283f148143.slice/crio-b1d79356ff951acc715de78afc1bd2a179d203d206ea57bfb9a8e698e54719b2 WatchSource:0}: Error finding container b1d79356ff951acc715de78afc1bd2a179d203d206ea57bfb9a8e698e54719b2: Status 404 returned error can't find the container with id b1d79356ff951acc715de78afc1bd2a179d203d206ea57bfb9a8e698e54719b2
Jun 03 01:39:56.904225 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:56.903913    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8609ed51_6f91_4a98_877b_082601476a8b.slice/crio-9db643c631b1d8692bc9470def6eed38e94e98d526a3872daa55c5c991ad85f9 WatchSource:0}: Error finding container 9db643c631b1d8692bc9470def6eed38e94e98d526a3872daa55c5c991ad85f9: Status 404 returned error can't find the container with id 9db643c631b1d8692bc9470def6eed38e94e98d526a3872daa55c5c991ad85f9
Jun 03 01:39:56.908025 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:56.907612    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94e5062_a17b_4233_a08c_815d443426ae.slice/crio-659036f466ba4dda248a64111de1ad1d3d0d91a9736860ecc2468c9c969873fa WatchSource:0}: Error finding container 659036f466ba4dda248a64111de1ad1d3d0d91a9736860ecc2468c9c969873fa: Status 404 returned error can't find the container with id 659036f466ba4dda248a64111de1ad1d3d0d91a9736860ecc2468c9c969873fa
Jun 03 01:39:56.909155 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:56.909120    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1bb080f_a4e1_4cbc_8954_ddd6a29939f0.slice/crio-beb4c1a0a9c8690815cfa852c4da5e415247175055313ceb5b32db153607b641 WatchSource:0}: Error finding container beb4c1a0a9c8690815cfa852c4da5e415247175055313ceb5b32db153607b641: Status 404 returned error can't find the container with id beb4c1a0a9c8690815cfa852c4da5e415247175055313ceb5b32db153607b641
Jun 03 01:39:56.909583 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:56.909566    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd99af95_239e_443d_9728_d39e3d460a6a.slice/crio-a3f2783c18e22d1d0b4cee050f25fc1f469a88b927b6cb785b368241d8de5de2 WatchSource:0}: Error finding container a3f2783c18e22d1d0b4cee050f25fc1f469a88b927b6cb785b368241d8de5de2: Status 404 returned error can't find the container with id a3f2783c18e22d1d0b4cee050f25fc1f469a88b927b6cb785b368241d8de5de2
Jun 03 01:39:56.910560 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:56.910528    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf36f4552_c791_4a58_b739_2778fb425e57.slice/crio-8eb452ca91bc7197df3591d5592379663a5e2c763922f5d4d05f5a86fd00f76f WatchSource:0}: Error finding container 8eb452ca91bc7197df3591d5592379663a5e2c763922f5d4d05f5a86fd00f76f: Status 404 returned error can't find the container with id 8eb452ca91bc7197df3591d5592379663a5e2c763922f5d4d05f5a86fd00f76f
Jun 03 01:39:56.912499 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:39:56.912427    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e17d65_b640_4e47_8a9c_48b82f1c5d19.slice/crio-3703286036d7a1d0910009ad0218faceec530fee1bd976104c56f390f3a81db6 WatchSource:0}: Error finding container 3703286036d7a1d0910009ad0218faceec530fee1bd976104c56f390f3a81db6: Status 404 returned error can't find the container with id 3703286036d7a1d0910009ad0218faceec530fee1bd976104c56f390f3a81db6
Jun 03 01:39:56.962352 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:56.962327    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:39:56.962460 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:56.962423    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:39:56.962541 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:56.962530    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs podName:0986221d-f836-4f45-983e-f6aa7b4b7b1d nodeName:}" failed. No retries permitted until 2026-06-03 01:39:57.962499545 +0000 UTC m=+4.029090131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs") pod "network-metrics-daemon-gnbxx" (UID: "0986221d-f836-4f45-983e-f6aa7b4b7b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:39:57.054549 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.054523    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-49zpw"]
Jun 03 01:39:57.056254 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.056232    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-49zpw"
Jun 03 01:39:57.058735 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.058713    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 03 01:39:57.058735 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.058730    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hv2mw\""
Jun 03 01:39:57.058879 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.058808    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 03 01:39:57.163880 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.163725    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0739bcf0-bee6-4fcf-be88-6bd78ed71465-tmp-dir\") pod \"node-resolver-49zpw\" (UID: \"0739bcf0-bee6-4fcf-be88-6bd78ed71465\") " pod="openshift-dns/node-resolver-49zpw"
Jun 03 01:39:57.163975 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.163893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0739bcf0-bee6-4fcf-be88-6bd78ed71465-hosts-file\") pod \"node-resolver-49zpw\" (UID: \"0739bcf0-bee6-4fcf-be88-6bd78ed71465\") " pod="openshift-dns/node-resolver-49zpw"
Jun 03 01:39:57.163975 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.163921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7jmt\" (UniqueName: \"kubernetes.io/projected/0739bcf0-bee6-4fcf-be88-6bd78ed71465-kube-api-access-m7jmt\") pod \"node-resolver-49zpw\" (UID: \"0739bcf0-bee6-4fcf-be88-6bd78ed71465\") " pod="openshift-dns/node-resolver-49zpw"
Jun 03 01:39:57.163975 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.163962    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54qzs\" (UniqueName: \"kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs\") pod \"network-check-target-2w4c2\" (UID: \"93e979a5-f2c5-4ba7-baae-859678f21bcf\") " pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:39:57.164115 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:57.164044    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:39:57.164115 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:57.164058    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:39:57.164115 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:57.164068    2575 projected.go:194] Error preparing data for projected volume kube-api-access-54qzs for pod openshift-network-diagnostics/network-check-target-2w4c2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:39:57.164115 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:57.164115    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs podName:93e979a5-f2c5-4ba7-baae-859678f21bcf nodeName:}" failed. No retries permitted until 2026-06-03 01:39:58.164098437 +0000 UTC m=+4.230689013 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-54qzs" (UniqueName: "kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs") pod "network-check-target-2w4c2" (UID: "93e979a5-f2c5-4ba7-baae-859678f21bcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:39:57.265320 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.265285    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0739bcf0-bee6-4fcf-be88-6bd78ed71465-hosts-file\") pod \"node-resolver-49zpw\" (UID: \"0739bcf0-bee6-4fcf-be88-6bd78ed71465\") " pod="openshift-dns/node-resolver-49zpw"
Jun 03 01:39:57.265512 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.265339    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7jmt\" (UniqueName: \"kubernetes.io/projected/0739bcf0-bee6-4fcf-be88-6bd78ed71465-kube-api-access-m7jmt\") pod \"node-resolver-49zpw\" (UID: \"0739bcf0-bee6-4fcf-be88-6bd78ed71465\") " pod="openshift-dns/node-resolver-49zpw"
Jun 03 01:39:57.265512 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.265365    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0739bcf0-bee6-4fcf-be88-6bd78ed71465-hosts-file\") pod \"node-resolver-49zpw\" (UID: \"0739bcf0-bee6-4fcf-be88-6bd78ed71465\") " pod="openshift-dns/node-resolver-49zpw"
Jun 03 01:39:57.265512 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.265434    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0739bcf0-bee6-4fcf-be88-6bd78ed71465-tmp-dir\") pod \"node-resolver-49zpw\" (UID: \"0739bcf0-bee6-4fcf-be88-6bd78ed71465\") " pod="openshift-dns/node-resolver-49zpw"
Jun 03 01:39:57.265751 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.265733    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0739bcf0-bee6-4fcf-be88-6bd78ed71465-tmp-dir\") pod \"node-resolver-49zpw\" (UID: \"0739bcf0-bee6-4fcf-be88-6bd78ed71465\") " pod="openshift-dns/node-resolver-49zpw"
Jun 03 01:39:57.273898 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.273876    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7jmt\" (UniqueName: \"kubernetes.io/projected/0739bcf0-bee6-4fcf-be88-6bd78ed71465-kube-api-access-m7jmt\") pod \"node-resolver-49zpw\" (UID: \"0739bcf0-bee6-4fcf-be88-6bd78ed71465\") " pod="openshift-dns/node-resolver-49zpw"
Jun 03 01:39:57.365047 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.365014    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-49zpw"
Jun 03 01:39:57.380207 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.380153    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 01:34:55 +0000 UTC" deadline="2027-12-31 16:53:19.475762759 +0000 UTC"
Jun 03 01:39:57.380207 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.380187    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13839h13m22.095579149s"
Jun 03 01:39:57.417534 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.417364    2575 generic.go:358] "Generic (PLEG): container finished" podID="60d9a94fe0fb6badc03a89f43c34129d" containerID="a451af240dab9454e3d815d6d39ac25280cf356b66b1141b675cff7760266170" exitCode=0
Jun 03 01:39:57.417534 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.417445    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" event={"ID":"60d9a94fe0fb6badc03a89f43c34129d","Type":"ContainerDied","Data":"a451af240dab9454e3d815d6d39ac25280cf356b66b1141b675cff7760266170"}
Jun 03 01:39:57.420783 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.420257    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal" event={"ID":"23d8c441f7d9cf4fc58ff38513145034","Type":"ContainerStarted","Data":"b8a45be7464ffaa96405d20454565ec17eeec56528677e0e3feeba43c9aa1d55"}
Jun 03 01:39:57.423113 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.423067    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dpfst" event={"ID":"fd99af95-239e-443d-9728-d39e3d460a6a","Type":"ContainerStarted","Data":"a3f2783c18e22d1d0b4cee050f25fc1f469a88b927b6cb785b368241d8de5de2"}
Jun 03 01:39:57.424733 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.424687    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mtm54" event={"ID":"a94e5062-a17b-4233-a08c-815d443426ae","Type":"ContainerStarted","Data":"659036f466ba4dda248a64111de1ad1d3d0d91a9736860ecc2468c9c969873fa"}
Jun 03 01:39:57.426835 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.426797    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk" event={"ID":"8609ed51-6f91-4a98-877b-082601476a8b","Type":"ContainerStarted","Data":"9db643c631b1d8692bc9470def6eed38e94e98d526a3872daa55c5c991ad85f9"}
Jun 03 01:39:57.433316 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.433268    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-67cd5" event={"ID":"5b26d3b3-77af-4cf9-890a-062403a387ca","Type":"ContainerStarted","Data":"6414de4a68b7bf80537a2289774b0bd612a4177004d288da65fb456cf731f291"}
Jun 03 01:39:57.451025 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.450995    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-49zpw" event={"ID":"0739bcf0-bee6-4fcf-be88-6bd78ed71465","Type":"ContainerStarted","Data":"4a8272c69583f0b64ec73d3eb708ad5a76b8a17205dfeec4e671fc36ca1737bf"}
Jun 03 01:39:57.459105 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.459006    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8bp44" event={"ID":"d1e17d65-b640-4e47-8a9c-48b82f1c5d19","Type":"ContainerStarted","Data":"3703286036d7a1d0910009ad0218faceec530fee1bd976104c56f390f3a81db6"}
Jun 03 01:39:57.466635 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.466608    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pct4r" event={"ID":"f36f4552-c791-4a58-b739-2778fb425e57","Type":"ContainerStarted","Data":"8eb452ca91bc7197df3591d5592379663a5e2c763922f5d4d05f5a86fd00f76f"}
Jun 03 01:39:57.476878 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.476851    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v6pmr" event={"ID":"d1bb080f-a4e1-4cbc-8954-ddd6a29939f0","Type":"ContainerStarted","Data":"beb4c1a0a9c8690815cfa852c4da5e415247175055313ceb5b32db153607b641"}
Jun 03 01:39:57.480163 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.480136    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh" event={"ID":"2cadf093-a6b4-412a-9ee2-1b283f148143","Type":"ContainerStarted","Data":"b1d79356ff951acc715de78afc1bd2a179d203d206ea57bfb9a8e698e54719b2"}
Jun 03 01:39:57.970537 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:57.970498    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:39:57.970739 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:57.970663    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:39:57.970739 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:57.970724    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs podName:0986221d-f836-4f45-983e-f6aa7b4b7b1d nodeName:}" failed. No retries permitted until 2026-06-03 01:39:59.970704619 +0000 UTC m=+6.037295210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs") pod "network-metrics-daemon-gnbxx" (UID: "0986221d-f836-4f45-983e-f6aa7b4b7b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:39:58.174445 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:58.174406    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54qzs\" (UniqueName: \"kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs\") pod \"network-check-target-2w4c2\" (UID: \"93e979a5-f2c5-4ba7-baae-859678f21bcf\") " pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:39:58.174645 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:58.174606    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:39:58.174645 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:58.174626    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:39:58.174645 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:58.174638    2575 projected.go:194] Error preparing data for projected volume kube-api-access-54qzs for pod openshift-network-diagnostics/network-check-target-2w4c2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:39:58.174802 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:58.174697    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs podName:93e979a5-f2c5-4ba7-baae-859678f21bcf nodeName:}" failed. No retries permitted until 2026-06-03 01:40:00.174678055 +0000 UTC m=+6.241268638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-54qzs" (UniqueName: "kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs") pod "network-check-target-2w4c2" (UID: "93e979a5-f2c5-4ba7-baae-859678f21bcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:39:58.411821 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:58.408783    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:39:58.411821 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:58.408906    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:39:58.411821 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:58.411588    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:39:58.411821 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:58.411713    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:39:58.496356 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:58.496321    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" event={"ID":"60d9a94fe0fb6badc03a89f43c34129d","Type":"ContainerStarted","Data":"2563f00bfbc5226dfd4dc6b277fc2f01a30acfb2f87c570a269b64320c8fe408"}
Jun 03 01:39:58.509960 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:58.509148    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-28.ec2.internal" podStartSLOduration=3.5091308530000003 podStartE2EDuration="3.509130853s" podCreationTimestamp="2026-06-03 01:39:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:39:57.442600216 +0000 UTC m=+3.509190813" watchObservedRunningTime="2026-06-03 01:39:58.509130853 +0000 UTC m=+4.575721453"
Jun 03 01:39:58.509960 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:58.509240    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-28.ec2.internal" podStartSLOduration=3.5092325300000002 podStartE2EDuration="3.50923253s" podCreationTimestamp="2026-06-03 01:39:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:39:58.507852989 +0000 UTC m=+4.574443588" watchObservedRunningTime="2026-06-03 01:39:58.50923253 +0000 UTC m=+4.575823128"
Jun 03 01:39:59.990402 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:39:59.989892    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:39:59.990402 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:59.990011    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:39:59.990402 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:39:59.990071    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs podName:0986221d-f836-4f45-983e-f6aa7b4b7b1d nodeName:}" failed. No retries permitted until 2026-06-03 01:40:03.990053096 +0000 UTC m=+10.056643676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs") pod "network-metrics-daemon-gnbxx" (UID: "0986221d-f836-4f45-983e-f6aa7b4b7b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:00.193306 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:00.192671    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54qzs\" (UniqueName: \"kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs\") pod \"network-check-target-2w4c2\" (UID: \"93e979a5-f2c5-4ba7-baae-859678f21bcf\") " pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:00.193306 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:00.192876    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:40:00.193306 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:00.192895    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:40:00.193306 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:00.192907    2575 projected.go:194] Error preparing data for projected volume kube-api-access-54qzs for pod openshift-network-diagnostics/network-check-target-2w4c2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:00.193306 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:00.192966    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs podName:93e979a5-f2c5-4ba7-baae-859678f21bcf nodeName:}" failed. No retries permitted until 2026-06-03 01:40:04.192947936 +0000 UTC m=+10.259538528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-54qzs" (UniqueName: "kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs") pod "network-check-target-2w4c2" (UID: "93e979a5-f2c5-4ba7-baae-859678f21bcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:00.408605 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:00.408523    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:00.408752 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:00.408648    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:00.408998 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:00.408977    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:00.409092 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:00.409073    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:02.408825 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:02.408759    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:02.408825 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:02.408781    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:02.409313 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:02.408882    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:02.409313 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:02.409007    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:04.024796 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:04.024757    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:04.025257 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:04.024924    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:04.025257 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:04.025011    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs podName:0986221d-f836-4f45-983e-f6aa7b4b7b1d nodeName:}" failed. No retries permitted until 2026-06-03 01:40:12.024989358 +0000 UTC m=+18.091579939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs") pod "network-metrics-daemon-gnbxx" (UID: "0986221d-f836-4f45-983e-f6aa7b4b7b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:04.226066 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:04.226031    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54qzs\" (UniqueName: \"kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs\") pod \"network-check-target-2w4c2\" (UID: \"93e979a5-f2c5-4ba7-baae-859678f21bcf\") " pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:04.226239 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:04.226223    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:40:04.226299 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:04.226246    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:40:04.226299 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:04.226259    2575 projected.go:194] Error preparing data for projected volume kube-api-access-54qzs for pod openshift-network-diagnostics/network-check-target-2w4c2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:04.226364 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:04.226315    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs podName:93e979a5-f2c5-4ba7-baae-859678f21bcf nodeName:}" failed. No retries permitted until 2026-06-03 01:40:12.226297799 +0000 UTC m=+18.292888389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-54qzs" (UniqueName: "kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs") pod "network-check-target-2w4c2" (UID: "93e979a5-f2c5-4ba7-baae-859678f21bcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:04.410706 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:04.410627    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:04.410876 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:04.410753    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:04.410876 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:04.410815    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:04.410979 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:04.410902    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:06.409112 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:06.409064    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:06.409533 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:06.409070    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:06.409533 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:06.409217    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:06.409533 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:06.409282    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:08.408538 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:08.408508    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:08.408950 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:08.408514    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:08.408950 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:08.408646    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:08.408950 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:08.408738    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:10.409065 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:10.409030    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:10.409747 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:10.409152    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:10.409747 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:10.409217    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:10.409747 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:10.409316    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:12.086206 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:12.086163    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:12.086611 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:12.086325    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:12.086611 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:12.086402    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs podName:0986221d-f836-4f45-983e-f6aa7b4b7b1d nodeName:}" failed. No retries permitted until 2026-06-03 01:40:28.086384083 +0000 UTC m=+34.152974664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs") pod "network-metrics-daemon-gnbxx" (UID: "0986221d-f836-4f45-983e-f6aa7b4b7b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:12.287485 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:12.287439    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54qzs\" (UniqueName: \"kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs\") pod \"network-check-target-2w4c2\" (UID: \"93e979a5-f2c5-4ba7-baae-859678f21bcf\") " pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:12.287639 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:12.287618    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:40:12.287680 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:12.287643    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:40:12.287680 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:12.287657    2575 projected.go:194] Error preparing data for projected volume kube-api-access-54qzs for pod openshift-network-diagnostics/network-check-target-2w4c2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:12.287737 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:12.287717    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs podName:93e979a5-f2c5-4ba7-baae-859678f21bcf nodeName:}" failed. No retries permitted until 2026-06-03 01:40:28.287698252 +0000 UTC m=+34.354288831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-54qzs" (UniqueName: "kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs") pod "network-check-target-2w4c2" (UID: "93e979a5-f2c5-4ba7-baae-859678f21bcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:12.408958 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:12.408880    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:12.409109 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:12.408880    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:12.409109 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:12.409002    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:12.409219 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:12.409118    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:14.409840 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:14.409795    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:14.410340 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:14.409906    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:14.410340 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:14.409993    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:14.410340 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:14.410111    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:15.531785 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:15.531423    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8bp44" event={"ID":"d1e17d65-b640-4e47-8a9c-48b82f1c5d19","Type":"ContainerStarted","Data":"e1d53d9367bbf95186d873a95fd68c072488cd9045246dce4b7e42f44bb91d2a"}
Jun 03 01:40:15.536259 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:15.536230    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v6pmr" event={"ID":"d1bb080f-a4e1-4cbc-8954-ddd6a29939f0","Type":"ContainerStarted","Data":"942aae76f4de825790b5af4f108b75a57fd309b926c8d234e0cab51e35239812"}
Jun 03 01:40:15.539704 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:15.539660    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh" event={"ID":"2cadf093-a6b4-412a-9ee2-1b283f148143","Type":"ContainerStarted","Data":"00c25bfc289006884ba7e7095cddb44607fdd9182655021ef7d8817f624b54db"}
Jun 03 01:40:15.541029 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:15.540992    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dpfst" event={"ID":"fd99af95-239e-443d-9728-d39e3d460a6a","Type":"ContainerStarted","Data":"ca2d41d929e05912a7cd50d03f18ca6a5cd02f7c798ffaf2608047f44356b420"}
Jun 03 01:40:15.547201 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:15.547135    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk" event={"ID":"8609ed51-6f91-4a98-877b-082601476a8b","Type":"ContainerStarted","Data":"860daa3537f8600e520305119017beb400ef5b2af0b6f4fe264a87224765f3ff"}
Jun 03 01:40:15.549890 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:15.549373    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-67cd5" event={"ID":"5b26d3b3-77af-4cf9-890a-062403a387ca","Type":"ContainerStarted","Data":"bdf21248b607a8a0f7269ddb37102c2e3398a7e00b95b77cdb64bfa9b92ff561"}
Jun 03 01:40:15.561505 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:15.559427    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-dpfst" podStartSLOduration=3.159232668 podStartE2EDuration="21.559412669s" podCreationTimestamp="2026-06-03 01:39:54 +0000 UTC" firstStartedPulling="2026-06-03 01:39:56.911969565 +0000 UTC m=+2.978560156" lastFinishedPulling="2026-06-03 01:40:15.312149575 +0000 UTC m=+21.378740157" observedRunningTime="2026-06-03 01:40:15.558834873 +0000 UTC m=+21.625425492" watchObservedRunningTime="2026-06-03 01:40:15.559412669 +0000 UTC m=+21.626003269"
Jun 03 01:40:15.575018 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:15.571594    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mtm54" podStartSLOduration=3.203529822 podStartE2EDuration="21.571573671s" podCreationTimestamp="2026-06-03 01:39:54 +0000 UTC" firstStartedPulling="2026-06-03 01:39:56.910162758 +0000 UTC m=+2.976753347" lastFinishedPulling="2026-06-03 01:40:15.278206611 +0000 UTC m=+21.344797196" observedRunningTime="2026-06-03 01:40:15.570910954 +0000 UTC m=+21.637501554" watchObservedRunningTime="2026-06-03 01:40:15.571573671 +0000 UTC m=+21.638164270"
Jun 03 01:40:15.598510 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:15.598444    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v6pmr" podStartSLOduration=11.396917792 podStartE2EDuration="21.598427693s" podCreationTimestamp="2026-06-03 01:39:54 +0000 UTC" firstStartedPulling="2026-06-03 01:39:56.911621561 +0000 UTC m=+2.978212154" lastFinishedPulling="2026-06-03 01:40:07.113131459 +0000 UTC m=+13.179722055" observedRunningTime="2026-06-03 01:40:15.586496155 +0000 UTC m=+21.653086750" watchObservedRunningTime="2026-06-03 01:40:15.598427693 +0000 UTC m=+21.665018288"
Jun 03 01:40:15.599064 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:15.599040    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-67cd5" podStartSLOduration=3.191485652 podStartE2EDuration="21.599031358s" podCreationTimestamp="2026-06-03 01:39:54 +0000 UTC" firstStartedPulling="2026-06-03 01:39:56.905369616 +0000 UTC m=+2.971960207" lastFinishedPulling="2026-06-03 01:40:15.312915319 +0000 UTC m=+21.379505913" observedRunningTime="2026-06-03 01:40:15.598553548 +0000 UTC m=+21.665144148" watchObservedRunningTime="2026-06-03 01:40:15.599031358 +0000 UTC m=+21.665622002"
Jun 03 01:40:16.408638 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.408556    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:16.408846 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.408564    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:16.408846 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:16.408658    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:16.408846 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:16.408756    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:16.551597 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.551550    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 03 01:40:16.552726 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.552699    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-49zpw" event={"ID":"0739bcf0-bee6-4fcf-be88-6bd78ed71465","Type":"ContainerStarted","Data":"1b26a4d76232565970b0ce00deeb060278dfde74329bec5d7f6115efdc7acfba"}
Jun 03 01:40:16.553814 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.553795    2575 generic.go:358] "Generic (PLEG): container finished" podID="d1e17d65-b640-4e47-8a9c-48b82f1c5d19" containerID="e1d53d9367bbf95186d873a95fd68c072488cd9045246dce4b7e42f44bb91d2a" exitCode=0
Jun 03 01:40:16.553893 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.553851    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8bp44" event={"ID":"d1e17d65-b640-4e47-8a9c-48b82f1c5d19","Type":"ContainerDied","Data":"e1d53d9367bbf95186d873a95fd68c072488cd9045246dce4b7e42f44bb91d2a"}
Jun 03 01:40:16.555384 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.555362    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh" event={"ID":"2cadf093-a6b4-412a-9ee2-1b283f148143","Type":"ContainerStarted","Data":"8fc20f6f5d816ce6d6b3f3d91fdd5f2f3cf5189f63e20ce0f45e824381f01976"}
Jun 03 01:40:16.556679 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.556657    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mtm54" event={"ID":"a94e5062-a17b-4233-a08c-815d443426ae","Type":"ContainerStarted","Data":"6b38bb02e61694c408a567206168faaeb7786f638b1b0da77a17a94029d4d9b3"}
Jun 03 01:40:16.559520 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.559499    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk" event={"ID":"8609ed51-6f91-4a98-877b-082601476a8b","Type":"ContainerStarted","Data":"7d752b820c2560b98733b4b9526438b66982fc253d2c536d837fb950fc8ad256"}
Jun 03 01:40:16.559608 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.559527    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk" event={"ID":"8609ed51-6f91-4a98-877b-082601476a8b","Type":"ContainerStarted","Data":"1c2d4d62953653e0d2f02ac78c460e65e8468455687fcba8114b845de612edff"}
Jun 03 01:40:16.559608 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.559540    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk" event={"ID":"8609ed51-6f91-4a98-877b-082601476a8b","Type":"ContainerStarted","Data":"2da5ae7d4b620c0f615d79bd0cdfd460237983fa72810b4536ba4a70a1d7a281"}
Jun 03 01:40:16.559608 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.559553    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk" event={"ID":"8609ed51-6f91-4a98-877b-082601476a8b","Type":"ContainerStarted","Data":"1b218c10282360102b266005c4e216fa0fea9a47cc96d1ba9dcf9fa33769b529"}
Jun 03 01:40:16.559608 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.559565    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk" event={"ID":"8609ed51-6f91-4a98-877b-082601476a8b","Type":"ContainerStarted","Data":"363ed45397ad9bb308ad57ca7bdbb47a449036cf9d5546c538d13c31784d63e9"}
Jun 03 01:40:16.577278 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:16.577237    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-49zpw" podStartSLOduration=1.6771350310000002 podStartE2EDuration="19.577226782s" podCreationTimestamp="2026-06-03 01:39:57 +0000 UTC" firstStartedPulling="2026-06-03 01:39:57.378046685 +0000 UTC m=+3.444637267" lastFinishedPulling="2026-06-03 01:40:15.278138427 +0000 UTC m=+21.344729018" observedRunningTime="2026-06-03 01:40:16.576881609 +0000 UTC m=+22.643472206" watchObservedRunningTime="2026-06-03 01:40:16.577226782 +0000 UTC m=+22.643817380"
Jun 03 01:40:17.425810 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:17.425699    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T01:40:16.551570463Z","UUID":"98d9ff11-3fe0-4ce8-a608-cb35f76d043f","Handler":null,"Name":"","Endpoint":""}
Jun 03 01:40:17.431359 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:17.428296    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 03 01:40:17.431359 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:17.428417    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 03 01:40:17.563699 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:17.563514    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pct4r" event={"ID":"f36f4552-c791-4a58-b739-2778fb425e57","Type":"ContainerStarted","Data":"b876e217a225c2d27e8b6ac934d50ed8d4beeaef490f3cd58080e210f3b7a3bf"}
Jun 03 01:40:17.566285 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:17.566254    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh" event={"ID":"2cadf093-a6b4-412a-9ee2-1b283f148143","Type":"ContainerStarted","Data":"6fab99a5c4ea0801a8ff5ee22d28186d85c3ffcf1b59b82c92bd1dcae60ad685"}
Jun 03 01:40:17.578887 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:17.578838    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pct4r" podStartSLOduration=5.213975264 podStartE2EDuration="23.578824176s" podCreationTimestamp="2026-06-03 01:39:54 +0000 UTC" firstStartedPulling="2026-06-03 01:39:56.91329073 +0000 UTC m=+2.979881321" lastFinishedPulling="2026-06-03 01:40:15.278139642 +0000 UTC m=+21.344730233" observedRunningTime="2026-06-03 01:40:17.578344061 +0000 UTC m=+23.644934663" watchObservedRunningTime="2026-06-03 01:40:17.578824176 +0000 UTC m=+23.645414774"
Jun 03 01:40:17.594223 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:17.594174    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d8zsh" podStartSLOduration=3.129127092 podStartE2EDuration="23.594160626s" podCreationTimestamp="2026-06-03 01:39:54 +0000 UTC" firstStartedPulling="2026-06-03 01:39:56.906561495 +0000 UTC m=+2.973152085" lastFinishedPulling="2026-06-03 01:40:17.371595029 +0000 UTC m=+23.438185619" observedRunningTime="2026-06-03 01:40:17.594119828 +0000 UTC m=+23.660710425" watchObservedRunningTime="2026-06-03 01:40:17.594160626 +0000 UTC m=+23.660751227"
Jun 03 01:40:18.408860 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:18.408825    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:18.409045 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:18.408825    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:18.409045 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:18.408933    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:18.409045 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:18.409001    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:18.571991 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:18.571953    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk" event={"ID":"8609ed51-6f91-4a98-877b-082601476a8b","Type":"ContainerStarted","Data":"11fd7cc03f00cb11c3a3f1ac651266a6f881b283846eb2fefb335087b97f200a"}
Jun 03 01:40:20.412173 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:20.411982    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:20.412580 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:20.412016    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:20.412580 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:20.412289    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:20.412580 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:20.412350    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:20.516014 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:20.515977    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mtm54"
Jun 03 01:40:20.516598 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:20.516575    2575 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mtm54"
Jun 03 01:40:20.575849 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:20.575815    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mtm54"
Jun 03 01:40:20.576362 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:20.576338    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mtm54"
Jun 03 01:40:21.580134 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:21.580068    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk" event={"ID":"8609ed51-6f91-4a98-877b-082601476a8b","Type":"ContainerStarted","Data":"8ca8187b8bc38eb4dde360fa465c246c5096e53d5bd206fbcecc32edcc481c08"}
Jun 03 01:40:21.580587 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:21.580365    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:40:21.580587 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:21.580395    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:40:21.581814 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:21.581792    2575 generic.go:358] "Generic (PLEG): container finished" podID="d1e17d65-b640-4e47-8a9c-48b82f1c5d19" containerID="430ef0a46963327df0fe475fbba23e8d44b3efe9aad89620f986b188f3b256b1" exitCode=0
Jun 03 01:40:21.581910 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:21.581872    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8bp44" event={"ID":"d1e17d65-b640-4e47-8a9c-48b82f1c5d19","Type":"ContainerDied","Data":"430ef0a46963327df0fe475fbba23e8d44b3efe9aad89620f986b188f3b256b1"}
Jun 03 01:40:21.595824 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:21.595802    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:40:21.606138 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:21.606101    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk" podStartSLOduration=9.141026714 podStartE2EDuration="27.606090959s" podCreationTimestamp="2026-06-03 01:39:54 +0000 UTC" firstStartedPulling="2026-06-03 01:39:56.907092126 +0000 UTC m=+2.973682718" lastFinishedPulling="2026-06-03 01:40:15.372156373 +0000 UTC m=+21.438746963" observedRunningTime="2026-06-03 01:40:21.604639593 +0000 UTC m=+27.671230190" watchObservedRunningTime="2026-06-03 01:40:21.606090959 +0000 UTC m=+27.672681555"
Jun 03 01:40:22.408353 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:22.408314    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:22.408547 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:22.408314    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:22.408547 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:22.408453    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:22.408662 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:22.408567    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:22.584154 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:22.584122    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:40:22.599839 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:22.599814    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:40:23.023207 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:23.023122    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gnbxx"]
Jun 03 01:40:23.023368 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:23.023244    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:23.023435 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:23.023364    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:23.026171 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:23.026144    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2w4c2"]
Jun 03 01:40:23.026290 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:23.026227    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:23.026331 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:23.026297    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:23.587452 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:23.587420    2575 generic.go:358] "Generic (PLEG): container finished" podID="d1e17d65-b640-4e47-8a9c-48b82f1c5d19" containerID="ac691b52fecfee9c30b74b88377b5991b75d584227612a86958e5ddfced6c0bd" exitCode=0
Jun 03 01:40:23.587966 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:23.587506    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8bp44" event={"ID":"d1e17d65-b640-4e47-8a9c-48b82f1c5d19","Type":"ContainerDied","Data":"ac691b52fecfee9c30b74b88377b5991b75d584227612a86958e5ddfced6c0bd"}
Jun 03 01:40:24.412200 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:24.412164    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:24.412359 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:24.412204    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:24.412359 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:24.412272    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:24.412359 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:24.412323    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:25.593217 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:25.593023    2575 generic.go:358] "Generic (PLEG): container finished" podID="d1e17d65-b640-4e47-8a9c-48b82f1c5d19" containerID="530a6dea7fa7eb017dd922e06cfdce32b8e1ff4f701c5365d3ea2d2ff75e3979" exitCode=0
Jun 03 01:40:25.593217 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:25.593110    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8bp44" event={"ID":"d1e17d65-b640-4e47-8a9c-48b82f1c5d19","Type":"ContainerDied","Data":"530a6dea7fa7eb017dd922e06cfdce32b8e1ff4f701c5365d3ea2d2ff75e3979"}
Jun 03 01:40:26.408464 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:26.408426    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:26.408464 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:26.408453    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:26.408694 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:26.408592    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:40:26.408768 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:26.408738    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2w4c2" podUID="93e979a5-f2c5-4ba7-baae-859678f21bcf"
Jun 03 01:40:28.106446 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.106353    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:28.106840 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.106506    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:28.106840 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.106562    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs podName:0986221d-f836-4f45-983e-f6aa7b4b7b1d nodeName:}" failed. No retries permitted until 2026-06-03 01:41:00.106548238 +0000 UTC m=+66.173138814 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs") pod "network-metrics-daemon-gnbxx" (UID: "0986221d-f836-4f45-983e-f6aa7b4b7b1d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 01:40:28.256687 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.256658    2575 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-28.ec2.internal" event="NodeReady"
Jun 03 01:40:28.256846 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.256777    2575 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
Jun 03 01:40:28.289099 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.289062    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"]
Jun 03 01:40:28.307521 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.307483    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54qzs\" (UniqueName: \"kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs\") pod \"network-check-target-2w4c2\" (UID: \"93e979a5-f2c5-4ba7-baae-859678f21bcf\") " pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:28.307670 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.307589    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 01:40:28.307670 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.307605    2575 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 01:40:28.307670 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.307613    2575 projected.go:194] Error preparing data for projected volume kube-api-access-54qzs for pod openshift-network-diagnostics/network-check-target-2w4c2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:28.307670 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.307664    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs podName:93e979a5-f2c5-4ba7-baae-859678f21bcf nodeName:}" failed. No retries permitted until 2026-06-03 01:41:00.307649058 +0000 UTC m=+66.374239637 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-54qzs" (UniqueName: "kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs") pod "network-check-target-2w4c2" (UID: "93e979a5-f2c5-4ba7-baae-859678f21bcf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 01:40:28.311126 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.311099    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"]
Jun 03 01:40:28.311261 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.311236    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:40:28.314354 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.314336    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jun 03 01:40:28.314510 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.314368    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pbbkv\""
Jun 03 01:40:28.314510 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.314407    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jun 03 01:40:28.335251 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.335221    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"]
Jun 03 01:40:28.335373 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.335356    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.337618 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.337598    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 03 01:40:28.337876 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.337858    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7lnrl\""
Jun 03 01:40:28.337944 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.337864    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 03 01:40:28.338005 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.337964    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 03 01:40:28.342964 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.342947    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 03 01:40:28.357575 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.357506    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds"]
Jun 03 01:40:28.357680 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.357657    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:40:28.360121 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.360090    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 03 01:40:28.360264 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.360245    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jun 03 01:40:28.361861 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.360441    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 03 01:40:28.361861 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.360522    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 03 01:40:28.379867 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.379787    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"]
Jun 03 01:40:28.400605 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.400578    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"]
Jun 03 01:40:28.400605 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.400606    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds"]
Jun 03 01:40:28.400605 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.400615    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"]
Jun 03 01:40:28.400828 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.400625    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"]
Jun 03 01:40:28.400828 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.400644    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d6x6x"]
Jun 03 01:40:28.400828 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.400739    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.403737 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.403713    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jun 03 01:40:28.403737 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.403714    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jun 03 01:40:28.403908 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.403751    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jun 03 01:40:28.404106 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.404086    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jun 03 01:40:28.407922 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.407896    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ba3954ce-9e0f-4878-b9b2-a393fef74854-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:40:28.408029 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.407950    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:40:28.424423 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.424387    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"]
Jun 03 01:40:28.424571 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.424519    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds"
Jun 03 01:40:28.424571 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.424559    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:40:28.425043 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.424717    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:28.425043 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.424923    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:40:28.426907 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.426882    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 01:40:28.427135 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.427112    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6wxn4\""
Jun 03 01:40:28.427235 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.427180    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jun 03 01:40:28.427374 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.427357    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hpsd7\""
Jun 03 01:40:28.428571 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.427794    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 03 01:40:28.428571 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.427828    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sx8gm\""
Jun 03 01:40:28.428571 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.427847    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 01:40:28.428571 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.427938    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d6x6x"]
Jun 03 01:40:28.428571 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.427973    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f9b9x"]
Jun 03 01:40:28.428571 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.428058    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 03 01:40:28.428571 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.428086    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 01:40:28.428571 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.428367    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2xcbn\""
Jun 03 01:40:28.447703 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.447685    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f9b9x"]
Jun 03 01:40:28.447818 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.447805    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:40:28.450550 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.450092    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 03 01:40:28.450550 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.450097    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 03 01:40:28.450550 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.450166    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 03 01:40:28.450550 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.450364    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tsbnv\""
Jun 03 01:40:28.508267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508234    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c56524eb-c475-4a6d-9c5c-b98f23f521ed-installation-pull-secrets\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.508437 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508282    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-ca\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.508437 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508302    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.508437 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508319    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-546q6\" (UniqueName: \"kubernetes.io/projected/bf23fc51-f1a1-437d-8d16-b763938cd7ed-kube-api-access-546q6\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:28.508437 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.508437 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508415    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c56524eb-c475-4a6d-9c5c-b98f23f521ed-image-registry-private-configuration\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.508663 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508442    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/10870f57-4a1c-4a12-905b-138781740b9c-klusterlet-config\") pod \"klusterlet-addon-workmgr-685f47c984-tjw66\" (UID: \"10870f57-4a1c-4a12-905b-138781740b9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:40:28.508663 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.508663 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508556    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ba3954ce-9e0f-4878-b9b2-a393fef74854-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:40:28.508663 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.508663 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508599    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c56524eb-c475-4a6d-9c5c-b98f23f521ed-ca-trust-extracted\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.508663 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-hub\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.508895 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jts9c\" (UniqueName: \"kubernetes.io/projected/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-kube-api-access-jts9c\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.508895 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508695    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-certificates\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.508895 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508719    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c56524eb-c475-4a6d-9c5c-b98f23f521ed-trusted-ca\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.508895 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508740    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l476c\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-kube-api-access-l476c\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.508895 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508769    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-bound-sa-token\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.508895 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508797    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf23fc51-f1a1-437d-8d16-b763938cd7ed-tmp-dir\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:28.508895 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/85217631-6981-4ac9-8ef3-284c1754740e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d54f7f59d-b4lds\" (UID: \"85217631-6981-4ac9-8ef3-284c1754740e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds"
Jun 03 01:40:28.508895 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10870f57-4a1c-4a12-905b-138781740b9c-tmp\") pod \"klusterlet-addon-workmgr-685f47c984-tjw66\" (UID: \"10870f57-4a1c-4a12-905b-138781740b9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:40:28.509155 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508895    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf23fc51-f1a1-437d-8d16-b763938cd7ed-config-volume\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:28.509155 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508943    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d5pt\" (UniqueName: \"kubernetes.io/projected/85217631-6981-4ac9-8ef3-284c1754740e-kube-api-access-7d5pt\") pod \"managed-serviceaccount-addon-agent-d54f7f59d-b4lds\" (UID: \"85217631-6981-4ac9-8ef3-284c1754740e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds"
Jun 03 01:40:28.509155 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjwfw\" (UniqueName: \"kubernetes.io/projected/10870f57-4a1c-4a12-905b-138781740b9c-kube-api-access-pjwfw\") pod \"klusterlet-addon-workmgr-685f47c984-tjw66\" (UID: \"10870f57-4a1c-4a12-905b-138781740b9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:40:28.509155 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.508988    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:28.509155 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.509008    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:40:28.509155 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.509105    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 01:40:28.509325 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.509235    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert podName:ba3954ce-9e0f-4878-b9b2-a393fef74854 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:29.009221334 +0000 UTC m=+35.075811923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-7rc7v" (UID: "ba3954ce-9e0f-4878-b9b2-a393fef74854") : secret "networking-console-plugin-cert" not found
Jun 03 01:40:28.509325 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.509242    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ba3954ce-9e0f-4878-b9b2-a393fef74854-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:40:28.609585 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609499    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7d5pt\" (UniqueName: \"kubernetes.io/projected/85217631-6981-4ac9-8ef3-284c1754740e-kube-api-access-7d5pt\") pod \"managed-serviceaccount-addon-agent-d54f7f59d-b4lds\" (UID: \"85217631-6981-4ac9-8ef3-284c1754740e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds"
Jun 03 01:40:28.609585 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609537    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pjwfw\" (UniqueName: \"kubernetes.io/projected/10870f57-4a1c-4a12-905b-138781740b9c-kube-api-access-pjwfw\") pod \"klusterlet-addon-workmgr-685f47c984-tjw66\" (UID: \"10870f57-4a1c-4a12-905b-138781740b9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:40:28.609585 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609562    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:28.609878 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609604    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:40:28.609878 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609626    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bzdc\" (UniqueName: \"kubernetes.io/projected/681b8472-6edf-4780-8b1e-4621ebfa1772-kube-api-access-5bzdc\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:40:28.609878 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609681    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c56524eb-c475-4a6d-9c5c-b98f23f521ed-installation-pull-secrets\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.609878 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609724    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-ca\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.609878 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.609739    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:40:28.609878 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609749    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.609878 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609777    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-546q6\" (UniqueName: \"kubernetes.io/projected/bf23fc51-f1a1-437d-8d16-b763938cd7ed-kube-api-access-546q6\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:28.609878 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.609793    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls podName:bf23fc51-f1a1-437d-8d16-b763938cd7ed nodeName:}" failed. No retries permitted until 2026-06-03 01:40:29.109776897 +0000 UTC m=+35.176367477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls") pod "dns-default-d6x6x" (UID: "bf23fc51-f1a1-437d-8d16-b763938cd7ed") : secret "dns-default-metrics-tls" not found
Jun 03 01:40:28.609878 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609834    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.609878 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609860    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c56524eb-c475-4a6d-9c5c-b98f23f521ed-image-registry-private-configuration\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.609878 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609877    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/10870f57-4a1c-4a12-905b-138781740b9c-klusterlet-config\") pod \"klusterlet-addon-workmgr-685f47c984-tjw66\" (UID: \"10870f57-4a1c-4a12-905b-138781740b9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.609913    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609918    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.609924    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d7cd6ff5-b2vnr: secret "image-registry-tls" not found
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609947    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.609966    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls podName:c56524eb-c475-4a6d-9c5c-b98f23f521ed nodeName:}" failed. No retries permitted until 2026-06-03 01:40:29.109949802 +0000 UTC m=+35.176540395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls") pod "image-registry-68d7cd6ff5-b2vnr" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed") : secret "image-registry-tls" not found
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.609994    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c56524eb-c475-4a6d-9c5c-b98f23f521ed-ca-trust-extracted\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.610014    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-hub\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.610035    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jts9c\" (UniqueName: \"kubernetes.io/projected/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-kube-api-access-jts9c\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.610050    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-certificates\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.610085    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c56524eb-c475-4a6d-9c5c-b98f23f521ed-trusted-ca\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.610106    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l476c\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-kube-api-access-l476c\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.610126    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-bound-sa-token\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.610152    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf23fc51-f1a1-437d-8d16-b763938cd7ed-tmp-dir\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.610184    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/85217631-6981-4ac9-8ef3-284c1754740e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d54f7f59d-b4lds\" (UID: \"85217631-6981-4ac9-8ef3-284c1754740e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds"
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.610198    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10870f57-4a1c-4a12-905b-138781740b9c-tmp\") pod \"klusterlet-addon-workmgr-685f47c984-tjw66\" (UID: \"10870f57-4a1c-4a12-905b-138781740b9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:40:28.610367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.610212    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf23fc51-f1a1-437d-8d16-b763938cd7ed-config-volume\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:28.611180 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.610765    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bf23fc51-f1a1-437d-8d16-b763938cd7ed-config-volume\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:28.611180 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.610921    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-certificates\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.611180 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.611051    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.611326 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.611180    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c56524eb-c475-4a6d-9c5c-b98f23f521ed-ca-trust-extracted\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.611692 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.611646    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf23fc51-f1a1-437d-8d16-b763938cd7ed-tmp-dir\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:28.611692 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.611653    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c56524eb-c475-4a6d-9c5c-b98f23f521ed-trusted-ca\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.612650 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.612454    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10870f57-4a1c-4a12-905b-138781740b9c-tmp\") pod \"klusterlet-addon-workmgr-685f47c984-tjw66\" (UID: \"10870f57-4a1c-4a12-905b-138781740b9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:40:28.615299 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.615255    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c56524eb-c475-4a6d-9c5c-b98f23f521ed-image-registry-private-configuration\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.615390 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.615371    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.615560 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.615539    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-ca\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.616071 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.616048    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/85217631-6981-4ac9-8ef3-284c1754740e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d54f7f59d-b4lds\" (UID: \"85217631-6981-4ac9-8ef3-284c1754740e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds"
Jun 03 01:40:28.616497 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.616280    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-hub\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.616497 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.616292    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.616698 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.616671    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c56524eb-c475-4a6d-9c5c-b98f23f521ed-installation-pull-secrets\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.616865 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.616836    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/10870f57-4a1c-4a12-905b-138781740b9c-klusterlet-config\") pod \"klusterlet-addon-workmgr-685f47c984-tjw66\" (UID: \"10870f57-4a1c-4a12-905b-138781740b9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:40:28.621234 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.621189    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjwfw\" (UniqueName: \"kubernetes.io/projected/10870f57-4a1c-4a12-905b-138781740b9c-kube-api-access-pjwfw\") pod \"klusterlet-addon-workmgr-685f47c984-tjw66\" (UID: \"10870f57-4a1c-4a12-905b-138781740b9c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:40:28.621889 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.621861    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d5pt\" (UniqueName: \"kubernetes.io/projected/85217631-6981-4ac9-8ef3-284c1754740e-kube-api-access-7d5pt\") pod \"managed-serviceaccount-addon-agent-d54f7f59d-b4lds\" (UID: \"85217631-6981-4ac9-8ef3-284c1754740e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds"
Jun 03 01:40:28.621967 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.621936    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jts9c\" (UniqueName: \"kubernetes.io/projected/2397fe7d-5bcc-4561-9bfb-ae68be0bd91e-kube-api-access-jts9c\") pod \"cluster-proxy-proxy-agent-b5864df69-5n5pk\" (UID: \"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.622525 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.622501    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-bound-sa-token\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.622525 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.622516    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-546q6\" (UniqueName: \"kubernetes.io/projected/bf23fc51-f1a1-437d-8d16-b763938cd7ed-kube-api-access-546q6\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:28.622932 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.622914    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l476c\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-kube-api-access-l476c\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:28.668954 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.668920    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:40:28.711443 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.710885    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:40:28.711443 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.710926    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5bzdc\" (UniqueName: \"kubernetes.io/projected/681b8472-6edf-4780-8b1e-4621ebfa1772-kube-api-access-5bzdc\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:40:28.711443 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.711255    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:40:28.711443 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:28.711303    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert podName:681b8472-6edf-4780-8b1e-4621ebfa1772 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:29.211289236 +0000 UTC m=+35.277879812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert") pod "ingress-canary-f9b9x" (UID: "681b8472-6edf-4780-8b1e-4621ebfa1772") : secret "canary-serving-cert" not found
Jun 03 01:40:28.720542 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.720496    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bzdc\" (UniqueName: \"kubernetes.io/projected/681b8472-6edf-4780-8b1e-4621ebfa1772-kube-api-access-5bzdc\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:40:28.724283 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.724243    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:40:28.735354 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.735318    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds"
Jun 03 01:40:28.874239 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.874159    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"]
Jun 03 01:40:28.879505 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:40:28.879456    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10870f57_4a1c_4a12_905b_138781740b9c.slice/crio-b5fac4fc8cdc1263f53029c80778ee7a094b6a84a7d5f9e733d94489dd29282d WatchSource:0}: Error finding container b5fac4fc8cdc1263f53029c80778ee7a094b6a84a7d5f9e733d94489dd29282d: Status 404 returned error can't find the container with id b5fac4fc8cdc1263f53029c80778ee7a094b6a84a7d5f9e733d94489dd29282d
Jun 03 01:40:28.888631 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.888607    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"]
Jun 03 01:40:28.896503 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:28.896092    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds"]
Jun 03 01:40:29.013138 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:29.013105    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:40:29.013321 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:29.013259    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 01:40:29.013393 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:29.013342    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert podName:ba3954ce-9e0f-4878-b9b2-a393fef74854 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:30.013321736 +0000 UTC m=+36.079912313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-7rc7v" (UID: "ba3954ce-9e0f-4878-b9b2-a393fef74854") : secret "networking-console-plugin-cert" not found
Jun 03 01:40:29.114486 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:29.114443    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:29.114931 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:29.114537    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:29.114931 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:29.114685    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 01:40:29.114931 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:29.114685    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:40:29.114931 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:29.114701    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d7cd6ff5-b2vnr: secret "image-registry-tls" not found
Jun 03 01:40:29.114931 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:29.114775    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls podName:bf23fc51-f1a1-437d-8d16-b763938cd7ed nodeName:}" failed. No retries permitted until 2026-06-03 01:40:30.114751449 +0000 UTC m=+36.181342036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls") pod "dns-default-d6x6x" (UID: "bf23fc51-f1a1-437d-8d16-b763938cd7ed") : secret "dns-default-metrics-tls" not found
Jun 03 01:40:29.114931 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:29.114800    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls podName:c56524eb-c475-4a6d-9c5c-b98f23f521ed nodeName:}" failed. No retries permitted until 2026-06-03 01:40:30.114791284 +0000 UTC m=+36.181381873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls") pod "image-registry-68d7cd6ff5-b2vnr" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed") : secret "image-registry-tls" not found
Jun 03 01:40:29.215065 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:29.215029    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:40:29.215211 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:29.215185    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:40:29.215262 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:29.215251    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert podName:681b8472-6edf-4780-8b1e-4621ebfa1772 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:30.215232544 +0000 UTC m=+36.281823119 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert") pod "ingress-canary-f9b9x" (UID: "681b8472-6edf-4780-8b1e-4621ebfa1772") : secret "canary-serving-cert" not found
Jun 03 01:40:29.602908 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:29.602818    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk" event={"ID":"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e","Type":"ContainerStarted","Data":"f3be745b155f607b4bb252f2735e602af5f685b956793739735ecda48c2e6347"}
Jun 03 01:40:29.604117 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:29.604058    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds" event={"ID":"85217631-6981-4ac9-8ef3-284c1754740e","Type":"ContainerStarted","Data":"926fc27f266a877ddc0d94567e8d13bc9a95bd1a8b5f5f6ab9e4eaee443657c8"}
Jun 03 01:40:29.605223 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:29.605029    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66" event={"ID":"10870f57-4a1c-4a12-905b-138781740b9c","Type":"ContainerStarted","Data":"b5fac4fc8cdc1263f53029c80778ee7a094b6a84a7d5f9e733d94489dd29282d"}
Jun 03 01:40:30.023871 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.023679    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:40:30.024196 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:30.024176    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 01:40:30.024303 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:30.024282    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert podName:ba3954ce-9e0f-4878-b9b2-a393fef74854 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:32.024261619 +0000 UTC m=+38.090852198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-7rc7v" (UID: "ba3954ce-9e0f-4878-b9b2-a393fef74854") : secret "networking-console-plugin-cert" not found
Jun 03 01:40:30.124398 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.124356    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:30.124893 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.124461    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:30.124893 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:30.124653    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 01:40:30.124893 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:30.124669    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d7cd6ff5-b2vnr: secret "image-registry-tls" not found
Jun 03 01:40:30.124893 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:30.124725    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls podName:c56524eb-c475-4a6d-9c5c-b98f23f521ed nodeName:}" failed. No retries permitted until 2026-06-03 01:40:32.124707517 +0000 UTC m=+38.191298118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls") pod "image-registry-68d7cd6ff5-b2vnr" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed") : secret "image-registry-tls" not found
Jun 03 01:40:30.125148 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:30.125130    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:40:30.125218 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:30.125184    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls podName:bf23fc51-f1a1-437d-8d16-b763938cd7ed nodeName:}" failed. No retries permitted until 2026-06-03 01:40:32.125169807 +0000 UTC m=+38.191760383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls") pod "dns-default-d6x6x" (UID: "bf23fc51-f1a1-437d-8d16-b763938cd7ed") : secret "dns-default-metrics-tls" not found
Jun 03 01:40:30.225778 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.225740    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:40:30.226025 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:30.226004    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:40:30.226108 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:30.226078    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert podName:681b8472-6edf-4780-8b1e-4621ebfa1772 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:32.226057593 +0000 UTC m=+38.292648178 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert") pod "ingress-canary-f9b9x" (UID: "681b8472-6edf-4780-8b1e-4621ebfa1772") : secret "canary-serving-cert" not found
Jun 03 01:40:30.298088 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.296990    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-d8xk6"]
Jun 03 01:40:30.323981 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.323937    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d8xk6"]
Jun 03 01:40:30.324157 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.324131    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8xk6"
Jun 03 01:40:30.328295 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.327796    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 01:40:30.429205 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.429169    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23b03bcf-4e82-41c6-ba74-9adeef24601a-original-pull-secret\") pod \"global-pull-secret-syncer-d8xk6\" (UID: \"23b03bcf-4e82-41c6-ba74-9adeef24601a\") " pod="kube-system/global-pull-secret-syncer-d8xk6"
Jun 03 01:40:30.429372 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.429225    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23b03bcf-4e82-41c6-ba74-9adeef24601a-dbus\") pod \"global-pull-secret-syncer-d8xk6\" (UID: \"23b03bcf-4e82-41c6-ba74-9adeef24601a\") " pod="kube-system/global-pull-secret-syncer-d8xk6"
Jun 03 01:40:30.429372 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.429276    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23b03bcf-4e82-41c6-ba74-9adeef24601a-kubelet-config\") pod \"global-pull-secret-syncer-d8xk6\" (UID: \"23b03bcf-4e82-41c6-ba74-9adeef24601a\") " pod="kube-system/global-pull-secret-syncer-d8xk6"
Jun 03 01:40:30.530759 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.530693    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23b03bcf-4e82-41c6-ba74-9adeef24601a-kubelet-config\") pod \"global-pull-secret-syncer-d8xk6\" (UID: \"23b03bcf-4e82-41c6-ba74-9adeef24601a\") " pod="kube-system/global-pull-secret-syncer-d8xk6"
Jun 03 01:40:30.530950 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.530821    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23b03bcf-4e82-41c6-ba74-9adeef24601a-original-pull-secret\") pod \"global-pull-secret-syncer-d8xk6\" (UID: \"23b03bcf-4e82-41c6-ba74-9adeef24601a\") " pod="kube-system/global-pull-secret-syncer-d8xk6"
Jun 03 01:40:30.530950 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.530861    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23b03bcf-4e82-41c6-ba74-9adeef24601a-dbus\") pod \"global-pull-secret-syncer-d8xk6\" (UID: \"23b03bcf-4e82-41c6-ba74-9adeef24601a\") " pod="kube-system/global-pull-secret-syncer-d8xk6"
Jun 03 01:40:30.531087 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.531070    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23b03bcf-4e82-41c6-ba74-9adeef24601a-dbus\") pod \"global-pull-secret-syncer-d8xk6\" (UID: \"23b03bcf-4e82-41c6-ba74-9adeef24601a\") " pod="kube-system/global-pull-secret-syncer-d8xk6"
Jun 03 01:40:30.531166 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.531149    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23b03bcf-4e82-41c6-ba74-9adeef24601a-kubelet-config\") pod \"global-pull-secret-syncer-d8xk6\" (UID: \"23b03bcf-4e82-41c6-ba74-9adeef24601a\") " pod="kube-system/global-pull-secret-syncer-d8xk6"
Jun 03 01:40:30.554166 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.547742    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23b03bcf-4e82-41c6-ba74-9adeef24601a-original-pull-secret\") pod \"global-pull-secret-syncer-d8xk6\" (UID: \"23b03bcf-4e82-41c6-ba74-9adeef24601a\") " pod="kube-system/global-pull-secret-syncer-d8xk6"
Jun 03 01:40:30.641427 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.641393    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8xk6"
Jun 03 01:40:30.836629 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:30.836287    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d8xk6"]
Jun 03 01:40:30.848326 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:40:30.848293    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b03bcf_4e82_41c6_ba74_9adeef24601a.slice/crio-4200112bb849cc99b8efc46f1d4f7bcc5625b622b81cd9717533b840e90efab9 WatchSource:0}: Error finding container 4200112bb849cc99b8efc46f1d4f7bcc5625b622b81cd9717533b840e90efab9: Status 404 returned error can't find the container with id 4200112bb849cc99b8efc46f1d4f7bcc5625b622b81cd9717533b840e90efab9
Jun 03 01:40:31.611111 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:31.611057    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d8xk6" event={"ID":"23b03bcf-4e82-41c6-ba74-9adeef24601a","Type":"ContainerStarted","Data":"4200112bb849cc99b8efc46f1d4f7bcc5625b622b81cd9717533b840e90efab9"}
Jun 03 01:40:32.046851 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:32.046811    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:40:32.047097 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:32.046978    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 01:40:32.047097 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:32.047060    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert podName:ba3954ce-9e0f-4878-b9b2-a393fef74854 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:36.047038781 +0000 UTC m=+42.113629360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-7rc7v" (UID: "ba3954ce-9e0f-4878-b9b2-a393fef74854") : secret "networking-console-plugin-cert" not found
Jun 03 01:40:32.148750 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:32.147910    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:32.148750 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:32.147983    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:32.148750 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:32.148121    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:40:32.148750 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:32.148178    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls podName:bf23fc51-f1a1-437d-8d16-b763938cd7ed nodeName:}" failed. No retries permitted until 2026-06-03 01:40:36.148160681 +0000 UTC m=+42.214751264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls") pod "dns-default-d6x6x" (UID: "bf23fc51-f1a1-437d-8d16-b763938cd7ed") : secret "dns-default-metrics-tls" not found
Jun 03 01:40:32.148750 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:32.148584    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 01:40:32.148750 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:32.148603    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d7cd6ff5-b2vnr: secret "image-registry-tls" not found
Jun 03 01:40:32.148750 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:32.148722    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls podName:c56524eb-c475-4a6d-9c5c-b98f23f521ed nodeName:}" failed. No retries permitted until 2026-06-03 01:40:36.148704668 +0000 UTC m=+42.215295245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls") pod "image-registry-68d7cd6ff5-b2vnr" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed") : secret "image-registry-tls" not found
Jun 03 01:40:32.249778 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:32.249298    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:40:32.249778 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:32.249430    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:40:32.249778 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:32.249502    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert podName:681b8472-6edf-4780-8b1e-4621ebfa1772 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:36.249488549 +0000 UTC m=+42.316079138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert") pod "ingress-canary-f9b9x" (UID: "681b8472-6edf-4780-8b1e-4621ebfa1772") : secret "canary-serving-cert" not found
Jun 03 01:40:36.083618 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:36.083574    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:40:36.084105 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:36.083766    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 01:40:36.084105 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:36.083850    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert podName:ba3954ce-9e0f-4878-b9b2-a393fef74854 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:44.083828742 +0000 UTC m=+50.150419331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-7rc7v" (UID: "ba3954ce-9e0f-4878-b9b2-a393fef74854") : secret "networking-console-plugin-cert" not found
Jun 03 01:40:36.184402 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:36.184364    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:36.184602 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:36.184439    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:36.184602 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:36.184530    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 01:40:36.184602 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:36.184552    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d7cd6ff5-b2vnr: secret "image-registry-tls" not found
Jun 03 01:40:36.184602 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:36.184577    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:40:36.184602 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:36.184606    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls podName:c56524eb-c475-4a6d-9c5c-b98f23f521ed nodeName:}" failed. No retries permitted until 2026-06-03 01:40:44.184589808 +0000 UTC m=+50.251180384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls") pod "image-registry-68d7cd6ff5-b2vnr" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed") : secret "image-registry-tls" not found
Jun 03 01:40:36.184815 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:36.184624    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls podName:bf23fc51-f1a1-437d-8d16-b763938cd7ed nodeName:}" failed. No retries permitted until 2026-06-03 01:40:44.184611738 +0000 UTC m=+50.251202317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls") pod "dns-default-d6x6x" (UID: "bf23fc51-f1a1-437d-8d16-b763938cd7ed") : secret "dns-default-metrics-tls" not found
Jun 03 01:40:36.285795 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:36.285750    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:40:36.285980 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:36.285913    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:40:36.286051 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:36.285981    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert podName:681b8472-6edf-4780-8b1e-4621ebfa1772 nodeName:}" failed. No retries permitted until 2026-06-03 01:40:44.285960138 +0000 UTC m=+50.352550757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert") pod "ingress-canary-f9b9x" (UID: "681b8472-6edf-4780-8b1e-4621ebfa1772") : secret "canary-serving-cert" not found
Jun 03 01:40:41.631643 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:41.631608    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds" event={"ID":"85217631-6981-4ac9-8ef3-284c1754740e","Type":"ContainerStarted","Data":"a018b41efabecfbcd65046db0cabaecfb22058327cc893be1265789ecab3f0bf"}
Jun 03 01:40:41.635177 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:41.635145    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66" event={"ID":"10870f57-4a1c-4a12-905b-138781740b9c","Type":"ContainerStarted","Data":"2a26c0cc8ce9a33b0d16450fae9e5076215f3cf16efb6cf455c8c1d6f9fd8e41"}
Jun 03 01:40:41.635330 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:41.635317    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:40:41.636691 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:41.636651    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d8xk6" event={"ID":"23b03bcf-4e82-41c6-ba74-9adeef24601a","Type":"ContainerStarted","Data":"ca6e018522b0bee7318fb52174de7fef53eee990cb839cfd9fd71ac89a2ad804"}
Jun 03 01:40:41.637060 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:41.637044    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:40:41.638904 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:41.638881    2575 generic.go:358] "Generic (PLEG): container finished" podID="d1e17d65-b640-4e47-8a9c-48b82f1c5d19" containerID="774d8b727cb599737cd06ec46b7ce858e9b85c3e721a76ab05dff932692af8e6" exitCode=0
Jun 03 01:40:41.638982 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:41.638947    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8bp44" event={"ID":"d1e17d65-b640-4e47-8a9c-48b82f1c5d19","Type":"ContainerDied","Data":"774d8b727cb599737cd06ec46b7ce858e9b85c3e721a76ab05dff932692af8e6"}
Jun 03 01:40:41.640111 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:41.640092    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk" event={"ID":"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e","Type":"ContainerStarted","Data":"313bd1cc79a7ff1b0ec2360345bb52ae39ada26f95dd87a5e778e84c27b22d5a"}
Jun 03 01:40:41.646597 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:41.646555    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds" podStartSLOduration=15.306287302 podStartE2EDuration="27.646540126s" podCreationTimestamp="2026-06-03 01:40:14 +0000 UTC" firstStartedPulling="2026-06-03 01:40:28.899290677 +0000 UTC m=+34.965881267" lastFinishedPulling="2026-06-03 01:40:41.239543508 +0000 UTC m=+47.306134091" observedRunningTime="2026-06-03 01:40:41.645696068 +0000 UTC m=+47.712286670" watchObservedRunningTime="2026-06-03 01:40:41.646540126 +0000 UTC m=+47.713130725"
Jun 03 01:40:41.682566 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:41.682501    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66" podStartSLOduration=15.357614998 podStartE2EDuration="27.682459359s" podCreationTimestamp="2026-06-03 01:40:14 +0000 UTC" firstStartedPulling="2026-06-03 01:40:28.881849142 +0000 UTC m=+34.948439718" lastFinishedPulling="2026-06-03 01:40:41.206693501 +0000 UTC m=+47.273284079" observedRunningTime="2026-06-03 01:40:41.682213216 +0000 UTC m=+47.748803816" watchObservedRunningTime="2026-06-03 01:40:41.682459359 +0000 UTC m=+47.749049957"
Jun 03 01:40:41.694403 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:41.694363    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d8xk6" podStartSLOduration=1.316027958 podStartE2EDuration="11.694349434s" podCreationTimestamp="2026-06-03 01:40:30 +0000 UTC" firstStartedPulling="2026-06-03 01:40:30.850230131 +0000 UTC m=+36.916820712" lastFinishedPulling="2026-06-03 01:40:41.228551597 +0000 UTC m=+47.295142188" observedRunningTime="2026-06-03 01:40:41.694241618 +0000 UTC m=+47.760832216" watchObservedRunningTime="2026-06-03 01:40:41.694349434 +0000 UTC m=+47.760940033"
Jun 03 01:40:42.645956 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:42.645362    2575 generic.go:358] "Generic (PLEG): container finished" podID="d1e17d65-b640-4e47-8a9c-48b82f1c5d19" containerID="c779f0bc3efcf43f62751f0de200b01c855ab079135e46aa98831a4a12c128af" exitCode=0
Jun 03 01:40:42.645956 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:42.645454    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8bp44" event={"ID":"d1e17d65-b640-4e47-8a9c-48b82f1c5d19","Type":"ContainerDied","Data":"c779f0bc3efcf43f62751f0de200b01c855ab079135e46aa98831a4a12c128af"}
Jun 03 01:40:43.650678 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:43.650644    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8bp44" event={"ID":"d1e17d65-b640-4e47-8a9c-48b82f1c5d19","Type":"ContainerStarted","Data":"0836822e57c52ff69265a4fdab0a001e0ec193aa7fe0ee3e29ca6da316c1afed"}
Jun 03 01:40:43.672318 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:43.672278    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8bp44" podStartSLOduration=5.383534857 podStartE2EDuration="49.672265474s" podCreationTimestamp="2026-06-03 01:39:54 +0000 UTC" firstStartedPulling="2026-06-03 01:39:56.914174634 +0000 UTC m=+2.980765223" lastFinishedPulling="2026-06-03 01:40:41.202905262 +0000 UTC m=+47.269495840" observedRunningTime="2026-06-03 01:40:43.671190241 +0000 UTC m=+49.737780839" watchObservedRunningTime="2026-06-03 01:40:43.672265474 +0000 UTC m=+49.738856071"
Jun 03 01:40:44.151269 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:44.151232    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:40:44.151434 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:44.151335    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 01:40:44.151434 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:44.151387    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert podName:ba3954ce-9e0f-4878-b9b2-a393fef74854 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:00.151373129 +0000 UTC m=+66.217963709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-7rc7v" (UID: "ba3954ce-9e0f-4878-b9b2-a393fef74854") : secret "networking-console-plugin-cert" not found
Jun 03 01:40:44.251687 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:44.251652    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:40:44.251808 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:44.251699    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:40:44.251808 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:44.251795    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:40:44.251876 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:44.251813    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 01:40:44.251876 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:44.251835    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d7cd6ff5-b2vnr: secret "image-registry-tls" not found
Jun 03 01:40:44.251876 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:44.251847    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls podName:bf23fc51-f1a1-437d-8d16-b763938cd7ed nodeName:}" failed. No retries permitted until 2026-06-03 01:41:00.251833428 +0000 UTC m=+66.318424004 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls") pod "dns-default-d6x6x" (UID: "bf23fc51-f1a1-437d-8d16-b763938cd7ed") : secret "dns-default-metrics-tls" not found
Jun 03 01:40:44.251969 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:44.251879    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls podName:c56524eb-c475-4a6d-9c5c-b98f23f521ed nodeName:}" failed. No retries permitted until 2026-06-03 01:41:00.251864978 +0000 UTC m=+66.318455554 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls") pod "image-registry-68d7cd6ff5-b2vnr" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed") : secret "image-registry-tls" not found
Jun 03 01:40:44.352213 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:44.352178    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:40:44.352341 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:44.352316    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:40:44.352384 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:40:44.352375    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert podName:681b8472-6edf-4780-8b1e-4621ebfa1772 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:00.352361103 +0000 UTC m=+66.418951679 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert") pod "ingress-canary-f9b9x" (UID: "681b8472-6edf-4780-8b1e-4621ebfa1772") : secret "canary-serving-cert" not found
Jun 03 01:40:44.655344 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:44.655306    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk" event={"ID":"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e","Type":"ContainerStarted","Data":"642de880e6963ac9cba1dca85b4ab949a8ac34ea28de0298c555a2e45877a403"}
Jun 03 01:40:44.655344 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:44.655346    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk" event={"ID":"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e","Type":"ContainerStarted","Data":"fc421088ae74d69e1c5c9b4a9b89bc84a1f86ce891a8010bbab02ff0b101ee6f"}
Jun 03 01:40:44.672059 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:44.672015    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk" podStartSLOduration=15.942487589 podStartE2EDuration="30.672002531s" podCreationTimestamp="2026-06-03 01:40:14 +0000 UTC" firstStartedPulling="2026-06-03 01:40:28.898108166 +0000 UTC m=+34.964698756" lastFinishedPulling="2026-06-03 01:40:43.627623118 +0000 UTC m=+49.694213698" observedRunningTime="2026-06-03 01:40:44.671558528 +0000 UTC m=+50.738149145" watchObservedRunningTime="2026-06-03 01:40:44.672002531 +0000 UTC m=+50.738593129"
Jun 03 01:40:54.600259 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:40:54.600232    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8jxk"
Jun 03 01:41:00.167259 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.167217    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:41:00.167712 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.167279    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:41:00.167712 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:00.167377    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 01:41:00.167712 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:00.167453    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert podName:ba3954ce-9e0f-4878-b9b2-a393fef74854 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:32.167437634 +0000 UTC m=+98.234028210 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-7rc7v" (UID: "ba3954ce-9e0f-4878-b9b2-a393fef74854") : secret "networking-console-plugin-cert" not found
Jun 03 01:41:00.169894 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.169878    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 01:41:00.178006 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:00.177992    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 01:41:00.178060 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:00.178047    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs podName:0986221d-f836-4f45-983e-f6aa7b4b7b1d nodeName:}" failed. No retries permitted until 2026-06-03 01:42:04.178032885 +0000 UTC m=+130.244623461 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs") pod "network-metrics-daemon-gnbxx" (UID: "0986221d-f836-4f45-983e-f6aa7b4b7b1d") : secret "metrics-daemon-secret" not found
Jun 03 01:41:00.267937 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.267907    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:41:00.268076 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.267983    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:41:00.268076 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:00.268038    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:41:00.268076 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:00.268060    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 01:41:00.268076 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:00.268070    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d7cd6ff5-b2vnr: secret "image-registry-tls" not found
Jun 03 01:41:00.268202 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:00.268093    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls podName:bf23fc51-f1a1-437d-8d16-b763938cd7ed nodeName:}" failed. No retries permitted until 2026-06-03 01:41:32.268079685 +0000 UTC m=+98.334670265 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls") pod "dns-default-d6x6x" (UID: "bf23fc51-f1a1-437d-8d16-b763938cd7ed") : secret "dns-default-metrics-tls" not found
Jun 03 01:41:00.268202 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:00.268106    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls podName:c56524eb-c475-4a6d-9c5c-b98f23f521ed nodeName:}" failed. No retries permitted until 2026-06-03 01:41:32.268099771 +0000 UTC m=+98.334690347 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls") pod "image-registry-68d7cd6ff5-b2vnr" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed") : secret "image-registry-tls" not found
Jun 03 01:41:00.369239 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.369208    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:41:00.369359 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.369265    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-54qzs\" (UniqueName: \"kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs\") pod \"network-check-target-2w4c2\" (UID: \"93e979a5-f2c5-4ba7-baae-859678f21bcf\") " pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:41:00.369359 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:00.369341    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:41:00.369441 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:00.369401    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert podName:681b8472-6edf-4780-8b1e-4621ebfa1772 nodeName:}" failed. No retries permitted until 2026-06-03 01:41:32.369387685 +0000 UTC m=+98.435978265 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert") pod "ingress-canary-f9b9x" (UID: "681b8472-6edf-4780-8b1e-4621ebfa1772") : secret "canary-serving-cert" not found
Jun 03 01:41:00.371979 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.371965    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 01:41:00.381576 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.381557    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 01:41:00.393137 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.393116    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54qzs\" (UniqueName: \"kubernetes.io/projected/93e979a5-f2c5-4ba7-baae-859678f21bcf-kube-api-access-54qzs\") pod \"network-check-target-2w4c2\" (UID: \"93e979a5-f2c5-4ba7-baae-859678f21bcf\") " pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:41:00.553266 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.553185    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hpsd7\""
Jun 03 01:41:00.561397 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.561378    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:41:00.680750 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.680722    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2w4c2"]
Jun 03 01:41:00.684005 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:41:00.683972    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e979a5_f2c5_4ba7_baae_859678f21bcf.slice/crio-fe2e07807e131141752109a5c6cc04d964d33783f2aff28977181fb78bd668ea WatchSource:0}: Error finding container fe2e07807e131141752109a5c6cc04d964d33783f2aff28977181fb78bd668ea: Status 404 returned error can't find the container with id fe2e07807e131141752109a5c6cc04d964d33783f2aff28977181fb78bd668ea
Jun 03 01:41:00.698824 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:00.698796    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2w4c2" event={"ID":"93e979a5-f2c5-4ba7-baae-859678f21bcf","Type":"ContainerStarted","Data":"fe2e07807e131141752109a5c6cc04d964d33783f2aff28977181fb78bd668ea"}
Jun 03 01:41:04.709033 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:04.708997    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2w4c2" event={"ID":"93e979a5-f2c5-4ba7-baae-859678f21bcf","Type":"ContainerStarted","Data":"7d260ebcc821a2963024504b79df2c837e813514328089470caefa3b1c119284"}
Jun 03 01:41:04.709453 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:04.709117    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:41:04.724304 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:04.724255    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2w4c2" podStartSLOduration=67.109605124 podStartE2EDuration="1m10.724243574s" podCreationTimestamp="2026-06-03 01:39:54 +0000 UTC" firstStartedPulling="2026-06-03 01:41:00.685887096 +0000 UTC m=+66.752477686" lastFinishedPulling="2026-06-03 01:41:04.300525546 +0000 UTC m=+70.367116136" observedRunningTime="2026-06-03 01:41:04.723064377 +0000 UTC m=+70.789654977" watchObservedRunningTime="2026-06-03 01:41:04.724243574 +0000 UTC m=+70.790834168"
Jun 03 01:41:32.218609 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:32.218565    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:41:32.219087 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:32.218709    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jun 03 01:41:32.219087 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:32.218782    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert podName:ba3954ce-9e0f-4878-b9b2-a393fef74854 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:36.218765788 +0000 UTC m=+162.285356368 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-7rc7v" (UID: "ba3954ce-9e0f-4878-b9b2-a393fef74854") : secret "networking-console-plugin-cert" not found
Jun 03 01:41:32.319204 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:32.319171    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:41:32.319368 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:32.319214    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:41:32.319368 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:32.319302    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 01:41:32.319368 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:32.319324    2575 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 01:41:32.319368 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:32.319344    2575 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d7cd6ff5-b2vnr: secret "image-registry-tls" not found
Jun 03 01:41:32.319368 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:32.319359    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls podName:bf23fc51-f1a1-437d-8d16-b763938cd7ed nodeName:}" failed. No retries permitted until 2026-06-03 01:42:36.319345044 +0000 UTC m=+162.385935620 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls") pod "dns-default-d6x6x" (UID: "bf23fc51-f1a1-437d-8d16-b763938cd7ed") : secret "dns-default-metrics-tls" not found
Jun 03 01:41:32.319589 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:32.319405    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls podName:c56524eb-c475-4a6d-9c5c-b98f23f521ed nodeName:}" failed. No retries permitted until 2026-06-03 01:42:36.319387738 +0000 UTC m=+162.385978333 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls") pod "image-registry-68d7cd6ff5-b2vnr" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed") : secret "image-registry-tls" not found
Jun 03 01:41:32.419677 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:32.419644    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:41:32.419836 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:32.419787    2575 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 01:41:32.419882 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:41:32.419856    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert podName:681b8472-6edf-4780-8b1e-4621ebfa1772 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:36.41983998 +0000 UTC m=+162.486430556 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert") pod "ingress-canary-f9b9x" (UID: "681b8472-6edf-4780-8b1e-4621ebfa1772") : secret "canary-serving-cert" not found
Jun 03 01:41:35.713621 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:41:35.713589    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2w4c2"
Jun 03 01:42:04.258835 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:04.258795    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:42:04.259290 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:04.258903    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 01:42:04.259290 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:04.258963    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs podName:0986221d-f836-4f45-983e-f6aa7b4b7b1d nodeName:}" failed. No retries permitted until 2026-06-03 01:44:06.258948527 +0000 UTC m=+252.325539102 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs") pod "network-metrics-daemon-gnbxx" (UID: "0986221d-f836-4f45-983e-f6aa7b4b7b1d") : secret "metrics-daemon-secret" not found
Jun 03 01:42:07.771298 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:07.771268    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-49zpw_0739bcf0-bee6-4fcf-be88-6bd78ed71465/dns-node-resolver/0.log"
Jun 03 01:42:09.172156 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:09.172129    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v6pmr_d1bb080f-a4e1-4cbc-8954-ddd6a29939f0/node-ca/0.log"
Jun 03 01:42:19.401381 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.401348    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8k275"]
Jun 03 01:42:19.404370 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.404339    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.407084 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.407063    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 03 01:42:19.407312 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.407291    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jv5mr\""
Jun 03 01:42:19.407365 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.407309    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 03 01:42:19.408057 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.408035    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 03 01:42:19.408315 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.408300    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 03 01:42:19.414948 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.414929    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8k275"]
Jun 03 01:42:19.469549 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.469513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.469692 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.469556    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.469692 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.469610    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-data-volume\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.469692 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.469662    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2d2f\" (UniqueName: \"kubernetes.io/projected/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-kube-api-access-q2d2f\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.469800 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.469699    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-crio-socket\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.570700 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.570658    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.570889 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.570705    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.570889 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.570753    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-data-volume\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.570889 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.570818    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2d2f\" (UniqueName: \"kubernetes.io/projected/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-kube-api-access-q2d2f\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.570889 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:19.570872    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:19.571068 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.570927    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-crio-socket\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.571068 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:19.570946    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls podName:f8ea660a-c934-4cc5-9f78-bdf4b074ae84 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:20.070930825 +0000 UTC m=+146.137521404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k275" (UID: "f8ea660a-c934-4cc5-9f78-bdf4b074ae84") : secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:19.571068 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.570873    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-crio-socket\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.571168 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.571116    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-data-volume\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.571296 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.571276    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:19.579535 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:19.579504    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2d2f\" (UniqueName: \"kubernetes.io/projected/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-kube-api-access-q2d2f\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:20.074727 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:20.074667    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:20.074918 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:20.074821    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:20.074918 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:20.074902    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls podName:f8ea660a-c934-4cc5-9f78-bdf4b074ae84 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:21.074886539 +0000 UTC m=+147.141477114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k275" (UID: "f8ea660a-c934-4cc5-9f78-bdf4b074ae84") : secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:21.083490 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:21.083428    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:21.083881 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:21.083579    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:21.083881 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:21.083645    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls podName:f8ea660a-c934-4cc5-9f78-bdf4b074ae84 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:23.083629677 +0000 UTC m=+149.150220253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k275" (UID: "f8ea660a-c934-4cc5-9f78-bdf4b074ae84") : secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:23.099246 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:23.099209    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:23.099744 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:23.099379    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:23.099744 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:23.099462    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls podName:f8ea660a-c934-4cc5-9f78-bdf4b074ae84 nodeName:}" failed. No retries permitted until 2026-06-03 01:42:27.099441248 +0000 UTC m=+153.166031846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8k275" (UID: "f8ea660a-c934-4cc5-9f78-bdf4b074ae84") : secret "insights-runtime-extractor-tls" not found
Jun 03 01:42:27.130709 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:27.130671    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:27.133379 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:27.133355    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f8ea660a-c934-4cc5-9f78-bdf4b074ae84-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8k275\" (UID: \"f8ea660a-c934-4cc5-9f78-bdf4b074ae84\") " pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:27.212588 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:27.212535    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8k275"
Jun 03 01:42:27.347425 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:27.347393    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8k275"]
Jun 03 01:42:27.351066 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:42:27.351037    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8ea660a_c934_4cc5_9f78_bdf4b074ae84.slice/crio-981d9c1158238b5696cf5dca3b46425dd58823e7803dfd17a49638147acc493a WatchSource:0}: Error finding container 981d9c1158238b5696cf5dca3b46425dd58823e7803dfd17a49638147acc493a: Status 404 returned error can't find the container with id 981d9c1158238b5696cf5dca3b46425dd58823e7803dfd17a49638147acc493a
Jun 03 01:42:27.901636 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:27.901597    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k275" event={"ID":"f8ea660a-c934-4cc5-9f78-bdf4b074ae84","Type":"ContainerStarted","Data":"385248dfde0eaa31877192ba6e41cdfe98815e396381a65f0da7d8279b860eb8"}
Jun 03 01:42:27.901636 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:27.901636    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k275" event={"ID":"f8ea660a-c934-4cc5-9f78-bdf4b074ae84","Type":"ContainerStarted","Data":"981d9c1158238b5696cf5dca3b46425dd58823e7803dfd17a49638147acc493a"}
Jun 03 01:42:28.904845 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:28.904783    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k275" event={"ID":"f8ea660a-c934-4cc5-9f78-bdf4b074ae84","Type":"ContainerStarted","Data":"e6389bc97c3927a225a3cd38b49a1b8fe9f389cb5dd589d9ab456b4c04c94f4c"}
Jun 03 01:42:30.911936 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:30.911898    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8k275" event={"ID":"f8ea660a-c934-4cc5-9f78-bdf4b074ae84","Type":"ContainerStarted","Data":"fb5cf939c6f0d67e4c9ae1c5988f4b890a2e6b1874fca92af7aba95aacbcf70b"}
Jun 03 01:42:30.928938 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:30.928897    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8k275" podStartSLOduration=9.197190878 podStartE2EDuration="11.928884999s" podCreationTimestamp="2026-06-03 01:42:19 +0000 UTC" firstStartedPulling="2026-06-03 01:42:27.405704621 +0000 UTC m=+153.472295196" lastFinishedPulling="2026-06-03 01:42:30.137398738 +0000 UTC m=+156.203989317" observedRunningTime="2026-06-03 01:42:30.927410343 +0000 UTC m=+156.994000940" watchObservedRunningTime="2026-06-03 01:42:30.928884999 +0000 UTC m=+156.995475597"
Jun 03 01:42:31.320819 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:31.320735    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v" podUID="ba3954ce-9e0f-4878-b9b2-a393fef74854"
Jun 03 01:42:31.343971 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:31.343934    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr" podUID="c56524eb-c475-4a6d-9c5c-b98f23f521ed"
Jun 03 01:42:31.457200 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:31.457167    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-d6x6x" podUID="bf23fc51-f1a1-437d-8d16-b763938cd7ed"
Jun 03 01:42:31.463368 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:31.463343    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gnbxx" podUID="0986221d-f836-4f45-983e-f6aa7b4b7b1d"
Jun 03 01:42:31.467535 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:42:31.467509    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-f9b9x" podUID="681b8472-6edf-4780-8b1e-4621ebfa1772"
Jun 03 01:42:31.914209 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:31.914182    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:42:31.914636 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:31.914191    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:42:31.914636 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:31.914191    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:42:36.301719 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.301683    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:42:36.304120 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.304090    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ba3954ce-9e0f-4878-b9b2-a393fef74854-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-7rc7v\" (UID: \"ba3954ce-9e0f-4878-b9b2-a393fef74854\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:42:36.403033 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.402994    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:42:36.403180 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.403072    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:42:36.405485 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.405444    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls\") pod \"image-registry-68d7cd6ff5-b2vnr\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") " pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:42:36.405588 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.405495    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bf23fc51-f1a1-437d-8d16-b763938cd7ed-metrics-tls\") pod \"dns-default-d6x6x\" (UID: \"bf23fc51-f1a1-437d-8d16-b763938cd7ed\") " pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:42:36.417827 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.417804    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pbbkv\""
Jun 03 01:42:36.417925 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.417814    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2xcbn\""
Jun 03 01:42:36.417925 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.417897    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7lnrl\""
Jun 03 01:42:36.425031 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.425003    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:42:36.425121 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.425041    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:42:36.425121 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.425008    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"
Jun 03 01:42:36.504029 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.503953    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:42:36.508507 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.508329    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/681b8472-6edf-4780-8b1e-4621ebfa1772-cert\") pod \"ingress-canary-f9b9x\" (UID: \"681b8472-6edf-4780-8b1e-4621ebfa1772\") " pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:42:36.564010 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.563944    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v"]
Jun 03 01:42:36.568109 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:42:36.568082    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba3954ce_9e0f_4878_b9b2_a393fef74854.slice/crio-a4a0dc47e7b8eca495ebae3e48240c0cce5ecf1288ebf1e9b3e1a0367b832a82 WatchSource:0}: Error finding container a4a0dc47e7b8eca495ebae3e48240c0cce5ecf1288ebf1e9b3e1a0367b832a82: Status 404 returned error can't find the container with id a4a0dc47e7b8eca495ebae3e48240c0cce5ecf1288ebf1e9b3e1a0367b832a82
Jun 03 01:42:36.584226 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.584197    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"]
Jun 03 01:42:36.587059 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:42:36.587033    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc56524eb_c475_4a6d_9c5c_b98f23f521ed.slice/crio-95012564e7b97bbd5ff99eeb136efdcdd73cd7bb5c40f428991b46ca4f1cdb89 WatchSource:0}: Error finding container 95012564e7b97bbd5ff99eeb136efdcdd73cd7bb5c40f428991b46ca4f1cdb89: Status 404 returned error can't find the container with id 95012564e7b97bbd5ff99eeb136efdcdd73cd7bb5c40f428991b46ca4f1cdb89
Jun 03 01:42:36.599798 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.599775    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d6x6x"]
Jun 03 01:42:36.602924 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:42:36.602903    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf23fc51_f1a1_437d_8d16_b763938cd7ed.slice/crio-b55029ec6f59163c77fad93509366e3cbefbfbadd6b6134e59b8a3162ec1a624 WatchSource:0}: Error finding container b55029ec6f59163c77fad93509366e3cbefbfbadd6b6134e59b8a3162ec1a624: Status 404 returned error can't find the container with id b55029ec6f59163c77fad93509366e3cbefbfbadd6b6134e59b8a3162ec1a624
Jun 03 01:42:36.927350 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.927317    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v" event={"ID":"ba3954ce-9e0f-4878-b9b2-a393fef74854","Type":"ContainerStarted","Data":"a4a0dc47e7b8eca495ebae3e48240c0cce5ecf1288ebf1e9b3e1a0367b832a82"}
Jun 03 01:42:36.928550 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.928522    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr" event={"ID":"c56524eb-c475-4a6d-9c5c-b98f23f521ed","Type":"ContainerStarted","Data":"e638b5340b979637800e6c4c7c00e12b6e6f49945f911eff6231c8dabe19e8bf"}
Jun 03 01:42:36.928690 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.928558    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr" event={"ID":"c56524eb-c475-4a6d-9c5c-b98f23f521ed","Type":"ContainerStarted","Data":"95012564e7b97bbd5ff99eeb136efdcdd73cd7bb5c40f428991b46ca4f1cdb89"}
Jun 03 01:42:36.928690 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.928649    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:42:36.929522 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.929501    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d6x6x" event={"ID":"bf23fc51-f1a1-437d-8d16-b763938cd7ed","Type":"ContainerStarted","Data":"b55029ec6f59163c77fad93509366e3cbefbfbadd6b6134e59b8a3162ec1a624"}
Jun 03 01:42:36.948425 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:36.948384    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr" podStartSLOduration=162.948372002 podStartE2EDuration="2m42.948372002s" podCreationTimestamp="2026-06-03 01:39:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:42:36.947490252 +0000 UTC m=+163.014080846" watchObservedRunningTime="2026-06-03 01:42:36.948372002 +0000 UTC m=+163.014962600"
Jun 03 01:42:38.940326 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:38.940292    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d6x6x" event={"ID":"bf23fc51-f1a1-437d-8d16-b763938cd7ed","Type":"ContainerStarted","Data":"e25bcd542db06d20fc2f4f706f102088ae14d63afcc45bd32611bbf6daef7972"}
Jun 03 01:42:38.940326 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:38.940327    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d6x6x" event={"ID":"bf23fc51-f1a1-437d-8d16-b763938cd7ed","Type":"ContainerStarted","Data":"ef0a3df43816150fbfb205063ffa7b52c93349b0d4fe94a40d93312c0cfa7ebc"}
Jun 03 01:42:38.940823 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:38.940451    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:42:38.941624 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:38.941604    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v" event={"ID":"ba3954ce-9e0f-4878-b9b2-a393fef74854","Type":"ContainerStarted","Data":"19a6d8b4c1068abb2feb42df8a3771afb0a0388ca645c097003f257f09652a1f"}
Jun 03 01:42:38.956793 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:38.956752    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-d6x6x" podStartSLOduration=129.243585658 podStartE2EDuration="2m10.956740943s" podCreationTimestamp="2026-06-03 01:40:28 +0000 UTC" firstStartedPulling="2026-06-03 01:42:36.604594444 +0000 UTC m=+162.671185036" lastFinishedPulling="2026-06-03 01:42:38.317749728 +0000 UTC m=+164.384340321" observedRunningTime="2026-06-03 01:42:38.956058428 +0000 UTC m=+165.022649029" watchObservedRunningTime="2026-06-03 01:42:38.956740943 +0000 UTC m=+165.023331534"
Jun 03 01:42:38.973035 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:38.973000    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-7rc7v" podStartSLOduration=146.230007839 podStartE2EDuration="2m27.972992695s" podCreationTimestamp="2026-06-03 01:40:11 +0000 UTC" firstStartedPulling="2026-06-03 01:42:36.571241515 +0000 UTC m=+162.637832093" lastFinishedPulling="2026-06-03 01:42:38.314226369 +0000 UTC m=+164.380816949" observedRunningTime="2026-06-03 01:42:38.971706436 +0000 UTC m=+165.038297047" watchObservedRunningTime="2026-06-03 01:42:38.972992695 +0000 UTC m=+165.039583293"
Jun 03 01:42:41.636340 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:41.636292    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66" podUID="10870f57-4a1c-4a12-905b-138781740b9c" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused"
Jun 03 01:42:41.951682 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:41.951648    2575 generic.go:358] "Generic (PLEG): container finished" podID="85217631-6981-4ac9-8ef3-284c1754740e" containerID="a018b41efabecfbcd65046db0cabaecfb22058327cc893be1265789ecab3f0bf" exitCode=255
Jun 03 01:42:41.951857 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:41.951720    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds" event={"ID":"85217631-6981-4ac9-8ef3-284c1754740e","Type":"ContainerDied","Data":"a018b41efabecfbcd65046db0cabaecfb22058327cc893be1265789ecab3f0bf"}
Jun 03 01:42:41.952076 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:41.952055    2575 scope.go:117] "RemoveContainer" containerID="a018b41efabecfbcd65046db0cabaecfb22058327cc893be1265789ecab3f0bf"
Jun 03 01:42:41.953175 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:41.953153    2575 generic.go:358] "Generic (PLEG): container finished" podID="10870f57-4a1c-4a12-905b-138781740b9c" containerID="2a26c0cc8ce9a33b0d16450fae9e5076215f3cf16efb6cf455c8c1d6f9fd8e41" exitCode=1
Jun 03 01:42:41.953261 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:41.953182    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66" event={"ID":"10870f57-4a1c-4a12-905b-138781740b9c","Type":"ContainerDied","Data":"2a26c0cc8ce9a33b0d16450fae9e5076215f3cf16efb6cf455c8c1d6f9fd8e41"}
Jun 03 01:42:41.953544 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:41.953521    2575 scope.go:117] "RemoveContainer" containerID="2a26c0cc8ce9a33b0d16450fae9e5076215f3cf16efb6cf455c8c1d6f9fd8e41"
Jun 03 01:42:42.957488 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:42.957434    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d54f7f59d-b4lds" event={"ID":"85217631-6981-4ac9-8ef3-284c1754740e","Type":"ContainerStarted","Data":"8a71a321f05f7979c268f71229a6d240d38dddf0b68675619e2352e98a333e5d"}
Jun 03 01:42:42.958985 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:42.958964    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66" event={"ID":"10870f57-4a1c-4a12-905b-138781740b9c","Type":"ContainerStarted","Data":"a9e86b5d97e430cf9932954f93c5ad43fb60a63852dc4f5f7b47864f134f87ef"}
Jun 03 01:42:42.959200 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:42.959184    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:42:42.959798 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:42.959779    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685f47c984-tjw66"
Jun 03 01:42:43.408976 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:43.408894    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:42:43.411880 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:43.411865    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tsbnv\""
Jun 03 01:42:43.419780 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:43.419764    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f9b9x"
Jun 03 01:42:43.539554 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:43.539523    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f9b9x"]
Jun 03 01:42:43.542691 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:42:43.542667    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681b8472_6edf_4780_8b1e_4621ebfa1772.slice/crio-f3ef16aa47c8cac19e866466ed735e5fe522049dba231d8bb2dd15ce11945b7e WatchSource:0}: Error finding container f3ef16aa47c8cac19e866466ed735e5fe522049dba231d8bb2dd15ce11945b7e: Status 404 returned error can't find the container with id f3ef16aa47c8cac19e866466ed735e5fe522049dba231d8bb2dd15ce11945b7e
Jun 03 01:42:43.966943 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:43.966907    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f9b9x" event={"ID":"681b8472-6edf-4780-8b1e-4621ebfa1772","Type":"ContainerStarted","Data":"f3ef16aa47c8cac19e866466ed735e5fe522049dba231d8bb2dd15ce11945b7e"}
Jun 03 01:42:44.411237 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:44.411182    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:42:45.972707 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:45.972676    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f9b9x" event={"ID":"681b8472-6edf-4780-8b1e-4621ebfa1772","Type":"ContainerStarted","Data":"471831d4989b81a262e29c08f4f9927b54c928e7fcfc36e6646807effd6fd42c"}
Jun 03 01:42:45.987752 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:45.987711    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f9b9x" podStartSLOduration=136.088413939 podStartE2EDuration="2m17.987697788s" podCreationTimestamp="2026-06-03 01:40:28 +0000 UTC" firstStartedPulling="2026-06-03 01:42:43.544575237 +0000 UTC m=+169.611165814" lastFinishedPulling="2026-06-03 01:42:45.443859087 +0000 UTC m=+171.510449663" observedRunningTime="2026-06-03 01:42:45.98704297 +0000 UTC m=+172.053633569" watchObservedRunningTime="2026-06-03 01:42:45.987697788 +0000 UTC m=+172.054288389"
Jun 03 01:42:48.946215 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:48.946182    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d6x6x"
Jun 03 01:42:49.566429 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.566402    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ssqrd"]
Jun 03 01:42:49.569567 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.569550    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.571855 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.571831    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f77s6\""
Jun 03 01:42:49.571985 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.571885    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 03 01:42:49.571985 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.571885    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 03 01:42:49.571985 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.571914    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 03 01:42:49.572684 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.572663    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 03 01:42:49.572684 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.572675    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 03 01:42:49.572844 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.572723    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 03 01:42:49.609927 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.609898    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.609927 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.609931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-textfile\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.610109 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.609947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7e20e00-2d75-4eac-81ce-8174e1708cf5-metrics-client-ca\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.610109 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.609967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2r9t\" (UniqueName: \"kubernetes.io/projected/f7e20e00-2d75-4eac-81ce-8174e1708cf5-kube-api-access-c2r9t\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.610109 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.610012    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-tls\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.610109 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.610077    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-accelerators-collector-config\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.610109 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.610100    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f7e20e00-2d75-4eac-81ce-8174e1708cf5-root\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.610263 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.610130    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7e20e00-2d75-4eac-81ce-8174e1708cf5-sys\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.610263 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.610149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-wtmp\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.711780 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.711742    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-tls\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.711966 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.711871    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-accelerators-collector-config\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.711966 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.711914    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f7e20e00-2d75-4eac-81ce-8174e1708cf5-root\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.712067 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.711965    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7e20e00-2d75-4eac-81ce-8174e1708cf5-sys\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.712067 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.711997    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-wtmp\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.712067 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.712061    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.712208 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.712106    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-textfile\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.712208 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.712136    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7e20e00-2d75-4eac-81ce-8174e1708cf5-metrics-client-ca\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.712208 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.712168    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2r9t\" (UniqueName: \"kubernetes.io/projected/f7e20e00-2d75-4eac-81ce-8174e1708cf5-kube-api-access-c2r9t\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.712690 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.712660    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-wtmp\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.712924 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.712898    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-textfile\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.713279 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.713252    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-accelerators-collector-config\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.713365 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.713348    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f7e20e00-2d75-4eac-81ce-8174e1708cf5-root\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.713434 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.713406    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7e20e00-2d75-4eac-81ce-8174e1708cf5-sys\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.713672 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.713648    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7e20e00-2d75-4eac-81ce-8174e1708cf5-metrics-client-ca\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.714963 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.714935    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-tls\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.715435 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.715403    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7e20e00-2d75-4eac-81ce-8174e1708cf5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.719650 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.719631    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2r9t\" (UniqueName: \"kubernetes.io/projected/f7e20e00-2d75-4eac-81ce-8174e1708cf5-kube-api-access-c2r9t\") pod \"node-exporter-ssqrd\" (UID: \"f7e20e00-2d75-4eac-81ce-8174e1708cf5\") " pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.878527 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.878429    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ssqrd"
Jun 03 01:42:49.886789 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:42:49.886763    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e20e00_2d75_4eac_81ce_8174e1708cf5.slice/crio-90e129de057c1d015e85f093eec304bf1aea252671202ec8b8d629e6640bf34b WatchSource:0}: Error finding container 90e129de057c1d015e85f093eec304bf1aea252671202ec8b8d629e6640bf34b: Status 404 returned error can't find the container with id 90e129de057c1d015e85f093eec304bf1aea252671202ec8b8d629e6640bf34b
Jun 03 01:42:49.984451 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:49.984417    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ssqrd" event={"ID":"f7e20e00-2d75-4eac-81ce-8174e1708cf5","Type":"ContainerStarted","Data":"90e129de057c1d015e85f093eec304bf1aea252671202ec8b8d629e6640bf34b"}
Jun 03 01:42:50.988691 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:50.988614    2575 generic.go:358] "Generic (PLEG): container finished" podID="f7e20e00-2d75-4eac-81ce-8174e1708cf5" containerID="5da60b8b73337dca3cb0f04722512fdd27f27f7f1de2dee86c0789d6cbde74fe" exitCode=0
Jun 03 01:42:50.988691 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:50.988675    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ssqrd" event={"ID":"f7e20e00-2d75-4eac-81ce-8174e1708cf5","Type":"ContainerDied","Data":"5da60b8b73337dca3cb0f04722512fdd27f27f7f1de2dee86c0789d6cbde74fe"}
Jun 03 01:42:51.993024 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:51.992994    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ssqrd" event={"ID":"f7e20e00-2d75-4eac-81ce-8174e1708cf5","Type":"ContainerStarted","Data":"7aae47e92c28ea8d62bf7ae5895c6394bc45a6f19a079e2a9645140ccb65f2e7"}
Jun 03 01:42:51.993024 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:51.993027    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ssqrd" event={"ID":"f7e20e00-2d75-4eac-81ce-8174e1708cf5","Type":"ContainerStarted","Data":"dd1a1d4ffa3fe50b259e42ecfb79e5716a6cb67622f88702bc5264d02fa5a973"}
Jun 03 01:42:56.429273 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:56.429235    2575 patch_prober.go:28] interesting pod/image-registry-68d7cd6ff5-b2vnr container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jun 03 01:42:56.429646 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:56.429292    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr" podUID="c56524eb-c475-4a6d-9c5c-b98f23f521ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 01:42:57.937084 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:57.937055    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:42:57.970992 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:42:57.970949    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ssqrd" podStartSLOduration=8.16677046 podStartE2EDuration="8.97093494s" podCreationTimestamp="2026-06-03 01:42:49 +0000 UTC" firstStartedPulling="2026-06-03 01:42:49.888399032 +0000 UTC m=+175.954989608" lastFinishedPulling="2026-06-03 01:42:50.692563508 +0000 UTC m=+176.759154088" observedRunningTime="2026-06-03 01:42:52.012134618 +0000 UTC m=+178.078725216" watchObservedRunningTime="2026-06-03 01:42:57.97093494 +0000 UTC m=+184.037525538"
Jun 03 01:43:03.635919 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:03.635887    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"]
Jun 03 01:43:18.726452 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:18.726413    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk" podUID="2397fe7d-5bcc-4561-9bfb-ae68be0bd91e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 03 01:43:28.655361 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.655295    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr" podUID="c56524eb-c475-4a6d-9c5c-b98f23f521ed" containerName="registry" containerID="cri-o://e638b5340b979637800e6c4c7c00e12b6e6f49945f911eff6231c8dabe19e8bf" gracePeriod=30
Jun 03 01:43:28.726029 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.725997    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk" podUID="2397fe7d-5bcc-4561-9bfb-ae68be0bd91e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 03 01:43:28.899846 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.899825    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:43:28.989790 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.989758    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c56524eb-c475-4a6d-9c5c-b98f23f521ed-installation-pull-secrets\") pod \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") "
Jun 03 01:43:28.989790 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.989793    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls\") pod \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") "
Jun 03 01:43:28.989985 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.989820    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l476c\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-kube-api-access-l476c\") pod \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") "
Jun 03 01:43:28.989985 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.989838    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c56524eb-c475-4a6d-9c5c-b98f23f521ed-ca-trust-extracted\") pod \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") "
Jun 03 01:43:28.989985 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.989912    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-certificates\") pod \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") "
Jun 03 01:43:28.989985 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.989968    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c56524eb-c475-4a6d-9c5c-b98f23f521ed-image-registry-private-configuration\") pod \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") "
Jun 03 01:43:28.990168 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.989995    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-bound-sa-token\") pod \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") "
Jun 03 01:43:28.990168 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.990063    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c56524eb-c475-4a6d-9c5c-b98f23f521ed-trusted-ca\") pod \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\" (UID: \"c56524eb-c475-4a6d-9c5c-b98f23f521ed\") "
Jun 03 01:43:28.990551 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.990377    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c56524eb-c475-4a6d-9c5c-b98f23f521ed" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:43:28.990835 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.990796    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c56524eb-c475-4a6d-9c5c-b98f23f521ed-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c56524eb-c475-4a6d-9c5c-b98f23f521ed" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:43:28.992444 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.992412    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c56524eb-c475-4a6d-9c5c-b98f23f521ed-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c56524eb-c475-4a6d-9c5c-b98f23f521ed" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:43:28.992669 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.992456    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c56524eb-c475-4a6d-9c5c-b98f23f521ed" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:43:28.992738 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.992702    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c56524eb-c475-4a6d-9c5c-b98f23f521ed" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:43:28.992789 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.992755    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c56524eb-c475-4a6d-9c5c-b98f23f521ed-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c56524eb-c475-4a6d-9c5c-b98f23f521ed" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:43:28.992928 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.992910    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-kube-api-access-l476c" (OuterVolumeSpecName: "kube-api-access-l476c") pod "c56524eb-c475-4a6d-9c5c-b98f23f521ed" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed"). InnerVolumeSpecName "kube-api-access-l476c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:43:28.999003 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:28.998982    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c56524eb-c475-4a6d-9c5c-b98f23f521ed-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c56524eb-c475-4a6d-9c5c-b98f23f521ed" (UID: "c56524eb-c475-4a6d-9c5c-b98f23f521ed"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 01:43:29.087454 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.087416    2575 generic.go:358] "Generic (PLEG): container finished" podID="c56524eb-c475-4a6d-9c5c-b98f23f521ed" containerID="e638b5340b979637800e6c4c7c00e12b6e6f49945f911eff6231c8dabe19e8bf" exitCode=0
Jun 03 01:43:29.087584 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.087500    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"
Jun 03 01:43:29.087584 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.087506    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr" event={"ID":"c56524eb-c475-4a6d-9c5c-b98f23f521ed","Type":"ContainerDied","Data":"e638b5340b979637800e6c4c7c00e12b6e6f49945f911eff6231c8dabe19e8bf"}
Jun 03 01:43:29.087584 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.087549    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d7cd6ff5-b2vnr" event={"ID":"c56524eb-c475-4a6d-9c5c-b98f23f521ed","Type":"ContainerDied","Data":"95012564e7b97bbd5ff99eeb136efdcdd73cd7bb5c40f428991b46ca4f1cdb89"}
Jun 03 01:43:29.087584 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.087564    2575 scope.go:117] "RemoveContainer" containerID="e638b5340b979637800e6c4c7c00e12b6e6f49945f911eff6231c8dabe19e8bf"
Jun 03 01:43:29.090648 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.090624    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l476c\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-kube-api-access-l476c\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:43:29.090747 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.090650    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c56524eb-c475-4a6d-9c5c-b98f23f521ed-ca-trust-extracted\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:43:29.090747 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.090667    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-certificates\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:43:29.090747 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.090683    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c56524eb-c475-4a6d-9c5c-b98f23f521ed-image-registry-private-configuration\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:43:29.090747 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.090699    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-bound-sa-token\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:43:29.090747 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.090713    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c56524eb-c475-4a6d-9c5c-b98f23f521ed-trusted-ca\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:43:29.090747 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.090727    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c56524eb-c475-4a6d-9c5c-b98f23f521ed-installation-pull-secrets\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:43:29.090747 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.090741    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c56524eb-c475-4a6d-9c5c-b98f23f521ed-registry-tls\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:43:29.095253 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.095236    2575 scope.go:117] "RemoveContainer" containerID="e638b5340b979637800e6c4c7c00e12b6e6f49945f911eff6231c8dabe19e8bf"
Jun 03 01:43:29.095527 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:43:29.095505    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e638b5340b979637800e6c4c7c00e12b6e6f49945f911eff6231c8dabe19e8bf\": container with ID starting with e638b5340b979637800e6c4c7c00e12b6e6f49945f911eff6231c8dabe19e8bf not found: ID does not exist" containerID="e638b5340b979637800e6c4c7c00e12b6e6f49945f911eff6231c8dabe19e8bf"
Jun 03 01:43:29.095599 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.095537    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e638b5340b979637800e6c4c7c00e12b6e6f49945f911eff6231c8dabe19e8bf"} err="failed to get container status \"e638b5340b979637800e6c4c7c00e12b6e6f49945f911eff6231c8dabe19e8bf\": rpc error: code = NotFound desc = could not find container \"e638b5340b979637800e6c4c7c00e12b6e6f49945f911eff6231c8dabe19e8bf\": container with ID starting with e638b5340b979637800e6c4c7c00e12b6e6f49945f911eff6231c8dabe19e8bf not found: ID does not exist"
Jun 03 01:43:29.106865 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.106845    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"]
Jun 03 01:43:29.110581 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:29.110564    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68d7cd6ff5-b2vnr"]
Jun 03 01:43:30.412606 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:30.412577    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c56524eb-c475-4a6d-9c5c-b98f23f521ed" path="/var/lib/kubelet/pods/c56524eb-c475-4a6d-9c5c-b98f23f521ed/volumes"
Jun 03 01:43:38.726922 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:38.726877    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk" podUID="2397fe7d-5bcc-4561-9bfb-ae68be0bd91e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 03 01:43:38.727496 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:38.726972    2575 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk"
Jun 03 01:43:38.727626 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:38.727604    2575 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"642de880e6963ac9cba1dca85b4ab949a8ac34ea28de0298c555a2e45877a403"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jun 03 01:43:38.727690 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:38.727656    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk" podUID="2397fe7d-5bcc-4561-9bfb-ae68be0bd91e" containerName="service-proxy" containerID="cri-o://642de880e6963ac9cba1dca85b4ab949a8ac34ea28de0298c555a2e45877a403" gracePeriod=30
Jun 03 01:43:39.114496 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:39.114387    2575 generic.go:358] "Generic (PLEG): container finished" podID="2397fe7d-5bcc-4561-9bfb-ae68be0bd91e" containerID="642de880e6963ac9cba1dca85b4ab949a8ac34ea28de0298c555a2e45877a403" exitCode=2
Jun 03 01:43:39.114496 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:39.114431    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk" event={"ID":"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e","Type":"ContainerDied","Data":"642de880e6963ac9cba1dca85b4ab949a8ac34ea28de0298c555a2e45877a403"}
Jun 03 01:43:39.114496 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:43:39.114463    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b5864df69-5n5pk" event={"ID":"2397fe7d-5bcc-4561-9bfb-ae68be0bd91e","Type":"ContainerStarted","Data":"058db4a54a217a8a4db6c36e7416e67ebabaafc2f96e9a37ba2d73d6e064fcee"}
Jun 03 01:44:06.272716 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:44:06.272673    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:44:06.275084 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:44:06.275060    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0986221d-f836-4f45-983e-f6aa7b4b7b1d-metrics-certs\") pod \"network-metrics-daemon-gnbxx\" (UID: \"0986221d-f836-4f45-983e-f6aa7b4b7b1d\") " pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:44:06.314602 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:44:06.314571    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sx8gm\""
Jun 03 01:44:06.322534 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:44:06.322510    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gnbxx"
Jun 03 01:44:06.447212 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:44:06.447181    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gnbxx"]
Jun 03 01:44:06.450220 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:44:06.450191    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0986221d_f836_4f45_983e_f6aa7b4b7b1d.slice/crio-4fa2b06ec6ce7209fd89d4c35706cb07ae299d2ffe49eabc76d09f8a16203aa7 WatchSource:0}: Error finding container 4fa2b06ec6ce7209fd89d4c35706cb07ae299d2ffe49eabc76d09f8a16203aa7: Status 404 returned error can't find the container with id 4fa2b06ec6ce7209fd89d4c35706cb07ae299d2ffe49eabc76d09f8a16203aa7
Jun 03 01:44:07.184757 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:44:07.184707    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnbxx" event={"ID":"0986221d-f836-4f45-983e-f6aa7b4b7b1d","Type":"ContainerStarted","Data":"4fa2b06ec6ce7209fd89d4c35706cb07ae299d2ffe49eabc76d09f8a16203aa7"}
Jun 03 01:44:08.188736 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:44:08.188698    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnbxx" event={"ID":"0986221d-f836-4f45-983e-f6aa7b4b7b1d","Type":"ContainerStarted","Data":"fb49e46142da255be5b99770da592e2f25f762bb711c1ea906ec2fc8d491cc4b"}
Jun 03 01:44:08.188736 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:44:08.188740    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gnbxx" event={"ID":"0986221d-f836-4f45-983e-f6aa7b4b7b1d","Type":"ContainerStarted","Data":"14e4f706880d0ad55668f3a66e88bb8b8264462eefbb8184afe36bdcb4c4517d"}
Jun 03 01:44:08.206181 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:44:08.206136    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gnbxx" podStartSLOduration=253.157618119 podStartE2EDuration="4m14.206124122s" podCreationTimestamp="2026-06-03 01:39:54 +0000 UTC" firstStartedPulling="2026-06-03 01:44:06.452081278 +0000 UTC m=+252.518671853" lastFinishedPulling="2026-06-03 01:44:07.50058728 +0000 UTC m=+253.567177856" observedRunningTime="2026-06-03 01:44:08.204916527 +0000 UTC m=+254.271507125" watchObservedRunningTime="2026-06-03 01:44:08.206124122 +0000 UTC m=+254.272714744"
Jun 03 01:44:54.361590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:44:54.361565    2575 kubelet.go:1628] "Image garbage collection succeeded"
Jun 03 01:46:05.299619 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.299533    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"]
Jun 03 01:46:05.300235 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.299847    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c56524eb-c475-4a6d-9c5c-b98f23f521ed" containerName="registry"
Jun 03 01:46:05.300235 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.299863    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c56524eb-c475-4a6d-9c5c-b98f23f521ed" containerName="registry"
Jun 03 01:46:05.300235 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.299933    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="c56524eb-c475-4a6d-9c5c-b98f23f521ed" containerName="registry"
Jun 03 01:46:05.302898 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.302878    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.306258 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.306239    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 03 01:46:05.306342 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.306239    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 03 01:46:05.306958 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.306943    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6wj9t\""
Jun 03 01:46:05.307047 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.307030    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 03 01:46:05.307217 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.307203    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 03 01:46:05.319351 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.319318    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"]
Jun 03 01:46:05.392868 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.392831    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.393051 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.392881    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-tmp\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.393051 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.392941    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-manifests\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.393051 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.392986    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m27c4\" (UniqueName: \"kubernetes.io/projected/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-kube-api-access-m27c4\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.393051 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.393008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.494365 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.494332    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.494365 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.494367    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-tmp\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.494645 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.494384    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-manifests\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.494645 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.494417    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m27c4\" (UniqueName: \"kubernetes.io/projected/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-kube-api-access-m27c4\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.494645 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.494445    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.494804 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.494784    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-manifests\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.496914 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.496883    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-tmp\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.497045 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.497000    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.497187 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.497167    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.508499 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.508460    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m27c4\" (UniqueName: \"kubernetes.io/projected/79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f-kube-api-access-m27c4\") pod \"opendatahub-operator-controller-manager-f9cd4ffb9-884f5\" (UID: \"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f\") " pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.612641 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.612551    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:05.743145 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.743111    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"]
Jun 03 01:46:05.746176 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:46:05.746147    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d6fbbd_8f8a_4fde_89b6_d5d477cdce3f.slice/crio-692114cda81d0fd4132560da8072fafe77b3b1b3ca94002c2bd0372fa09c92bc WatchSource:0}: Error finding container 692114cda81d0fd4132560da8072fafe77b3b1b3ca94002c2bd0372fa09c92bc: Status 404 returned error can't find the container with id 692114cda81d0fd4132560da8072fafe77b3b1b3ca94002c2bd0372fa09c92bc
Jun 03 01:46:05.747783 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:05.747764    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 01:46:06.482078 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:06.482035    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5" event={"ID":"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f","Type":"ContainerStarted","Data":"692114cda81d0fd4132560da8072fafe77b3b1b3ca94002c2bd0372fa09c92bc"}
Jun 03 01:46:09.492717 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:09.492678    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5" event={"ID":"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f","Type":"ContainerStarted","Data":"de560fb2d4d259ff524a1ab9e6a69e699b6c8ec7141743208f54672f7f85f397"}
Jun 03 01:46:10.496779 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:10.496744    2575 generic.go:358] "Generic (PLEG): container finished" podID="79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f" containerID="de560fb2d4d259ff524a1ab9e6a69e699b6c8ec7141743208f54672f7f85f397" exitCode=0
Jun 03 01:46:10.497131 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:10.496810    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5" event={"ID":"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f","Type":"ContainerDied","Data":"de560fb2d4d259ff524a1ab9e6a69e699b6c8ec7141743208f54672f7f85f397"}
Jun 03 01:46:11.501050 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:11.501016    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5" event={"ID":"79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f","Type":"ContainerStarted","Data":"c2db3846951f98f7e077005e910bb6bc118b952bd9de2ac466d5b129015cd456"}
Jun 03 01:46:11.501541 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:11.501178    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:11.523111 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:11.523063    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5" podStartSLOduration=1.462607608 podStartE2EDuration="6.523049469s" podCreationTimestamp="2026-06-03 01:46:05 +0000 UTC" firstStartedPulling="2026-06-03 01:46:05.747890122 +0000 UTC m=+371.814480700" lastFinishedPulling="2026-06-03 01:46:10.808331971 +0000 UTC m=+376.874922561" observedRunningTime="2026-06-03 01:46:11.521222536 +0000 UTC m=+377.587813135" watchObservedRunningTime="2026-06-03 01:46:11.523049469 +0000 UTC m=+377.589640063"
Jun 03 01:46:22.505721 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:22.505687    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f9cd4ffb9-884f5"
Jun 03 01:46:23.860117 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:23.860085    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"]
Jun 03 01:46:23.867816 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:23.867793    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:23.870407 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:23.870382    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 03 01:46:23.870535 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:23.870417    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jun 03 01:46:23.871497 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:23.871462    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-npgp5\""
Jun 03 01:46:23.871610 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:23.871558    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jun 03 01:46:23.871610 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:23.871583    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 03 01:46:23.871610 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:23.871601    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jun 03 01:46:23.875102 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:23.875085    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"]
Jun 03 01:46:23.927554 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:23.927518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3bd324c-791c-4973-ab35-1d4254773892-metrics-cert\") pod \"lws-controller-manager-7bc87d8b78-dmqvr\" (UID: \"e3bd324c-791c-4973-ab35-1d4254773892\") " pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:23.927694 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:23.927577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e3bd324c-791c-4973-ab35-1d4254773892-manager-config\") pod \"lws-controller-manager-7bc87d8b78-dmqvr\" (UID: \"e3bd324c-791c-4973-ab35-1d4254773892\") " pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:23.927694 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:23.927619    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7smvn\" (UniqueName: \"kubernetes.io/projected/e3bd324c-791c-4973-ab35-1d4254773892-kube-api-access-7smvn\") pod \"lws-controller-manager-7bc87d8b78-dmqvr\" (UID: \"e3bd324c-791c-4973-ab35-1d4254773892\") " pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:23.927694 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:23.927681    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3bd324c-791c-4973-ab35-1d4254773892-cert\") pod \"lws-controller-manager-7bc87d8b78-dmqvr\" (UID: \"e3bd324c-791c-4973-ab35-1d4254773892\") " pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:24.028275 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.028240    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3bd324c-791c-4973-ab35-1d4254773892-metrics-cert\") pod \"lws-controller-manager-7bc87d8b78-dmqvr\" (UID: \"e3bd324c-791c-4973-ab35-1d4254773892\") " pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:24.028454 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.028293    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e3bd324c-791c-4973-ab35-1d4254773892-manager-config\") pod \"lws-controller-manager-7bc87d8b78-dmqvr\" (UID: \"e3bd324c-791c-4973-ab35-1d4254773892\") " pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:24.028454 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.028311    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7smvn\" (UniqueName: \"kubernetes.io/projected/e3bd324c-791c-4973-ab35-1d4254773892-kube-api-access-7smvn\") pod \"lws-controller-manager-7bc87d8b78-dmqvr\" (UID: \"e3bd324c-791c-4973-ab35-1d4254773892\") " pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:24.028454 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.028332    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3bd324c-791c-4973-ab35-1d4254773892-cert\") pod \"lws-controller-manager-7bc87d8b78-dmqvr\" (UID: \"e3bd324c-791c-4973-ab35-1d4254773892\") " pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:24.028986 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.028954    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e3bd324c-791c-4973-ab35-1d4254773892-manager-config\") pod \"lws-controller-manager-7bc87d8b78-dmqvr\" (UID: \"e3bd324c-791c-4973-ab35-1d4254773892\") " pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:24.030843 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.030822    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e3bd324c-791c-4973-ab35-1d4254773892-cert\") pod \"lws-controller-manager-7bc87d8b78-dmqvr\" (UID: \"e3bd324c-791c-4973-ab35-1d4254773892\") " pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:24.030924 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.030877    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3bd324c-791c-4973-ab35-1d4254773892-metrics-cert\") pod \"lws-controller-manager-7bc87d8b78-dmqvr\" (UID: \"e3bd324c-791c-4973-ab35-1d4254773892\") " pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:24.058595 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.058569    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7smvn\" (UniqueName: \"kubernetes.io/projected/e3bd324c-791c-4973-ab35-1d4254773892-kube-api-access-7smvn\") pod \"lws-controller-manager-7bc87d8b78-dmqvr\" (UID: \"e3bd324c-791c-4973-ab35-1d4254773892\") " pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:24.177504 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.177450    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:24.327072 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.327040    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"]
Jun 03 01:46:24.330860 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:46:24.330836    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3bd324c_791c_4973_ab35_1d4254773892.slice/crio-3ff4fe7dd21b33c15800042c913f9a05e50c857e0519c8e556689e9853595d50 WatchSource:0}: Error finding container 3ff4fe7dd21b33c15800042c913f9a05e50c857e0519c8e556689e9853595d50: Status 404 returned error can't find the container with id 3ff4fe7dd21b33c15800042c913f9a05e50c857e0519c8e556689e9853595d50
Jun 03 01:46:24.537322 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.537241    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr" event={"ID":"e3bd324c-791c-4973-ab35-1d4254773892","Type":"ContainerStarted","Data":"3ff4fe7dd21b33c15800042c913f9a05e50c857e0519c8e556689e9853595d50"}
Jun 03 01:46:24.924766 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.924736    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"]
Jun 03 01:46:24.927232 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.927217    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"
Jun 03 01:46:24.929547 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.929501    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 03 01:46:24.929660 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.929553    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8r42k\""
Jun 03 01:46:24.929660 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.929598    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 03 01:46:24.929660 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.929621    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 03 01:46:24.929924 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.929908    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 03 01:46:24.935828 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.935804    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn5sn\" (UniqueName: \"kubernetes.io/projected/26b8ec99-86f4-4518-880c-b4d1b15c0e70-kube-api-access-pn5sn\") pod \"kube-auth-proxy-889cb89c5-69lsj\" (UID: \"26b8ec99-86f4-4518-880c-b4d1b15c0e70\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"
Jun 03 01:46:24.935933 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.935869    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b8ec99-86f4-4518-880c-b4d1b15c0e70-tls-certs\") pod \"kube-auth-proxy-889cb89c5-69lsj\" (UID: \"26b8ec99-86f4-4518-880c-b4d1b15c0e70\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"
Jun 03 01:46:24.935980 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.935946    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26b8ec99-86f4-4518-880c-b4d1b15c0e70-tmp\") pod \"kube-auth-proxy-889cb89c5-69lsj\" (UID: \"26b8ec99-86f4-4518-880c-b4d1b15c0e70\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"
Jun 03 01:46:24.941089 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:24.941067    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"]
Jun 03 01:46:25.037086 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:25.037055    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b8ec99-86f4-4518-880c-b4d1b15c0e70-tls-certs\") pod \"kube-auth-proxy-889cb89c5-69lsj\" (UID: \"26b8ec99-86f4-4518-880c-b4d1b15c0e70\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"
Jun 03 01:46:25.037231 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:25.037100    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26b8ec99-86f4-4518-880c-b4d1b15c0e70-tmp\") pod \"kube-auth-proxy-889cb89c5-69lsj\" (UID: \"26b8ec99-86f4-4518-880c-b4d1b15c0e70\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"
Jun 03 01:46:25.037231 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:25.037136    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pn5sn\" (UniqueName: \"kubernetes.io/projected/26b8ec99-86f4-4518-880c-b4d1b15c0e70-kube-api-access-pn5sn\") pod \"kube-auth-proxy-889cb89c5-69lsj\" (UID: \"26b8ec99-86f4-4518-880c-b4d1b15c0e70\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"
Jun 03 01:46:25.037462 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:46:25.037440    2575 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jun 03 01:46:25.037581 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:46:25.037540    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26b8ec99-86f4-4518-880c-b4d1b15c0e70-tls-certs podName:26b8ec99-86f4-4518-880c-b4d1b15c0e70 nodeName:}" failed. No retries permitted until 2026-06-03 01:46:25.537517926 +0000 UTC m=+391.604108502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/26b8ec99-86f4-4518-880c-b4d1b15c0e70-tls-certs") pod "kube-auth-proxy-889cb89c5-69lsj" (UID: "26b8ec99-86f4-4518-880c-b4d1b15c0e70") : secret "kube-auth-proxy-tls" not found
Jun 03 01:46:25.039822 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:25.039795    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26b8ec99-86f4-4518-880c-b4d1b15c0e70-tmp\") pod \"kube-auth-proxy-889cb89c5-69lsj\" (UID: \"26b8ec99-86f4-4518-880c-b4d1b15c0e70\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"
Jun 03 01:46:25.045613 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:25.045573    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn5sn\" (UniqueName: \"kubernetes.io/projected/26b8ec99-86f4-4518-880c-b4d1b15c0e70-kube-api-access-pn5sn\") pod \"kube-auth-proxy-889cb89c5-69lsj\" (UID: \"26b8ec99-86f4-4518-880c-b4d1b15c0e70\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"
Jun 03 01:46:25.541801 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:25.541764    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b8ec99-86f4-4518-880c-b4d1b15c0e70-tls-certs\") pod \"kube-auth-proxy-889cb89c5-69lsj\" (UID: \"26b8ec99-86f4-4518-880c-b4d1b15c0e70\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"
Jun 03 01:46:25.544512 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:25.544453    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26b8ec99-86f4-4518-880c-b4d1b15c0e70-tls-certs\") pod \"kube-auth-proxy-889cb89c5-69lsj\" (UID: \"26b8ec99-86f4-4518-880c-b4d1b15c0e70\") " pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"
Jun 03 01:46:25.837400 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:25.837311    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"
Jun 03 01:46:26.898405 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:26.898380    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-889cb89c5-69lsj"]
Jun 03 01:46:26.901381 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:46:26.901352    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b8ec99_86f4_4518_880c_b4d1b15c0e70.slice/crio-8c71d198360181090786052ba26ac2ffe7a02fd22dec9794df8088be4e6d5840 WatchSource:0}: Error finding container 8c71d198360181090786052ba26ac2ffe7a02fd22dec9794df8088be4e6d5840: Status 404 returned error can't find the container with id 8c71d198360181090786052ba26ac2ffe7a02fd22dec9794df8088be4e6d5840
Jun 03 01:46:27.551267 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:27.549623    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj" event={"ID":"26b8ec99-86f4-4518-880c-b4d1b15c0e70","Type":"ContainerStarted","Data":"8c71d198360181090786052ba26ac2ffe7a02fd22dec9794df8088be4e6d5840"}
Jun 03 01:46:27.551464 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:27.551357    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr" event={"ID":"e3bd324c-791c-4973-ab35-1d4254773892","Type":"ContainerStarted","Data":"4eabcd62e2e119a381f98ae336335e153e5a5fe09592c8f4f36e3e106a58ed5a"}
Jun 03 01:46:27.551692 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:27.551674    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:46:27.568800 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:27.568747    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr" podStartSLOduration=2.065402257 podStartE2EDuration="4.568733928s" podCreationTimestamp="2026-06-03 01:46:23 +0000 UTC" firstStartedPulling="2026-06-03 01:46:24.332975747 +0000 UTC m=+390.399566324" lastFinishedPulling="2026-06-03 01:46:26.836307401 +0000 UTC m=+392.902897995" observedRunningTime="2026-06-03 01:46:27.566620785 +0000 UTC m=+393.633211387" watchObservedRunningTime="2026-06-03 01:46:27.568733928 +0000 UTC m=+393.635324526"
Jun 03 01:46:29.557983 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:29.557953    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj" event={"ID":"26b8ec99-86f4-4518-880c-b4d1b15c0e70","Type":"ContainerStarted","Data":"c8393e9009dc740952b3e6ea918d79278ba439b952e70d8cd3237c6f5ab1ee66"}
Jun 03 01:46:29.573018 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:29.572978    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-889cb89c5-69lsj" podStartSLOduration=3.029930149 podStartE2EDuration="5.572963309s" podCreationTimestamp="2026-06-03 01:46:24 +0000 UTC" firstStartedPulling="2026-06-03 01:46:26.903077659 +0000 UTC m=+392.969668235" lastFinishedPulling="2026-06-03 01:46:29.446110808 +0000 UTC m=+395.512701395" observedRunningTime="2026-06-03 01:46:29.572097405 +0000 UTC m=+395.638688000" watchObservedRunningTime="2026-06-03 01:46:29.572963309 +0000 UTC m=+395.639553968"
Jun 03 01:46:38.556636 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:46:38.556601    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bc87d8b78-dmqvr"
Jun 03 01:48:15.389365 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.389332    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"]
Jun 03 01:48:15.391047 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.391033    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"
Jun 03 01:48:15.393367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.393340    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jun 03 01:48:15.393367 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.393352    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 01:48:15.393581 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.393374    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jun 03 01:48:15.393581 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.393352    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9jrmt\""
Jun 03 01:48:15.394280 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.394267    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 01:48:15.399408 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.399378    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"]
Jun 03 01:48:15.427544 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.427501    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-n5h6p\" (UID: \"6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"
Jun 03 01:48:15.427688 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.427556    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v644\" (UniqueName: \"kubernetes.io/projected/6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb-kube-api-access-6v644\") pod \"kuadrant-console-plugin-6cb54b5c86-n5h6p\" (UID: \"6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"
Jun 03 01:48:15.427688 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.427596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-n5h6p\" (UID: \"6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"
Jun 03 01:48:15.528439 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.528404    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-n5h6p\" (UID: \"6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"
Jun 03 01:48:15.528636 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.528465    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-n5h6p\" (UID: \"6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"
Jun 03 01:48:15.528636 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.528506    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6v644\" (UniqueName: \"kubernetes.io/projected/6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb-kube-api-access-6v644\") pod \"kuadrant-console-plugin-6cb54b5c86-n5h6p\" (UID: \"6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"
Jun 03 01:48:15.528636 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:48:15.528574    2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jun 03 01:48:15.528762 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:48:15.528659    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb-plugin-serving-cert podName:6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb nodeName:}" failed. No retries permitted until 2026-06-03 01:48:16.02863638 +0000 UTC m=+502.095226971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-n5h6p" (UID: "6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb") : secret "plugin-serving-cert" not found
Jun 03 01:48:15.529145 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.529126    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-n5h6p\" (UID: \"6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"
Jun 03 01:48:15.536678 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:15.536660    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v644\" (UniqueName: \"kubernetes.io/projected/6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb-kube-api-access-6v644\") pod \"kuadrant-console-plugin-6cb54b5c86-n5h6p\" (UID: \"6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"
Jun 03 01:48:16.032571 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:16.032529    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-n5h6p\" (UID: \"6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"
Jun 03 01:48:16.035039 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:16.035018    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-n5h6p\" (UID: \"6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"
Jun 03 01:48:16.300711 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:16.300620    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"
Jun 03 01:48:16.429189 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:16.429153    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p"]
Jun 03 01:48:16.432961 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:48:16.432936    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c3bfd1f_e8e1_4eae_aa59_e0c230c86beb.slice/crio-e28cb1d8d310c47a030b21698a7e318dd802aef82871a9810ec39254ea64ad45 WatchSource:0}: Error finding container e28cb1d8d310c47a030b21698a7e318dd802aef82871a9810ec39254ea64ad45: Status 404 returned error can't find the container with id e28cb1d8d310c47a030b21698a7e318dd802aef82871a9810ec39254ea64ad45
Jun 03 01:48:16.845211 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:16.845169    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p" event={"ID":"6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb","Type":"ContainerStarted","Data":"e28cb1d8d310c47a030b21698a7e318dd802aef82871a9810ec39254ea64ad45"}
Jun 03 01:48:40.914125 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:40.914086    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p" event={"ID":"6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb","Type":"ContainerStarted","Data":"07a9d2a904e716e3e7336847dcb4d1a40f2acc58b46fd3527f28003c7290056c"}
Jun 03 01:48:40.929590 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:48:40.929542    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-n5h6p" podStartSLOduration=2.231470102 podStartE2EDuration="25.929528228s" podCreationTimestamp="2026-06-03 01:48:15 +0000 UTC" firstStartedPulling="2026-06-03 01:48:16.434142582 +0000 UTC m=+502.500733161" lastFinishedPulling="2026-06-03 01:48:40.132200698 +0000 UTC m=+526.198791287" observedRunningTime="2026-06-03 01:48:40.927949281 +0000 UTC m=+526.994539879" watchObservedRunningTime="2026-06-03 01:48:40.929528228 +0000 UTC m=+526.996118825"
Jun 03 01:49:13.031583 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.031544    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:49:13.043976 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.043955    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:49:13.044103 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.044053    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-5rv89"
Jun 03 01:49:13.046536 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.046514    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jun 03 01:49:13.060382 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.060362    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:49:13.161912 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.161880    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8c3411e8-bde6-487d-bc9f-a3cd05b81a72-config-file\") pod \"limitador-limitador-78c99df468-5rv89\" (UID: \"8c3411e8-bde6-487d-bc9f-a3cd05b81a72\") " pod="kuadrant-system/limitador-limitador-78c99df468-5rv89"
Jun 03 01:49:13.162057 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.161934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgttf\" (UniqueName: \"kubernetes.io/projected/8c3411e8-bde6-487d-bc9f-a3cd05b81a72-kube-api-access-jgttf\") pod \"limitador-limitador-78c99df468-5rv89\" (UID: \"8c3411e8-bde6-487d-bc9f-a3cd05b81a72\") " pod="kuadrant-system/limitador-limitador-78c99df468-5rv89"
Jun 03 01:49:13.262801 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.262774    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgttf\" (UniqueName: \"kubernetes.io/projected/8c3411e8-bde6-487d-bc9f-a3cd05b81a72-kube-api-access-jgttf\") pod \"limitador-limitador-78c99df468-5rv89\" (UID: \"8c3411e8-bde6-487d-bc9f-a3cd05b81a72\") " pod="kuadrant-system/limitador-limitador-78c99df468-5rv89"
Jun 03 01:49:13.262916 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.262824    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8c3411e8-bde6-487d-bc9f-a3cd05b81a72-config-file\") pod \"limitador-limitador-78c99df468-5rv89\" (UID: \"8c3411e8-bde6-487d-bc9f-a3cd05b81a72\") " pod="kuadrant-system/limitador-limitador-78c99df468-5rv89"
Jun 03 01:49:13.263358 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.263342    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8c3411e8-bde6-487d-bc9f-a3cd05b81a72-config-file\") pod \"limitador-limitador-78c99df468-5rv89\" (UID: \"8c3411e8-bde6-487d-bc9f-a3cd05b81a72\") " pod="kuadrant-system/limitador-limitador-78c99df468-5rv89"
Jun 03 01:49:13.274035 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.274003    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgttf\" (UniqueName: \"kubernetes.io/projected/8c3411e8-bde6-487d-bc9f-a3cd05b81a72-kube-api-access-jgttf\") pod \"limitador-limitador-78c99df468-5rv89\" (UID: \"8c3411e8-bde6-487d-bc9f-a3cd05b81a72\") " pod="kuadrant-system/limitador-limitador-78c99df468-5rv89"
Jun 03 01:49:13.354092 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.354038    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-5rv89"
Jun 03 01:49:13.478681 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.478616    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:49:13.481368 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:49:13.481341    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3411e8_bde6_487d_bc9f_a3cd05b81a72.slice/crio-3dddf0cfc5724643bb0daa8de8cefdf474dbb390c5bfb1fa36f0feaccb4ea794 WatchSource:0}: Error finding container 3dddf0cfc5724643bb0daa8de8cefdf474dbb390c5bfb1fa36f0feaccb4ea794: Status 404 returned error can't find the container with id 3dddf0cfc5724643bb0daa8de8cefdf474dbb390c5bfb1fa36f0feaccb4ea794
Jun 03 01:49:13.521204 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.521182    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jgphp"]
Jun 03 01:49:13.525326 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.525312    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-jgphp"
Jun 03 01:49:13.527937 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.527915    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-d8n7t\""
Jun 03 01:49:13.530843 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.530824    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jgphp"]
Jun 03 01:49:13.637465 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.637402    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-gwhdk"]
Jun 03 01:49:13.640287 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.640263    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-gwhdk"
Jun 03 01:49:13.646303 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.646281    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-gwhdk"]
Jun 03 01:49:13.667186 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.667159    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk25c\" (UniqueName: \"kubernetes.io/projected/28490e8d-01a6-4677-82f0-a2dd7f7ac272-kube-api-access-nk25c\") pod \"authorino-f99f4b5cd-jgphp\" (UID: \"28490e8d-01a6-4677-82f0-a2dd7f7ac272\") " pod="kuadrant-system/authorino-f99f4b5cd-jgphp"
Jun 03 01:49:13.767845 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.767818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24s88\" (UniqueName: \"kubernetes.io/projected/7f95aa99-6fab-41be-8e21-36ff4e82795a-kube-api-access-24s88\") pod \"authorino-7498df8756-gwhdk\" (UID: \"7f95aa99-6fab-41be-8e21-36ff4e82795a\") " pod="kuadrant-system/authorino-7498df8756-gwhdk"
Jun 03 01:49:13.767950 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.767873    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nk25c\" (UniqueName: \"kubernetes.io/projected/28490e8d-01a6-4677-82f0-a2dd7f7ac272-kube-api-access-nk25c\") pod \"authorino-f99f4b5cd-jgphp\" (UID: \"28490e8d-01a6-4677-82f0-a2dd7f7ac272\") " pod="kuadrant-system/authorino-f99f4b5cd-jgphp"
Jun 03 01:49:13.775108 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.775088    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk25c\" (UniqueName: \"kubernetes.io/projected/28490e8d-01a6-4677-82f0-a2dd7f7ac272-kube-api-access-nk25c\") pod \"authorino-f99f4b5cd-jgphp\" (UID: \"28490e8d-01a6-4677-82f0-a2dd7f7ac272\") " pod="kuadrant-system/authorino-f99f4b5cd-jgphp"
Jun 03 01:49:13.836300 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.836272    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-jgphp"
Jun 03 01:49:13.868690 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.868655    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24s88\" (UniqueName: \"kubernetes.io/projected/7f95aa99-6fab-41be-8e21-36ff4e82795a-kube-api-access-24s88\") pod \"authorino-7498df8756-gwhdk\" (UID: \"7f95aa99-6fab-41be-8e21-36ff4e82795a\") " pod="kuadrant-system/authorino-7498df8756-gwhdk"
Jun 03 01:49:13.876220 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.876184    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24s88\" (UniqueName: \"kubernetes.io/projected/7f95aa99-6fab-41be-8e21-36ff4e82795a-kube-api-access-24s88\") pod \"authorino-7498df8756-gwhdk\" (UID: \"7f95aa99-6fab-41be-8e21-36ff4e82795a\") " pod="kuadrant-system/authorino-7498df8756-gwhdk"
Jun 03 01:49:13.950763 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.950336    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-gwhdk"
Jun 03 01:49:13.971630 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:13.971598    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jgphp"]
Jun 03 01:49:13.979481 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:49:13.979423    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28490e8d_01a6_4677_82f0_a2dd7f7ac272.slice/crio-debff42e7776c07132562c033c3e38746df292a09eed9222e4211d1d27b35c6e WatchSource:0}: Error finding container debff42e7776c07132562c033c3e38746df292a09eed9222e4211d1d27b35c6e: Status 404 returned error can't find the container with id debff42e7776c07132562c033c3e38746df292a09eed9222e4211d1d27b35c6e
Jun 03 01:49:14.004800 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:14.004697    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-5rv89" event={"ID":"8c3411e8-bde6-487d-bc9f-a3cd05b81a72","Type":"ContainerStarted","Data":"3dddf0cfc5724643bb0daa8de8cefdf474dbb390c5bfb1fa36f0feaccb4ea794"}
Jun 03 01:49:14.006657 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:14.006608    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-jgphp" event={"ID":"28490e8d-01a6-4677-82f0-a2dd7f7ac272","Type":"ContainerStarted","Data":"debff42e7776c07132562c033c3e38746df292a09eed9222e4211d1d27b35c6e"}
Jun 03 01:49:14.123430 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:14.123377    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-gwhdk"]
Jun 03 01:49:14.128496 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:49:14.128432    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f95aa99_6fab_41be_8e21_36ff4e82795a.slice/crio-0991d426a7f35c227c0d6d411c544e5738149ff3660dd80be6cd89e0bfbaf000 WatchSource:0}: Error finding container 0991d426a7f35c227c0d6d411c544e5738149ff3660dd80be6cd89e0bfbaf000: Status 404 returned error can't find the container with id 0991d426a7f35c227c0d6d411c544e5738149ff3660dd80be6cd89e0bfbaf000
Jun 03 01:49:15.012438 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:15.012399    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-gwhdk" event={"ID":"7f95aa99-6fab-41be-8e21-36ff4e82795a","Type":"ContainerStarted","Data":"0991d426a7f35c227c0d6d411c544e5738149ff3660dd80be6cd89e0bfbaf000"}
Jun 03 01:49:19.027570 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:19.027533    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-5rv89" event={"ID":"8c3411e8-bde6-487d-bc9f-a3cd05b81a72","Type":"ContainerStarted","Data":"2b008c6a9bce95ed9651b1df85c98f40cf2487d45063c06624b1e8db7d3e6276"}
Jun 03 01:49:19.028048 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:19.027635    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-5rv89"
Jun 03 01:49:19.028793 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:19.028772    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-jgphp" event={"ID":"28490e8d-01a6-4677-82f0-a2dd7f7ac272","Type":"ContainerStarted","Data":"df8dfba577845b5a8383a7e6bba1107acb13971775a521579aa3afd512e3676b"}
Jun 03 01:49:19.029966 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:19.029947    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-gwhdk" event={"ID":"7f95aa99-6fab-41be-8e21-36ff4e82795a","Type":"ContainerStarted","Data":"664052e3bdfbbf8598868a809a95cfd1b3ce8ce2c71b4a6937a1f9b57279ec31"}
Jun 03 01:49:19.045102 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:19.045062    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-5rv89" podStartSLOduration=1.10968501 podStartE2EDuration="6.04505108s" podCreationTimestamp="2026-06-03 01:49:13 +0000 UTC" firstStartedPulling="2026-06-03 01:49:13.483036524 +0000 UTC m=+559.549627100" lastFinishedPulling="2026-06-03 01:49:18.418402592 +0000 UTC m=+564.484993170" observedRunningTime="2026-06-03 01:49:19.043842329 +0000 UTC m=+565.110432928" watchObservedRunningTime="2026-06-03 01:49:19.04505108 +0000 UTC m=+565.111641677"
Jun 03 01:49:19.057125 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:19.057083    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-gwhdk" podStartSLOduration=1.779154122 podStartE2EDuration="6.057072789s" podCreationTimestamp="2026-06-03 01:49:13 +0000 UTC" firstStartedPulling="2026-06-03 01:49:14.129849767 +0000 UTC m=+560.196440347" lastFinishedPulling="2026-06-03 01:49:18.40776843 +0000 UTC m=+564.474359014" observedRunningTime="2026-06-03 01:49:19.055895276 +0000 UTC m=+565.122485864" watchObservedRunningTime="2026-06-03 01:49:19.057072789 +0000 UTC m=+565.123663387"
Jun 03 01:49:19.069830 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:19.069796    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-jgphp" podStartSLOduration=1.680328123 podStartE2EDuration="6.069783689s" podCreationTimestamp="2026-06-03 01:49:13 +0000 UTC" firstStartedPulling="2026-06-03 01:49:13.981159431 +0000 UTC m=+560.047750015" lastFinishedPulling="2026-06-03 01:49:18.370614986 +0000 UTC m=+564.437205581" observedRunningTime="2026-06-03 01:49:19.067955589 +0000 UTC m=+565.134546187" watchObservedRunningTime="2026-06-03 01:49:19.069783689 +0000 UTC m=+565.136374290"
Jun 03 01:49:19.090547 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:19.090524    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jgphp"]
Jun 03 01:49:21.035851 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:21.035789    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-jgphp" podUID="28490e8d-01a6-4677-82f0-a2dd7f7ac272" containerName="authorino" containerID="cri-o://df8dfba577845b5a8383a7e6bba1107acb13971775a521579aa3afd512e3676b" gracePeriod=30
Jun 03 01:49:21.266134 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:21.266113    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-jgphp"
Jun 03 01:49:21.329600 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:21.329536    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk25c\" (UniqueName: \"kubernetes.io/projected/28490e8d-01a6-4677-82f0-a2dd7f7ac272-kube-api-access-nk25c\") pod \"28490e8d-01a6-4677-82f0-a2dd7f7ac272\" (UID: \"28490e8d-01a6-4677-82f0-a2dd7f7ac272\") "
Jun 03 01:49:21.331700 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:21.331678    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28490e8d-01a6-4677-82f0-a2dd7f7ac272-kube-api-access-nk25c" (OuterVolumeSpecName: "kube-api-access-nk25c") pod "28490e8d-01a6-4677-82f0-a2dd7f7ac272" (UID: "28490e8d-01a6-4677-82f0-a2dd7f7ac272"). InnerVolumeSpecName "kube-api-access-nk25c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:49:21.430278 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:21.430250    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk25c\" (UniqueName: \"kubernetes.io/projected/28490e8d-01a6-4677-82f0-a2dd7f7ac272-kube-api-access-nk25c\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:49:22.039490 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:22.039437    2575 generic.go:358] "Generic (PLEG): container finished" podID="28490e8d-01a6-4677-82f0-a2dd7f7ac272" containerID="df8dfba577845b5a8383a7e6bba1107acb13971775a521579aa3afd512e3676b" exitCode=0
Jun 03 01:49:22.039892 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:22.039509    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-jgphp"
Jun 03 01:49:22.039892 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:22.039514    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-jgphp" event={"ID":"28490e8d-01a6-4677-82f0-a2dd7f7ac272","Type":"ContainerDied","Data":"df8dfba577845b5a8383a7e6bba1107acb13971775a521579aa3afd512e3676b"}
Jun 03 01:49:22.039892 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:22.039551    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-jgphp" event={"ID":"28490e8d-01a6-4677-82f0-a2dd7f7ac272","Type":"ContainerDied","Data":"debff42e7776c07132562c033c3e38746df292a09eed9222e4211d1d27b35c6e"}
Jun 03 01:49:22.039892 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:22.039566    2575 scope.go:117] "RemoveContainer" containerID="df8dfba577845b5a8383a7e6bba1107acb13971775a521579aa3afd512e3676b"
Jun 03 01:49:22.047696 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:22.047679    2575 scope.go:117] "RemoveContainer" containerID="df8dfba577845b5a8383a7e6bba1107acb13971775a521579aa3afd512e3676b"
Jun 03 01:49:22.047954 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:49:22.047937    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df8dfba577845b5a8383a7e6bba1107acb13971775a521579aa3afd512e3676b\": container with ID starting with df8dfba577845b5a8383a7e6bba1107acb13971775a521579aa3afd512e3676b not found: ID does not exist" containerID="df8dfba577845b5a8383a7e6bba1107acb13971775a521579aa3afd512e3676b"
Jun 03 01:49:22.048000 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:22.047962    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df8dfba577845b5a8383a7e6bba1107acb13971775a521579aa3afd512e3676b"} err="failed to get container status \"df8dfba577845b5a8383a7e6bba1107acb13971775a521579aa3afd512e3676b\": rpc error: code = NotFound desc = could not find container \"df8dfba577845b5a8383a7e6bba1107acb13971775a521579aa3afd512e3676b\": container with ID starting with df8dfba577845b5a8383a7e6bba1107acb13971775a521579aa3afd512e3676b not found: ID does not exist"
Jun 03 01:49:22.058431 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:22.058407    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jgphp"]
Jun 03 01:49:22.061652 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:22.061634    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-jgphp"]
Jun 03 01:49:22.412355 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:22.412331    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28490e8d-01a6-4677-82f0-a2dd7f7ac272" path="/var/lib/kubelet/pods/28490e8d-01a6-4677-82f0-a2dd7f7ac272/volumes"
Jun 03 01:49:30.034133 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:49:30.034101    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-5rv89"
Jun 03 01:50:40.194806 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.194763    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ks4bl"]
Jun 03 01:50:40.198993 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.195010    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28490e8d-01a6-4677-82f0-a2dd7f7ac272" containerName="authorino"
Jun 03 01:50:40.198993 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.195021    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="28490e8d-01a6-4677-82f0-a2dd7f7ac272" containerName="authorino"
Jun 03 01:50:40.198993 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.195077    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="28490e8d-01a6-4677-82f0-a2dd7f7ac272" containerName="authorino"
Jun 03 01:50:40.199793 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.199777    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ks4bl"
Jun 03 01:50:40.206802 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.206774    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ks4bl"]
Jun 03 01:50:40.294883 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.294848    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qck99\" (UniqueName: \"kubernetes.io/projected/b36d7381-c8c4-4a5f-bb41-25544a7d0940-kube-api-access-qck99\") pod \"authorino-8b475cf9f-ks4bl\" (UID: \"b36d7381-c8c4-4a5f-bb41-25544a7d0940\") " pod="kuadrant-system/authorino-8b475cf9f-ks4bl"
Jun 03 01:50:40.395623 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.395593    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qck99\" (UniqueName: \"kubernetes.io/projected/b36d7381-c8c4-4a5f-bb41-25544a7d0940-kube-api-access-qck99\") pod \"authorino-8b475cf9f-ks4bl\" (UID: \"b36d7381-c8c4-4a5f-bb41-25544a7d0940\") " pod="kuadrant-system/authorino-8b475cf9f-ks4bl"
Jun 03 01:50:40.404873 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.404846    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qck99\" (UniqueName: \"kubernetes.io/projected/b36d7381-c8c4-4a5f-bb41-25544a7d0940-kube-api-access-qck99\") pod \"authorino-8b475cf9f-ks4bl\" (UID: \"b36d7381-c8c4-4a5f-bb41-25544a7d0940\") " pod="kuadrant-system/authorino-8b475cf9f-ks4bl"
Jun 03 01:50:40.423664 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.423642    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ks4bl"]
Jun 03 01:50:40.423803 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.423792    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ks4bl"
Jun 03 01:50:40.450261 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.450192    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f4db77d8f-xhv24"]
Jun 03 01:50:40.454112 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.454091    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f4db77d8f-xhv24"
Jun 03 01:50:40.460818 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.460797    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f4db77d8f-xhv24"]
Jun 03 01:50:40.496901 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.496869    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ccr2\" (UniqueName: \"kubernetes.io/projected/7a430f1c-e0a4-4b08-84cd-b72b2fb0320e-kube-api-access-2ccr2\") pod \"authorino-7f4db77d8f-xhv24\" (UID: \"7a430f1c-e0a4-4b08-84cd-b72b2fb0320e\") " pod="kuadrant-system/authorino-7f4db77d8f-xhv24"
Jun 03 01:50:40.542401 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.542363    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f4db77d8f-xhv24"]
Jun 03 01:50:40.542663 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:50:40.542639    2575 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2ccr2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7f4db77d8f-xhv24" podUID="7a430f1c-e0a4-4b08-84cd-b72b2fb0320e"
Jun 03 01:50:40.556800 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.556771    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ks4bl"]
Jun 03 01:50:40.560645 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:50:40.560603    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb36d7381_c8c4_4a5f_bb41_25544a7d0940.slice/crio-0885018187f86d190ab7abb0f8a06b568f4b23e1cba6fec462034c1619c86e02 WatchSource:0}: Error finding container 0885018187f86d190ab7abb0f8a06b568f4b23e1cba6fec462034c1619c86e02: Status 404 returned error can't find the container with id 0885018187f86d190ab7abb0f8a06b568f4b23e1cba6fec462034c1619c86e02
Jun 03 01:50:40.565743 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.565725    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d5f5d97-jkr5p"]
Jun 03 01:50:40.568732 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.568712    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d5f5d97-jkr5p"
Jun 03 01:50:40.570782 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.570764    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jun 03 01:50:40.574256 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.574232    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d5f5d97-jkr5p"]
Jun 03 01:50:40.598239 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.598212    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ccr2\" (UniqueName: \"kubernetes.io/projected/7a430f1c-e0a4-4b08-84cd-b72b2fb0320e-kube-api-access-2ccr2\") pod \"authorino-7f4db77d8f-xhv24\" (UID: \"7a430f1c-e0a4-4b08-84cd-b72b2fb0320e\") " pod="kuadrant-system/authorino-7f4db77d8f-xhv24"
Jun 03 01:50:40.605975 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.605956    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ccr2\" (UniqueName: \"kubernetes.io/projected/7a430f1c-e0a4-4b08-84cd-b72b2fb0320e-kube-api-access-2ccr2\") pod \"authorino-7f4db77d8f-xhv24\" (UID: \"7a430f1c-e0a4-4b08-84cd-b72b2fb0320e\") " pod="kuadrant-system/authorino-7f4db77d8f-xhv24"
Jun 03 01:50:40.698733 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.698677    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwnb5\" (UniqueName: \"kubernetes.io/projected/ee325b87-afd1-4f2d-94eb-17e085d81280-kube-api-access-rwnb5\") pod \"authorino-7d5f5d97-jkr5p\" (UID: \"ee325b87-afd1-4f2d-94eb-17e085d81280\") " pod="kuadrant-system/authorino-7d5f5d97-jkr5p"
Jun 03 01:50:40.698853 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.698775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ee325b87-afd1-4f2d-94eb-17e085d81280-tls-cert\") pod \"authorino-7d5f5d97-jkr5p\" (UID: \"ee325b87-afd1-4f2d-94eb-17e085d81280\") " pod="kuadrant-system/authorino-7d5f5d97-jkr5p"
Jun 03 01:50:40.799107 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.799041    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ee325b87-afd1-4f2d-94eb-17e085d81280-tls-cert\") pod \"authorino-7d5f5d97-jkr5p\" (UID: \"ee325b87-afd1-4f2d-94eb-17e085d81280\") " pod="kuadrant-system/authorino-7d5f5d97-jkr5p"
Jun 03 01:50:40.799107 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.799086    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwnb5\" (UniqueName: \"kubernetes.io/projected/ee325b87-afd1-4f2d-94eb-17e085d81280-kube-api-access-rwnb5\") pod \"authorino-7d5f5d97-jkr5p\" (UID: \"ee325b87-afd1-4f2d-94eb-17e085d81280\") " pod="kuadrant-system/authorino-7d5f5d97-jkr5p"
Jun 03 01:50:40.801523 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.801496    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ee325b87-afd1-4f2d-94eb-17e085d81280-tls-cert\") pod \"authorino-7d5f5d97-jkr5p\" (UID: \"ee325b87-afd1-4f2d-94eb-17e085d81280\") " pod="kuadrant-system/authorino-7d5f5d97-jkr5p"
Jun 03 01:50:40.806533 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.806516    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwnb5\" (UniqueName: \"kubernetes.io/projected/ee325b87-afd1-4f2d-94eb-17e085d81280-kube-api-access-rwnb5\") pod \"authorino-7d5f5d97-jkr5p\" (UID: \"ee325b87-afd1-4f2d-94eb-17e085d81280\") " pod="kuadrant-system/authorino-7d5f5d97-jkr5p"
Jun 03 01:50:40.878630 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:40.878598    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d5f5d97-jkr5p"
Jun 03 01:50:41.007734 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.007701    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d5f5d97-jkr5p"]
Jun 03 01:50:41.010792 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:50:41.010767    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee325b87_afd1_4f2d_94eb_17e085d81280.slice/crio-47dbbe0bca34e11bc550e8f03e8c52eab2250a0186870cac18d4c210fb94a785 WatchSource:0}: Error finding container 47dbbe0bca34e11bc550e8f03e8c52eab2250a0186870cac18d4c210fb94a785: Status 404 returned error can't find the container with id 47dbbe0bca34e11bc550e8f03e8c52eab2250a0186870cac18d4c210fb94a785
Jun 03 01:50:41.260726 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.260687    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d5f5d97-jkr5p" event={"ID":"ee325b87-afd1-4f2d-94eb-17e085d81280","Type":"ContainerStarted","Data":"47dbbe0bca34e11bc550e8f03e8c52eab2250a0186870cac18d4c210fb94a785"}
Jun 03 01:50:41.261897 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.261871    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-ks4bl" event={"ID":"b36d7381-c8c4-4a5f-bb41-25544a7d0940","Type":"ContainerStarted","Data":"99bf64e2f58fa0c8d61e0389f370781f7baca7e6f8110e2d2870d1006d1864b9"}
Jun 03 01:50:41.261995 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.261907    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-ks4bl" event={"ID":"b36d7381-c8c4-4a5f-bb41-25544a7d0940","Type":"ContainerStarted","Data":"0885018187f86d190ab7abb0f8a06b568f4b23e1cba6fec462034c1619c86e02"}
Jun 03 01:50:41.261995 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.261882    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f4db77d8f-xhv24"
Jun 03 01:50:41.261995 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.261955    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-ks4bl" podUID="b36d7381-c8c4-4a5f-bb41-25544a7d0940" containerName="authorino" containerID="cri-o://99bf64e2f58fa0c8d61e0389f370781f7baca7e6f8110e2d2870d1006d1864b9" gracePeriod=30
Jun 03 01:50:41.266351 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.266333    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f4db77d8f-xhv24"
Jun 03 01:50:41.277726 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.277685    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-ks4bl" podStartSLOduration=0.92909985 podStartE2EDuration="1.277673658s" podCreationTimestamp="2026-06-03 01:50:40 +0000 UTC" firstStartedPulling="2026-06-03 01:50:40.562199629 +0000 UTC m=+646.628790205" lastFinishedPulling="2026-06-03 01:50:40.910773425 +0000 UTC m=+646.977364013" observedRunningTime="2026-06-03 01:50:41.277581231 +0000 UTC m=+647.344171825" watchObservedRunningTime="2026-06-03 01:50:41.277673658 +0000 UTC m=+647.344264256"
Jun 03 01:50:41.404976 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.404942    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ccr2\" (UniqueName: \"kubernetes.io/projected/7a430f1c-e0a4-4b08-84cd-b72b2fb0320e-kube-api-access-2ccr2\") pod \"7a430f1c-e0a4-4b08-84cd-b72b2fb0320e\" (UID: \"7a430f1c-e0a4-4b08-84cd-b72b2fb0320e\") "
Jun 03 01:50:41.407162 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.407124    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a430f1c-e0a4-4b08-84cd-b72b2fb0320e-kube-api-access-2ccr2" (OuterVolumeSpecName: "kube-api-access-2ccr2") pod "7a430f1c-e0a4-4b08-84cd-b72b2fb0320e" (UID: "7a430f1c-e0a4-4b08-84cd-b72b2fb0320e"). InnerVolumeSpecName "kube-api-access-2ccr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:50:41.506305 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.506277    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ccr2\" (UniqueName: \"kubernetes.io/projected/7a430f1c-e0a4-4b08-84cd-b72b2fb0320e-kube-api-access-2ccr2\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:50:41.511238 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.511190    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ks4bl"
Jun 03 01:50:41.607463 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.607435    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qck99\" (UniqueName: \"kubernetes.io/projected/b36d7381-c8c4-4a5f-bb41-25544a7d0940-kube-api-access-qck99\") pod \"b36d7381-c8c4-4a5f-bb41-25544a7d0940\" (UID: \"b36d7381-c8c4-4a5f-bb41-25544a7d0940\") "
Jun 03 01:50:41.609457 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.609426    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b36d7381-c8c4-4a5f-bb41-25544a7d0940-kube-api-access-qck99" (OuterVolumeSpecName: "kube-api-access-qck99") pod "b36d7381-c8c4-4a5f-bb41-25544a7d0940" (UID: "b36d7381-c8c4-4a5f-bb41-25544a7d0940"). InnerVolumeSpecName "kube-api-access-qck99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:50:41.708534 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:41.708507    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qck99\" (UniqueName: \"kubernetes.io/projected/b36d7381-c8c4-4a5f-bb41-25544a7d0940-kube-api-access-qck99\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:50:42.266956 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.266913    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d5f5d97-jkr5p" event={"ID":"ee325b87-afd1-4f2d-94eb-17e085d81280","Type":"ContainerStarted","Data":"59907bd01806e51395c405c58e44755e7ba80e10f81fa5a5b9f6ef75b026c53d"}
Jun 03 01:50:42.267918 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.267895    2575 generic.go:358] "Generic (PLEG): container finished" podID="b36d7381-c8c4-4a5f-bb41-25544a7d0940" containerID="99bf64e2f58fa0c8d61e0389f370781f7baca7e6f8110e2d2870d1006d1864b9" exitCode=0
Jun 03 01:50:42.268023 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.267934    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ks4bl"
Jun 03 01:50:42.268023 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.267959    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-ks4bl" event={"ID":"b36d7381-c8c4-4a5f-bb41-25544a7d0940","Type":"ContainerDied","Data":"99bf64e2f58fa0c8d61e0389f370781f7baca7e6f8110e2d2870d1006d1864b9"}
Jun 03 01:50:42.268023 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.267982    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-ks4bl" event={"ID":"b36d7381-c8c4-4a5f-bb41-25544a7d0940","Type":"ContainerDied","Data":"0885018187f86d190ab7abb0f8a06b568f4b23e1cba6fec462034c1619c86e02"}
Jun 03 01:50:42.268023 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.267997    2575 scope.go:117] "RemoveContainer" containerID="99bf64e2f58fa0c8d61e0389f370781f7baca7e6f8110e2d2870d1006d1864b9"
Jun 03 01:50:42.268176 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.268142    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f4db77d8f-xhv24"
Jun 03 01:50:42.277242 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.277225    2575 scope.go:117] "RemoveContainer" containerID="99bf64e2f58fa0c8d61e0389f370781f7baca7e6f8110e2d2870d1006d1864b9"
Jun 03 01:50:42.277505 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:50:42.277464    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99bf64e2f58fa0c8d61e0389f370781f7baca7e6f8110e2d2870d1006d1864b9\": container with ID starting with 99bf64e2f58fa0c8d61e0389f370781f7baca7e6f8110e2d2870d1006d1864b9 not found: ID does not exist" containerID="99bf64e2f58fa0c8d61e0389f370781f7baca7e6f8110e2d2870d1006d1864b9"
Jun 03 01:50:42.277574 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.277512    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99bf64e2f58fa0c8d61e0389f370781f7baca7e6f8110e2d2870d1006d1864b9"} err="failed to get container status \"99bf64e2f58fa0c8d61e0389f370781f7baca7e6f8110e2d2870d1006d1864b9\": rpc error: code = NotFound desc = could not find container \"99bf64e2f58fa0c8d61e0389f370781f7baca7e6f8110e2d2870d1006d1864b9\": container with ID starting with 99bf64e2f58fa0c8d61e0389f370781f7baca7e6f8110e2d2870d1006d1864b9 not found: ID does not exist"
Jun 03 01:50:42.281235 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.281199    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7d5f5d97-jkr5p" podStartSLOduration=1.9985683079999998 podStartE2EDuration="2.281187228s" podCreationTimestamp="2026-06-03 01:50:40 +0000 UTC" firstStartedPulling="2026-06-03 01:50:41.01203582 +0000 UTC m=+647.078626400" lastFinishedPulling="2026-06-03 01:50:41.294654742 +0000 UTC m=+647.361245320" observedRunningTime="2026-06-03 01:50:42.279688375 +0000 UTC m=+648.346278973" watchObservedRunningTime="2026-06-03 01:50:42.281187228 +0000 UTC m=+648.347777826"
Jun 03 01:50:42.293627 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.293604    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ks4bl"]
Jun 03 01:50:42.299609 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.299589    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ks4bl"]
Jun 03 01:50:42.301963 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.301944    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-gwhdk"]
Jun 03 01:50:42.302149 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.302128    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-gwhdk" podUID="7f95aa99-6fab-41be-8e21-36ff4e82795a" containerName="authorino" containerID="cri-o://664052e3bdfbbf8598868a809a95cfd1b3ce8ce2c71b4a6937a1f9b57279ec31" gracePeriod=30
Jun 03 01:50:42.325948 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.325926    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f4db77d8f-xhv24"]
Jun 03 01:50:42.328694 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.328671    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f4db77d8f-xhv24"]
Jun 03 01:50:42.413497 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.413441    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a430f1c-e0a4-4b08-84cd-b72b2fb0320e" path="/var/lib/kubelet/pods/7a430f1c-e0a4-4b08-84cd-b72b2fb0320e/volumes"
Jun 03 01:50:42.413771 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.413752    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b36d7381-c8c4-4a5f-bb41-25544a7d0940" path="/var/lib/kubelet/pods/b36d7381-c8c4-4a5f-bb41-25544a7d0940/volumes"
Jun 03 01:50:42.553844 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.553824    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-gwhdk"
Jun 03 01:50:42.615038 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.615012    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24s88\" (UniqueName: \"kubernetes.io/projected/7f95aa99-6fab-41be-8e21-36ff4e82795a-kube-api-access-24s88\") pod \"7f95aa99-6fab-41be-8e21-36ff4e82795a\" (UID: \"7f95aa99-6fab-41be-8e21-36ff4e82795a\") "
Jun 03 01:50:42.617006 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.616971    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f95aa99-6fab-41be-8e21-36ff4e82795a-kube-api-access-24s88" (OuterVolumeSpecName: "kube-api-access-24s88") pod "7f95aa99-6fab-41be-8e21-36ff4e82795a" (UID: "7f95aa99-6fab-41be-8e21-36ff4e82795a"). InnerVolumeSpecName "kube-api-access-24s88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:50:42.716041 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:42.716018    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24s88\" (UniqueName: \"kubernetes.io/projected/7f95aa99-6fab-41be-8e21-36ff4e82795a-kube-api-access-24s88\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:50:43.272355 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:43.272317    2575 generic.go:358] "Generic (PLEG): container finished" podID="7f95aa99-6fab-41be-8e21-36ff4e82795a" containerID="664052e3bdfbbf8598868a809a95cfd1b3ce8ce2c71b4a6937a1f9b57279ec31" exitCode=0
Jun 03 01:50:43.272841 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:43.272385    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-gwhdk"
Jun 03 01:50:43.272841 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:43.272392    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-gwhdk" event={"ID":"7f95aa99-6fab-41be-8e21-36ff4e82795a","Type":"ContainerDied","Data":"664052e3bdfbbf8598868a809a95cfd1b3ce8ce2c71b4a6937a1f9b57279ec31"}
Jun 03 01:50:43.272841 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:43.272427    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-gwhdk" event={"ID":"7f95aa99-6fab-41be-8e21-36ff4e82795a","Type":"ContainerDied","Data":"0991d426a7f35c227c0d6d411c544e5738149ff3660dd80be6cd89e0bfbaf000"}
Jun 03 01:50:43.272841 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:43.272443    2575 scope.go:117] "RemoveContainer" containerID="664052e3bdfbbf8598868a809a95cfd1b3ce8ce2c71b4a6937a1f9b57279ec31"
Jun 03 01:50:43.280153 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:43.280137    2575 scope.go:117] "RemoveContainer" containerID="664052e3bdfbbf8598868a809a95cfd1b3ce8ce2c71b4a6937a1f9b57279ec31"
Jun 03 01:50:43.280378 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:50:43.280361    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"664052e3bdfbbf8598868a809a95cfd1b3ce8ce2c71b4a6937a1f9b57279ec31\": container with ID starting with 664052e3bdfbbf8598868a809a95cfd1b3ce8ce2c71b4a6937a1f9b57279ec31 not found: ID does not exist" containerID="664052e3bdfbbf8598868a809a95cfd1b3ce8ce2c71b4a6937a1f9b57279ec31"
Jun 03 01:50:43.280416 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:43.280385    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"664052e3bdfbbf8598868a809a95cfd1b3ce8ce2c71b4a6937a1f9b57279ec31"} err="failed to get container status \"664052e3bdfbbf8598868a809a95cfd1b3ce8ce2c71b4a6937a1f9b57279ec31\": rpc error: code = NotFound desc = could not find container \"664052e3bdfbbf8598868a809a95cfd1b3ce8ce2c71b4a6937a1f9b57279ec31\": container with ID starting with 664052e3bdfbbf8598868a809a95cfd1b3ce8ce2c71b4a6937a1f9b57279ec31 not found: ID does not exist"
Jun 03 01:50:43.291786 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:43.291766    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-gwhdk"]
Jun 03 01:50:43.296037 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:43.296020    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-gwhdk"]
Jun 03 01:50:44.412377 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:44.412346    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f95aa99-6fab-41be-8e21-36ff4e82795a" path="/var/lib/kubelet/pods/7f95aa99-6fab-41be-8e21-36ff4e82795a/volumes"
Jun 03 01:50:45.348521 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.348490    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-799dfc5879-sgqbb"]
Jun 03 01:50:45.348753 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.348741    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f95aa99-6fab-41be-8e21-36ff4e82795a" containerName="authorino"
Jun 03 01:50:45.348802 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.348754    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f95aa99-6fab-41be-8e21-36ff4e82795a" containerName="authorino"
Jun 03 01:50:45.348802 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.348764    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b36d7381-c8c4-4a5f-bb41-25544a7d0940" containerName="authorino"
Jun 03 01:50:45.348802 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.348769    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b36d7381-c8c4-4a5f-bb41-25544a7d0940" containerName="authorino"
Jun 03 01:50:45.348908 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.348818    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="7f95aa99-6fab-41be-8e21-36ff4e82795a" containerName="authorino"
Jun 03 01:50:45.348908 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.348828    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="b36d7381-c8c4-4a5f-bb41-25544a7d0940" containerName="authorino"
Jun 03 01:50:45.352777 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.352763    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-799dfc5879-sgqbb"
Jun 03 01:50:45.356965 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.356944    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4247v\""
Jun 03 01:50:45.357257 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.357240    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 03 01:50:45.362197 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.362173    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-799dfc5879-sgqbb"]
Jun 03 01:50:45.432908 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.432871    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxxbq\" (UniqueName: \"kubernetes.io/projected/04b60cac-a86f-405a-a732-e6fabef7ff27-kube-api-access-wxxbq\") pod \"maas-controller-799dfc5879-sgqbb\" (UID: \"04b60cac-a86f-405a-a732-e6fabef7ff27\") " pod="opendatahub/maas-controller-799dfc5879-sgqbb"
Jun 03 01:50:45.533896 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.533857    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxxbq\" (UniqueName: \"kubernetes.io/projected/04b60cac-a86f-405a-a732-e6fabef7ff27-kube-api-access-wxxbq\") pod \"maas-controller-799dfc5879-sgqbb\" (UID: \"04b60cac-a86f-405a-a732-e6fabef7ff27\") " pod="opendatahub/maas-controller-799dfc5879-sgqbb"
Jun 03 01:50:45.542118 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.542095    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxxbq\" (UniqueName: \"kubernetes.io/projected/04b60cac-a86f-405a-a732-e6fabef7ff27-kube-api-access-wxxbq\") pod \"maas-controller-799dfc5879-sgqbb\" (UID: \"04b60cac-a86f-405a-a732-e6fabef7ff27\") " pod="opendatahub/maas-controller-799dfc5879-sgqbb"
Jun 03 01:50:45.663826 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.663799    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-799dfc5879-sgqbb"
Jun 03 01:50:45.788921 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:45.788838    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-799dfc5879-sgqbb"]
Jun 03 01:50:45.791317 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:50:45.791291    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b60cac_a86f_405a_a732_e6fabef7ff27.slice/crio-62ad2ee8226323d76c8e3eec037ef7e1c4b425649db0559a8bfe09a80ec73512 WatchSource:0}: Error finding container 62ad2ee8226323d76c8e3eec037ef7e1c4b425649db0559a8bfe09a80ec73512: Status 404 returned error can't find the container with id 62ad2ee8226323d76c8e3eec037ef7e1c4b425649db0559a8bfe09a80ec73512
Jun 03 01:50:46.283987 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:46.283955    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-799dfc5879-sgqbb" event={"ID":"04b60cac-a86f-405a-a732-e6fabef7ff27","Type":"ContainerStarted","Data":"62ad2ee8226323d76c8e3eec037ef7e1c4b425649db0559a8bfe09a80ec73512"}
Jun 03 01:50:48.292317 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:48.292289    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-799dfc5879-sgqbb" event={"ID":"04b60cac-a86f-405a-a732-e6fabef7ff27","Type":"ContainerStarted","Data":"0c5164b3a4011b5632f7de8bccbbe89a95277435e2fb7bdcf2cd920ccd6f5358"}
Jun 03 01:50:48.292646 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:48.292352    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-799dfc5879-sgqbb"
Jun 03 01:50:48.308734 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:48.308687    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-799dfc5879-sgqbb" podStartSLOduration=0.875567375 podStartE2EDuration="3.308673446s" podCreationTimestamp="2026-06-03 01:50:45 +0000 UTC" firstStartedPulling="2026-06-03 01:50:45.79274818 +0000 UTC m=+651.859338757" lastFinishedPulling="2026-06-03 01:50:48.225854249 +0000 UTC m=+654.292444828" observedRunningTime="2026-06-03 01:50:48.307178632 +0000 UTC m=+654.373769229" watchObservedRunningTime="2026-06-03 01:50:48.308673446 +0000 UTC m=+654.375264044"
Jun 03 01:50:59.301959 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:50:59.301925    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-799dfc5879-sgqbb"
Jun 03 01:51:00.279666 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:00.279635    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-799dfc5879-sgqbb"]
Jun 03 01:51:00.279840 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:00.279816    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-799dfc5879-sgqbb" podUID="04b60cac-a86f-405a-a732-e6fabef7ff27" containerName="manager" containerID="cri-o://0c5164b3a4011b5632f7de8bccbbe89a95277435e2fb7bdcf2cd920ccd6f5358" gracePeriod=30
Jun 03 01:51:00.513816 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:00.513795    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-799dfc5879-sgqbb"
Jun 03 01:51:00.651389 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:00.651320    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxxbq\" (UniqueName: \"kubernetes.io/projected/04b60cac-a86f-405a-a732-e6fabef7ff27-kube-api-access-wxxbq\") pod \"04b60cac-a86f-405a-a732-e6fabef7ff27\" (UID: \"04b60cac-a86f-405a-a732-e6fabef7ff27\") "
Jun 03 01:51:00.653604 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:00.653575    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04b60cac-a86f-405a-a732-e6fabef7ff27-kube-api-access-wxxbq" (OuterVolumeSpecName: "kube-api-access-wxxbq") pod "04b60cac-a86f-405a-a732-e6fabef7ff27" (UID: "04b60cac-a86f-405a-a732-e6fabef7ff27"). InnerVolumeSpecName "kube-api-access-wxxbq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:51:00.752717 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:00.752675    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxxbq\" (UniqueName: \"kubernetes.io/projected/04b60cac-a86f-405a-a732-e6fabef7ff27-kube-api-access-wxxbq\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:51:01.332870 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:01.332832    2575 generic.go:358] "Generic (PLEG): container finished" podID="04b60cac-a86f-405a-a732-e6fabef7ff27" containerID="0c5164b3a4011b5632f7de8bccbbe89a95277435e2fb7bdcf2cd920ccd6f5358" exitCode=0
Jun 03 01:51:01.333012 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:01.332908    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-799dfc5879-sgqbb" event={"ID":"04b60cac-a86f-405a-a732-e6fabef7ff27","Type":"ContainerDied","Data":"0c5164b3a4011b5632f7de8bccbbe89a95277435e2fb7bdcf2cd920ccd6f5358"}
Jun 03 01:51:01.333012 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:01.332918    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-799dfc5879-sgqbb"
Jun 03 01:51:01.333012 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:01.332954    2575 scope.go:117] "RemoveContainer" containerID="0c5164b3a4011b5632f7de8bccbbe89a95277435e2fb7bdcf2cd920ccd6f5358"
Jun 03 01:51:01.333169 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:01.332944    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-799dfc5879-sgqbb" event={"ID":"04b60cac-a86f-405a-a732-e6fabef7ff27","Type":"ContainerDied","Data":"62ad2ee8226323d76c8e3eec037ef7e1c4b425649db0559a8bfe09a80ec73512"}
Jun 03 01:51:01.345610 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:01.345591    2575 scope.go:117] "RemoveContainer" containerID="0c5164b3a4011b5632f7de8bccbbe89a95277435e2fb7bdcf2cd920ccd6f5358"
Jun 03 01:51:01.345892 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:51:01.345868    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c5164b3a4011b5632f7de8bccbbe89a95277435e2fb7bdcf2cd920ccd6f5358\": container with ID starting with 0c5164b3a4011b5632f7de8bccbbe89a95277435e2fb7bdcf2cd920ccd6f5358 not found: ID does not exist" containerID="0c5164b3a4011b5632f7de8bccbbe89a95277435e2fb7bdcf2cd920ccd6f5358"
Jun 03 01:51:01.345938 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:01.345898    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c5164b3a4011b5632f7de8bccbbe89a95277435e2fb7bdcf2cd920ccd6f5358"} err="failed to get container status \"0c5164b3a4011b5632f7de8bccbbe89a95277435e2fb7bdcf2cd920ccd6f5358\": rpc error: code = NotFound desc = could not find container \"0c5164b3a4011b5632f7de8bccbbe89a95277435e2fb7bdcf2cd920ccd6f5358\": container with ID starting with 0c5164b3a4011b5632f7de8bccbbe89a95277435e2fb7bdcf2cd920ccd6f5358 not found: ID does not exist"
Jun 03 01:51:01.356453 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:01.356426    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-799dfc5879-sgqbb"]
Jun 03 01:51:01.358256 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:01.358238    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-799dfc5879-sgqbb"]
Jun 03 01:51:02.412785 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:02.412749    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04b60cac-a86f-405a-a732-e6fabef7ff27" path="/var/lib/kubelet/pods/04b60cac-a86f-405a-a732-e6fabef7ff27/volumes"
Jun 03 01:51:19.871252 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:19.871218    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-75d9d88b9-tv9hg"]
Jun 03 01:51:19.871714 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:19.871485    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04b60cac-a86f-405a-a732-e6fabef7ff27" containerName="manager"
Jun 03 01:51:19.871714 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:19.871496    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="04b60cac-a86f-405a-a732-e6fabef7ff27" containerName="manager"
Jun 03 01:51:19.871714 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:19.871555    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="04b60cac-a86f-405a-a732-e6fabef7ff27" containerName="manager"
Jun 03 01:51:19.874269 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:19.874253    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tv9hg"
Jun 03 01:51:19.876806 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:19.876783    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 03 01:51:19.876932 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:19.876854    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-p2n8v\""
Jun 03 01:51:19.882613 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:19.882588    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-75d9d88b9-tv9hg"]
Jun 03 01:51:19.987129 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:19.987098    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkcqk\" (UniqueName: \"kubernetes.io/projected/52e07907-90d0-4d57-bef6-c23d246ba0aa-kube-api-access-rkcqk\") pod \"payload-pre-processing-75d9d88b9-tv9hg\" (UID: \"52e07907-90d0-4d57-bef6-c23d246ba0aa\") " pod="openshift-ingress/payload-pre-processing-75d9d88b9-tv9hg"
Jun 03 01:51:20.000427 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:20.000403    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:51:20.087874 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:20.087834    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkcqk\" (UniqueName: \"kubernetes.io/projected/52e07907-90d0-4d57-bef6-c23d246ba0aa-kube-api-access-rkcqk\") pod \"payload-pre-processing-75d9d88b9-tv9hg\" (UID: \"52e07907-90d0-4d57-bef6-c23d246ba0aa\") " pod="openshift-ingress/payload-pre-processing-75d9d88b9-tv9hg"
Jun 03 01:51:20.095672 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:20.095639    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkcqk\" (UniqueName: \"kubernetes.io/projected/52e07907-90d0-4d57-bef6-c23d246ba0aa-kube-api-access-rkcqk\") pod \"payload-pre-processing-75d9d88b9-tv9hg\" (UID: \"52e07907-90d0-4d57-bef6-c23d246ba0aa\") " pod="openshift-ingress/payload-pre-processing-75d9d88b9-tv9hg"
Jun 03 01:51:20.184527 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:20.184494    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tv9hg"
Jun 03 01:51:20.304201 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:20.304171    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-75d9d88b9-tv9hg"]
Jun 03 01:51:20.307353 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:51:20.307325    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e07907_90d0_4d57_bef6_c23d246ba0aa.slice/crio-eaf55dd09e37b968d9db3f989aaf4ca95840e8b07fed9f69175a6f6ecb6d8c1b WatchSource:0}: Error finding container eaf55dd09e37b968d9db3f989aaf4ca95840e8b07fed9f69175a6f6ecb6d8c1b: Status 404 returned error can't find the container with id eaf55dd09e37b968d9db3f989aaf4ca95840e8b07fed9f69175a6f6ecb6d8c1b
Jun 03 01:51:20.309528 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:20.309511    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 01:51:20.390539 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:20.390504    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tv9hg" event={"ID":"52e07907-90d0-4d57-bef6-c23d246ba0aa","Type":"ContainerStarted","Data":"eaf55dd09e37b968d9db3f989aaf4ca95840e8b07fed9f69175a6f6ecb6d8c1b"}
Jun 03 01:51:23.400900 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:23.400864    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tv9hg" event={"ID":"52e07907-90d0-4d57-bef6-c23d246ba0aa","Type":"ContainerStarted","Data":"eee12b5082e799e08366e59093a8564337561c63a241afe376c47b514b8ecd92"}
Jun 03 01:51:23.401366 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:23.400958    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tv9hg"
Jun 03 01:51:23.419089 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:23.419046    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tv9hg" podStartSLOduration=2.183717478 podStartE2EDuration="4.41903488s" podCreationTimestamp="2026-06-03 01:51:19 +0000 UTC" firstStartedPulling="2026-06-03 01:51:20.309642183 +0000 UTC m=+686.376232758" lastFinishedPulling="2026-06-03 01:51:22.544959569 +0000 UTC m=+688.611550160" observedRunningTime="2026-06-03 01:51:23.418951221 +0000 UTC m=+689.485541819" watchObservedRunningTime="2026-06-03 01:51:23.41903488 +0000 UTC m=+689.485625478"
Jun 03 01:51:34.406214 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:51:34.406180    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-75d9d88b9-tv9hg"
Jun 03 01:52:09.991897 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:09.991864    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69b8947595-qmslm"]
Jun 03 01:52:09.998323 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:09.998305    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69b8947595-qmslm"
Jun 03 01:52:10.000784 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.000762    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\""
Jun 03 01:52:10.001087 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.001062    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69b8947595-qmslm"]
Jun 03 01:52:10.053752 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.053726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6935352b-a571-4e6a-98df-fe1b76bb7367-oidc-ca\") pod \"authorino-69b8947595-qmslm\" (UID: \"6935352b-a571-4e6a-98df-fe1b76bb7367\") " pod="kuadrant-system/authorino-69b8947595-qmslm"
Jun 03 01:52:10.053874 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.053774    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qk9z\" (UniqueName: \"kubernetes.io/projected/6935352b-a571-4e6a-98df-fe1b76bb7367-kube-api-access-6qk9z\") pod \"authorino-69b8947595-qmslm\" (UID: \"6935352b-a571-4e6a-98df-fe1b76bb7367\") " pod="kuadrant-system/authorino-69b8947595-qmslm"
Jun 03 01:52:10.053874 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.053846    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6935352b-a571-4e6a-98df-fe1b76bb7367-tls-cert\") pod \"authorino-69b8947595-qmslm\" (UID: \"6935352b-a571-4e6a-98df-fe1b76bb7367\") " pod="kuadrant-system/authorino-69b8947595-qmslm"
Jun 03 01:52:10.154390 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.154359    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6935352b-a571-4e6a-98df-fe1b76bb7367-oidc-ca\") pod \"authorino-69b8947595-qmslm\" (UID: \"6935352b-a571-4e6a-98df-fe1b76bb7367\") " pod="kuadrant-system/authorino-69b8947595-qmslm"
Jun 03 01:52:10.154596 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.154402    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6qk9z\" (UniqueName: \"kubernetes.io/projected/6935352b-a571-4e6a-98df-fe1b76bb7367-kube-api-access-6qk9z\") pod \"authorino-69b8947595-qmslm\" (UID: \"6935352b-a571-4e6a-98df-fe1b76bb7367\") " pod="kuadrant-system/authorino-69b8947595-qmslm"
Jun 03 01:52:10.154596 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.154436    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6935352b-a571-4e6a-98df-fe1b76bb7367-tls-cert\") pod \"authorino-69b8947595-qmslm\" (UID: \"6935352b-a571-4e6a-98df-fe1b76bb7367\") " pod="kuadrant-system/authorino-69b8947595-qmslm"
Jun 03 01:52:10.155099 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.155081    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6935352b-a571-4e6a-98df-fe1b76bb7367-oidc-ca\") pod \"authorino-69b8947595-qmslm\" (UID: \"6935352b-a571-4e6a-98df-fe1b76bb7367\") " pod="kuadrant-system/authorino-69b8947595-qmslm"
Jun 03 01:52:10.156973 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.156950    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6935352b-a571-4e6a-98df-fe1b76bb7367-tls-cert\") pod \"authorino-69b8947595-qmslm\" (UID: \"6935352b-a571-4e6a-98df-fe1b76bb7367\") " pod="kuadrant-system/authorino-69b8947595-qmslm"
Jun 03 01:52:10.162187 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.162163    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qk9z\" (UniqueName: \"kubernetes.io/projected/6935352b-a571-4e6a-98df-fe1b76bb7367-kube-api-access-6qk9z\") pod \"authorino-69b8947595-qmslm\" (UID: \"6935352b-a571-4e6a-98df-fe1b76bb7367\") " pod="kuadrant-system/authorino-69b8947595-qmslm"
Jun 03 01:52:10.308106 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.308028    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69b8947595-qmslm"
Jun 03 01:52:10.429232 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.429200    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69b8947595-qmslm"]
Jun 03 01:52:10.432342 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:52:10.432309    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6935352b_a571_4e6a_98df_fe1b76bb7367.slice/crio-a6944ff0b25d577f019d950a68ffb10c179394fa21246011a86e68f8d0776ad4 WatchSource:0}: Error finding container a6944ff0b25d577f019d950a68ffb10c179394fa21246011a86e68f8d0776ad4: Status 404 returned error can't find the container with id a6944ff0b25d577f019d950a68ffb10c179394fa21246011a86e68f8d0776ad4
Jun 03 01:52:10.541394 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:10.541360    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69b8947595-qmslm" event={"ID":"6935352b-a571-4e6a-98df-fe1b76bb7367","Type":"ContainerStarted","Data":"a6944ff0b25d577f019d950a68ffb10c179394fa21246011a86e68f8d0776ad4"}
Jun 03 01:52:11.545979 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:11.545939    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69b8947595-qmslm" event={"ID":"6935352b-a571-4e6a-98df-fe1b76bb7367","Type":"ContainerStarted","Data":"0bcffabcff66caed6f44c36a38bbb15f985b61f7f3162c2fdf443d7a85a6a2db"}
Jun 03 01:52:11.561310 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:11.561263    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-69b8947595-qmslm" podStartSLOduration=2.093209032 podStartE2EDuration="2.56124843s" podCreationTimestamp="2026-06-03 01:52:09 +0000 UTC" firstStartedPulling="2026-06-03 01:52:10.433515945 +0000 UTC m=+736.500106540" lastFinishedPulling="2026-06-03 01:52:10.901555356 +0000 UTC m=+736.968145938" observedRunningTime="2026-06-03 01:52:11.560092561 +0000 UTC m=+737.626683160" watchObservedRunningTime="2026-06-03 01:52:11.56124843 +0000 UTC m=+737.627839079"
Jun 03 01:52:11.584699 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:11.584664    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d5f5d97-jkr5p"]
Jun 03 01:52:11.584884 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:11.584861    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7d5f5d97-jkr5p" podUID="ee325b87-afd1-4f2d-94eb-17e085d81280" containerName="authorino" containerID="cri-o://59907bd01806e51395c405c58e44755e7ba80e10f81fa5a5b9f6ef75b026c53d" gracePeriod=30
Jun 03 01:52:11.834769 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:11.834746    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d5f5d97-jkr5p"
Jun 03 01:52:11.968934 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:11.968899    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwnb5\" (UniqueName: \"kubernetes.io/projected/ee325b87-afd1-4f2d-94eb-17e085d81280-kube-api-access-rwnb5\") pod \"ee325b87-afd1-4f2d-94eb-17e085d81280\" (UID: \"ee325b87-afd1-4f2d-94eb-17e085d81280\") "
Jun 03 01:52:11.969089 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:11.968958    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ee325b87-afd1-4f2d-94eb-17e085d81280-tls-cert\") pod \"ee325b87-afd1-4f2d-94eb-17e085d81280\" (UID: \"ee325b87-afd1-4f2d-94eb-17e085d81280\") "
Jun 03 01:52:11.971183 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:11.971160    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee325b87-afd1-4f2d-94eb-17e085d81280-kube-api-access-rwnb5" (OuterVolumeSpecName: "kube-api-access-rwnb5") pod "ee325b87-afd1-4f2d-94eb-17e085d81280" (UID: "ee325b87-afd1-4f2d-94eb-17e085d81280"). InnerVolumeSpecName "kube-api-access-rwnb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:52:11.979974 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:11.979950    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee325b87-afd1-4f2d-94eb-17e085d81280-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ee325b87-afd1-4f2d-94eb-17e085d81280" (UID: "ee325b87-afd1-4f2d-94eb-17e085d81280"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:52:12.069542 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:12.069447    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ee325b87-afd1-4f2d-94eb-17e085d81280-tls-cert\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:52:12.069542 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:12.069496    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwnb5\" (UniqueName: \"kubernetes.io/projected/ee325b87-afd1-4f2d-94eb-17e085d81280-kube-api-access-rwnb5\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:52:12.550206 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:12.550169    2575 generic.go:358] "Generic (PLEG): container finished" podID="ee325b87-afd1-4f2d-94eb-17e085d81280" containerID="59907bd01806e51395c405c58e44755e7ba80e10f81fa5a5b9f6ef75b026c53d" exitCode=0
Jun 03 01:52:12.550700 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:12.550229    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d5f5d97-jkr5p"
Jun 03 01:52:12.550700 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:12.550257    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d5f5d97-jkr5p" event={"ID":"ee325b87-afd1-4f2d-94eb-17e085d81280","Type":"ContainerDied","Data":"59907bd01806e51395c405c58e44755e7ba80e10f81fa5a5b9f6ef75b026c53d"}
Jun 03 01:52:12.550700 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:12.550294    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d5f5d97-jkr5p" event={"ID":"ee325b87-afd1-4f2d-94eb-17e085d81280","Type":"ContainerDied","Data":"47dbbe0bca34e11bc550e8f03e8c52eab2250a0186870cac18d4c210fb94a785"}
Jun 03 01:52:12.550700 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:12.550312    2575 scope.go:117] "RemoveContainer" containerID="59907bd01806e51395c405c58e44755e7ba80e10f81fa5a5b9f6ef75b026c53d"
Jun 03 01:52:12.557930 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:12.557901    2575 scope.go:117] "RemoveContainer" containerID="59907bd01806e51395c405c58e44755e7ba80e10f81fa5a5b9f6ef75b026c53d"
Jun 03 01:52:12.558158 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:52:12.558138    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59907bd01806e51395c405c58e44755e7ba80e10f81fa5a5b9f6ef75b026c53d\": container with ID starting with 59907bd01806e51395c405c58e44755e7ba80e10f81fa5a5b9f6ef75b026c53d not found: ID does not exist" containerID="59907bd01806e51395c405c58e44755e7ba80e10f81fa5a5b9f6ef75b026c53d"
Jun 03 01:52:12.558206 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:12.558168    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59907bd01806e51395c405c58e44755e7ba80e10f81fa5a5b9f6ef75b026c53d"} err="failed to get container status \"59907bd01806e51395c405c58e44755e7ba80e10f81fa5a5b9f6ef75b026c53d\": rpc error: code = NotFound desc = could not find container \"59907bd01806e51395c405c58e44755e7ba80e10f81fa5a5b9f6ef75b026c53d\": container with ID starting with 59907bd01806e51395c405c58e44755e7ba80e10f81fa5a5b9f6ef75b026c53d not found: ID does not exist"
Jun 03 01:52:12.567154 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:12.567128    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d5f5d97-jkr5p"]
Jun 03 01:52:12.570490 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:12.570452    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d5f5d97-jkr5p"]
Jun 03 01:52:14.412682 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:14.412653    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee325b87-afd1-4f2d-94eb-17e085d81280" path="/var/lib/kubelet/pods/ee325b87-afd1-4f2d-94eb-17e085d81280/volumes"
Jun 03 01:52:18.176982 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:18.176945    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:52:27.371860 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:27.371825    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:52:45.179165 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:52:45.179133    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:53:08.373265 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:53:08.373188    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:53:21.278658 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:53:21.278618    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:53:29.667971 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:53:29.667929    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:54:19.548982 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.548947    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7fc588bfc4-6l4vd"]
Jun 03 01:54:19.549438 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.549231    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee325b87-afd1-4f2d-94eb-17e085d81280" containerName="authorino"
Jun 03 01:54:19.549438 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.549243    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee325b87-afd1-4f2d-94eb-17e085d81280" containerName="authorino"
Jun 03 01:54:19.549438 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.549309    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="ee325b87-afd1-4f2d-94eb-17e085d81280" containerName="authorino"
Jun 03 01:54:19.551923 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.551907    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc588bfc4-6l4vd"
Jun 03 01:54:19.560268 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.560245    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fc588bfc4-6l4vd"]
Jun 03 01:54:19.620204 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.620166    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5dzb\" (UniqueName: \"kubernetes.io/projected/f0a9d747-e231-4825-8809-1562041369e3-kube-api-access-w5dzb\") pod \"authorino-7fc588bfc4-6l4vd\" (UID: \"f0a9d747-e231-4825-8809-1562041369e3\") " pod="kuadrant-system/authorino-7fc588bfc4-6l4vd"
Jun 03 01:54:19.620365 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.620215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f0a9d747-e231-4825-8809-1562041369e3-oidc-ca\") pod \"authorino-7fc588bfc4-6l4vd\" (UID: \"f0a9d747-e231-4825-8809-1562041369e3\") " pod="kuadrant-system/authorino-7fc588bfc4-6l4vd"
Jun 03 01:54:19.620365 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.620307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0a9d747-e231-4825-8809-1562041369e3-tls-cert\") pod \"authorino-7fc588bfc4-6l4vd\" (UID: \"f0a9d747-e231-4825-8809-1562041369e3\") " pod="kuadrant-system/authorino-7fc588bfc4-6l4vd"
Jun 03 01:54:19.721548 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.721519    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f0a9d747-e231-4825-8809-1562041369e3-oidc-ca\") pod \"authorino-7fc588bfc4-6l4vd\" (UID: \"f0a9d747-e231-4825-8809-1562041369e3\") " pod="kuadrant-system/authorino-7fc588bfc4-6l4vd"
Jun 03 01:54:19.721678 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.721579    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0a9d747-e231-4825-8809-1562041369e3-tls-cert\") pod \"authorino-7fc588bfc4-6l4vd\" (UID: \"f0a9d747-e231-4825-8809-1562041369e3\") " pod="kuadrant-system/authorino-7fc588bfc4-6l4vd"
Jun 03 01:54:19.721678 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.721603    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dzb\" (UniqueName: \"kubernetes.io/projected/f0a9d747-e231-4825-8809-1562041369e3-kube-api-access-w5dzb\") pod \"authorino-7fc588bfc4-6l4vd\" (UID: \"f0a9d747-e231-4825-8809-1562041369e3\") " pod="kuadrant-system/authorino-7fc588bfc4-6l4vd"
Jun 03 01:54:19.722170 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.722147    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f0a9d747-e231-4825-8809-1562041369e3-oidc-ca\") pod \"authorino-7fc588bfc4-6l4vd\" (UID: \"f0a9d747-e231-4825-8809-1562041369e3\") " pod="kuadrant-system/authorino-7fc588bfc4-6l4vd"
Jun 03 01:54:19.724074 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.724053    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f0a9d747-e231-4825-8809-1562041369e3-tls-cert\") pod \"authorino-7fc588bfc4-6l4vd\" (UID: \"f0a9d747-e231-4825-8809-1562041369e3\") " pod="kuadrant-system/authorino-7fc588bfc4-6l4vd"
Jun 03 01:54:19.728696 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.728674    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5dzb\" (UniqueName: \"kubernetes.io/projected/f0a9d747-e231-4825-8809-1562041369e3-kube-api-access-w5dzb\") pod \"authorino-7fc588bfc4-6l4vd\" (UID: \"f0a9d747-e231-4825-8809-1562041369e3\") " pod="kuadrant-system/authorino-7fc588bfc4-6l4vd"
Jun 03 01:54:19.861404 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.861321    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fc588bfc4-6l4vd"
Jun 03 01:54:19.982739 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:19.982711    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fc588bfc4-6l4vd"]
Jun 03 01:54:19.985683 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:54:19.985658    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0a9d747_e231_4825_8809_1562041369e3.slice/crio-87ea4bf48d38a40de28aa61f56398e276ce248ce8998fb791525d656462db7f6 WatchSource:0}: Error finding container 87ea4bf48d38a40de28aa61f56398e276ce248ce8998fb791525d656462db7f6: Status 404 returned error can't find the container with id 87ea4bf48d38a40de28aa61f56398e276ce248ce8998fb791525d656462db7f6
Jun 03 01:54:20.943587 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:20.943543    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fc588bfc4-6l4vd" event={"ID":"f0a9d747-e231-4825-8809-1562041369e3","Type":"ContainerStarted","Data":"fe82262812f3ec78888a7e92b5a9c37b253118ac7f1e8becfc7c94351dd17c5a"}
Jun 03 01:54:20.943587 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:20.943589    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fc588bfc4-6l4vd" event={"ID":"f0a9d747-e231-4825-8809-1562041369e3","Type":"ContainerStarted","Data":"87ea4bf48d38a40de28aa61f56398e276ce248ce8998fb791525d656462db7f6"}
Jun 03 01:54:20.994313 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:20.994245    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7fc588bfc4-6l4vd" podStartSLOduration=1.5741501169999998 podStartE2EDuration="1.994224296s" podCreationTimestamp="2026-06-03 01:54:19 +0000 UTC" firstStartedPulling="2026-06-03 01:54:19.98714372 +0000 UTC m=+866.053734301" lastFinishedPulling="2026-06-03 01:54:20.407217899 +0000 UTC m=+866.473808480" observedRunningTime="2026-06-03 01:54:20.965229502 +0000 UTC m=+867.031820101" watchObservedRunningTime="2026-06-03 01:54:20.994224296 +0000 UTC m=+867.060814895"
Jun 03 01:54:20.995514 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:20.995464    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69b8947595-qmslm"]
Jun 03 01:54:20.996952 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:20.996918    2575 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-69b8947595-qmslm" podUID="6935352b-a571-4e6a-98df-fe1b76bb7367" containerName="authorino" containerID="cri-o://0bcffabcff66caed6f44c36a38bbb15f985b61f7f3162c2fdf443d7a85a6a2db" gracePeriod=30
Jun 03 01:54:21.245540 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.245515    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69b8947595-qmslm"
Jun 03 01:54:21.332934 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.332900    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qk9z\" (UniqueName: \"kubernetes.io/projected/6935352b-a571-4e6a-98df-fe1b76bb7367-kube-api-access-6qk9z\") pod \"6935352b-a571-4e6a-98df-fe1b76bb7367\" (UID: \"6935352b-a571-4e6a-98df-fe1b76bb7367\") "
Jun 03 01:54:21.333116 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.332963    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6935352b-a571-4e6a-98df-fe1b76bb7367-oidc-ca\") pod \"6935352b-a571-4e6a-98df-fe1b76bb7367\" (UID: \"6935352b-a571-4e6a-98df-fe1b76bb7367\") "
Jun 03 01:54:21.333116 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.332991    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6935352b-a571-4e6a-98df-fe1b76bb7367-tls-cert\") pod \"6935352b-a571-4e6a-98df-fe1b76bb7367\" (UID: \"6935352b-a571-4e6a-98df-fe1b76bb7367\") "
Jun 03 01:54:21.335269 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.335239    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6935352b-a571-4e6a-98df-fe1b76bb7367-kube-api-access-6qk9z" (OuterVolumeSpecName: "kube-api-access-6qk9z") pod "6935352b-a571-4e6a-98df-fe1b76bb7367" (UID: "6935352b-a571-4e6a-98df-fe1b76bb7367"). InnerVolumeSpecName "kube-api-access-6qk9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 01:54:21.337412 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.337391    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6935352b-a571-4e6a-98df-fe1b76bb7367-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "6935352b-a571-4e6a-98df-fe1b76bb7367" (UID: "6935352b-a571-4e6a-98df-fe1b76bb7367"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 01:54:21.343119 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.343096    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6935352b-a571-4e6a-98df-fe1b76bb7367-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6935352b-a571-4e6a-98df-fe1b76bb7367" (UID: "6935352b-a571-4e6a-98df-fe1b76bb7367"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 01:54:21.433597 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.433570    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qk9z\" (UniqueName: \"kubernetes.io/projected/6935352b-a571-4e6a-98df-fe1b76bb7367-kube-api-access-6qk9z\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:54:21.433597 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.433593    2575 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6935352b-a571-4e6a-98df-fe1b76bb7367-oidc-ca\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:54:21.433725 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.433602    2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6935352b-a571-4e6a-98df-fe1b76bb7367-tls-cert\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 01:54:21.947328 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.947290    2575 generic.go:358] "Generic (PLEG): container finished" podID="6935352b-a571-4e6a-98df-fe1b76bb7367" containerID="0bcffabcff66caed6f44c36a38bbb15f985b61f7f3162c2fdf443d7a85a6a2db" exitCode=0
Jun 03 01:54:21.947695 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.947328    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69b8947595-qmslm" event={"ID":"6935352b-a571-4e6a-98df-fe1b76bb7367","Type":"ContainerDied","Data":"0bcffabcff66caed6f44c36a38bbb15f985b61f7f3162c2fdf443d7a85a6a2db"}
Jun 03 01:54:21.947695 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.947367    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69b8947595-qmslm" event={"ID":"6935352b-a571-4e6a-98df-fe1b76bb7367","Type":"ContainerDied","Data":"a6944ff0b25d577f019d950a68ffb10c179394fa21246011a86e68f8d0776ad4"}
Jun 03 01:54:21.947695 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.947382    2575 scope.go:117] "RemoveContainer" containerID="0bcffabcff66caed6f44c36a38bbb15f985b61f7f3162c2fdf443d7a85a6a2db"
Jun 03 01:54:21.947695 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.947339    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69b8947595-qmslm"
Jun 03 01:54:21.955976 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.955956    2575 scope.go:117] "RemoveContainer" containerID="0bcffabcff66caed6f44c36a38bbb15f985b61f7f3162c2fdf443d7a85a6a2db"
Jun 03 01:54:21.956240 ip-10-0-128-28 kubenswrapper[2575]: E0603 01:54:21.956222    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bcffabcff66caed6f44c36a38bbb15f985b61f7f3162c2fdf443d7a85a6a2db\": container with ID starting with 0bcffabcff66caed6f44c36a38bbb15f985b61f7f3162c2fdf443d7a85a6a2db not found: ID does not exist" containerID="0bcffabcff66caed6f44c36a38bbb15f985b61f7f3162c2fdf443d7a85a6a2db"
Jun 03 01:54:21.956296 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.956248    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bcffabcff66caed6f44c36a38bbb15f985b61f7f3162c2fdf443d7a85a6a2db"} err="failed to get container status \"0bcffabcff66caed6f44c36a38bbb15f985b61f7f3162c2fdf443d7a85a6a2db\": rpc error: code = NotFound desc = could not find container \"0bcffabcff66caed6f44c36a38bbb15f985b61f7f3162c2fdf443d7a85a6a2db\": container with ID starting with 0bcffabcff66caed6f44c36a38bbb15f985b61f7f3162c2fdf443d7a85a6a2db not found: ID does not exist"
Jun 03 01:54:21.967285 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.967261    2575 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69b8947595-qmslm"]
Jun 03 01:54:21.970229 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:21.970208    2575 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-69b8947595-qmslm"]
Jun 03 01:54:22.412575 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:22.412543    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6935352b-a571-4e6a-98df-fe1b76bb7367" path="/var/lib/kubelet/pods/6935352b-a571-4e6a-98df-fe1b76bb7367/volumes"
Jun 03 01:54:52.482046 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:54:52.481963    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:55:01.978110 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:01.978076    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:55:10.567730 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:10.567697    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:55:21.372158 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:21.372123    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:55:30.472693 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:30.472655    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:55:40.368971 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:40.368864    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:55:48.495235 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:48.495202    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69665ccb6d-v2wsp"]
Jun 03 01:55:48.495616 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:48.495460    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6935352b-a571-4e6a-98df-fe1b76bb7367" containerName="authorino"
Jun 03 01:55:48.495616 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:48.495484    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="6935352b-a571-4e6a-98df-fe1b76bb7367" containerName="authorino"
Jun 03 01:55:48.495616 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:48.495544    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="6935352b-a571-4e6a-98df-fe1b76bb7367" containerName="authorino"
Jun 03 01:55:48.498258 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:48.498243    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69665ccb6d-v2wsp"
Jun 03 01:55:48.501636 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:48.501611    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4247v\""
Jun 03 01:55:48.501757 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:48.501690    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 03 01:55:48.509763 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:48.509736    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69665ccb6d-v2wsp"]
Jun 03 01:55:48.578700 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:48.578672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45vc9\" (UniqueName: \"kubernetes.io/projected/5591f8ed-6707-4775-be94-eaa5f2b340c7-kube-api-access-45vc9\") pod \"maas-controller-69665ccb6d-v2wsp\" (UID: \"5591f8ed-6707-4775-be94-eaa5f2b340c7\") " pod="opendatahub/maas-controller-69665ccb6d-v2wsp"
Jun 03 01:55:48.679065 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:48.679036    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-45vc9\" (UniqueName: \"kubernetes.io/projected/5591f8ed-6707-4775-be94-eaa5f2b340c7-kube-api-access-45vc9\") pod \"maas-controller-69665ccb6d-v2wsp\" (UID: \"5591f8ed-6707-4775-be94-eaa5f2b340c7\") " pod="opendatahub/maas-controller-69665ccb6d-v2wsp"
Jun 03 01:55:48.687763 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:48.687737    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45vc9\" (UniqueName: \"kubernetes.io/projected/5591f8ed-6707-4775-be94-eaa5f2b340c7-kube-api-access-45vc9\") pod \"maas-controller-69665ccb6d-v2wsp\" (UID: \"5591f8ed-6707-4775-be94-eaa5f2b340c7\") " pod="opendatahub/maas-controller-69665ccb6d-v2wsp"
Jun 03 01:55:48.808326 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:48.808239    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69665ccb6d-v2wsp"
Jun 03 01:55:48.944341 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:48.944316    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69665ccb6d-v2wsp"]
Jun 03 01:55:48.947163 ip-10-0-128-28 kubenswrapper[2575]: W0603 01:55:48.947135    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5591f8ed_6707_4775_be94_eaa5f2b340c7.slice/crio-c4add0b4199feb31acd5f45dea8c6519dd34d6ff1be13139e1ec3733f7cc0e22 WatchSource:0}: Error finding container c4add0b4199feb31acd5f45dea8c6519dd34d6ff1be13139e1ec3733f7cc0e22: Status 404 returned error can't find the container with id c4add0b4199feb31acd5f45dea8c6519dd34d6ff1be13139e1ec3733f7cc0e22
Jun 03 01:55:49.214191 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:49.214156    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69665ccb6d-v2wsp" event={"ID":"5591f8ed-6707-4775-be94-eaa5f2b340c7","Type":"ContainerStarted","Data":"c4add0b4199feb31acd5f45dea8c6519dd34d6ff1be13139e1ec3733f7cc0e22"}
Jun 03 01:55:50.219004 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:50.218969    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69665ccb6d-v2wsp" event={"ID":"5591f8ed-6707-4775-be94-eaa5f2b340c7","Type":"ContainerStarted","Data":"e6081c7c4768a7326741b8c5263c25c35621d8f0061b9d2cd9666914d11b78a1"}
Jun 03 01:55:50.219388 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:50.219091    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69665ccb6d-v2wsp"
Jun 03 01:55:50.237937 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:55:50.237883    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-69665ccb6d-v2wsp" podStartSLOduration=1.7909770680000001 podStartE2EDuration="2.237870598s" podCreationTimestamp="2026-06-03 01:55:48 +0000 UTC" firstStartedPulling="2026-06-03 01:55:48.94832048 +0000 UTC m=+955.014911057" lastFinishedPulling="2026-06-03 01:55:49.395214008 +0000 UTC m=+955.461804587" observedRunningTime="2026-06-03 01:55:50.236795516 +0000 UTC m=+956.303386114" watchObservedRunningTime="2026-06-03 01:55:50.237870598 +0000 UTC m=+956.304461196"
Jun 03 01:56:01.227510 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:56:01.227457    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69665ccb6d-v2wsp"
Jun 03 01:56:11.978464 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:56:11.978385    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:56:20.173634 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:56:20.173599    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:56:55.175232 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:56:55.175192    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:57:11.173648 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:57:11.173614    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:57:49.177402 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:57:49.177321    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:58:09.267895 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:58:09.267858    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:58:20.074541 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:58:20.074505    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:58:37.278279 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:58:37.278238    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:59:33.671084 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:59:33.671045    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 01:59:43.171598 ip-10-0-128-28 kubenswrapper[2575]: I0603 01:59:43.171563    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:00:00.132546 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:00.132512    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29674200-6vx7v"]
Jun 03 02:00:00.135673 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:00.135656    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674200-6vx7v"
Jun 03 02:00:00.138122 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:00.138100    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6nkl5\""
Jun 03 02:00:00.149419 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:00.149386    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29674200-6vx7v"]
Jun 03 02:00:00.177142 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:00.177102    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:00:00.189167 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:00.189139    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmqcb\" (UniqueName: \"kubernetes.io/projected/44700fbd-7ea3-4b56-b9df-e465e8bdac75-kube-api-access-kmqcb\") pod \"maas-api-key-cleanup-29674200-6vx7v\" (UID: \"44700fbd-7ea3-4b56-b9df-e465e8bdac75\") " pod="opendatahub/maas-api-key-cleanup-29674200-6vx7v"
Jun 03 02:00:00.290464 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:00.290426    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmqcb\" (UniqueName: \"kubernetes.io/projected/44700fbd-7ea3-4b56-b9df-e465e8bdac75-kube-api-access-kmqcb\") pod \"maas-api-key-cleanup-29674200-6vx7v\" (UID: \"44700fbd-7ea3-4b56-b9df-e465e8bdac75\") " pod="opendatahub/maas-api-key-cleanup-29674200-6vx7v"
Jun 03 02:00:00.300859 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:00.300827    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmqcb\" (UniqueName: \"kubernetes.io/projected/44700fbd-7ea3-4b56-b9df-e465e8bdac75-kube-api-access-kmqcb\") pod \"maas-api-key-cleanup-29674200-6vx7v\" (UID: \"44700fbd-7ea3-4b56-b9df-e465e8bdac75\") " pod="opendatahub/maas-api-key-cleanup-29674200-6vx7v"
Jun 03 02:00:00.444611 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:00.444572    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674200-6vx7v"
Jun 03 02:00:00.572113 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:00.572073    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29674200-6vx7v"]
Jun 03 02:00:00.575654 ip-10-0-128-28 kubenswrapper[2575]: W0603 02:00:00.575623    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44700fbd_7ea3_4b56_b9df_e465e8bdac75.slice/crio-8222151c0ccbd2290773ead2bbf9b9f513f6de63eb2720d9cb7c21cacea54dcd WatchSource:0}: Error finding container 8222151c0ccbd2290773ead2bbf9b9f513f6de63eb2720d9cb7c21cacea54dcd: Status 404 returned error can't find the container with id 8222151c0ccbd2290773ead2bbf9b9f513f6de63eb2720d9cb7c21cacea54dcd
Jun 03 02:00:00.577451 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:00.577434    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 02:00:00.960506 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:00.960456    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674200-6vx7v" event={"ID":"44700fbd-7ea3-4b56-b9df-e465e8bdac75","Type":"ContainerStarted","Data":"8222151c0ccbd2290773ead2bbf9b9f513f6de63eb2720d9cb7c21cacea54dcd"}
Jun 03 02:00:06.868291 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:06.868251    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:00:06.980821 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:06.980780    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674200-6vx7v" event={"ID":"44700fbd-7ea3-4b56-b9df-e465e8bdac75","Type":"ContainerStarted","Data":"431c9d8db7ef2181ab1afd4730e9c9fe0f143017d0d4f51ce2c85c32b1cd1689"}
Jun 03 02:00:06.995428 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:06.995384    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29674200-6vx7v" podStartSLOduration=1.441808071 podStartE2EDuration="6.995368574s" podCreationTimestamp="2026-06-03 02:00:00 +0000 UTC" firstStartedPulling="2026-06-03 02:00:00.577617461 +0000 UTC m=+1206.644208038" lastFinishedPulling="2026-06-03 02:00:06.131177965 +0000 UTC m=+1212.197768541" observedRunningTime="2026-06-03 02:00:06.994141525 +0000 UTC m=+1213.060732123" watchObservedRunningTime="2026-06-03 02:00:06.995368574 +0000 UTC m=+1213.061959171"
Jun 03 02:00:07.984867 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:07.984831    2575 generic.go:358] "Generic (PLEG): container finished" podID="44700fbd-7ea3-4b56-b9df-e465e8bdac75" containerID="431c9d8db7ef2181ab1afd4730e9c9fe0f143017d0d4f51ce2c85c32b1cd1689" exitCode=0
Jun 03 02:00:07.984867 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:07.984872    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674200-6vx7v" event={"ID":"44700fbd-7ea3-4b56-b9df-e465e8bdac75","Type":"ContainerDied","Data":"431c9d8db7ef2181ab1afd4730e9c9fe0f143017d0d4f51ce2c85c32b1cd1689"}
Jun 03 02:00:09.111364 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:09.111342    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674200-6vx7v"
Jun 03 02:00:09.155709 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:09.155676    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmqcb\" (UniqueName: \"kubernetes.io/projected/44700fbd-7ea3-4b56-b9df-e465e8bdac75-kube-api-access-kmqcb\") pod \"44700fbd-7ea3-4b56-b9df-e465e8bdac75\" (UID: \"44700fbd-7ea3-4b56-b9df-e465e8bdac75\") "
Jun 03 02:00:09.157852 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:09.157829    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44700fbd-7ea3-4b56-b9df-e465e8bdac75-kube-api-access-kmqcb" (OuterVolumeSpecName: "kube-api-access-kmqcb") pod "44700fbd-7ea3-4b56-b9df-e465e8bdac75" (UID: "44700fbd-7ea3-4b56-b9df-e465e8bdac75"). InnerVolumeSpecName "kube-api-access-kmqcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 02:00:09.256585 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:09.256505    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmqcb\" (UniqueName: \"kubernetes.io/projected/44700fbd-7ea3-4b56-b9df-e465e8bdac75-kube-api-access-kmqcb\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 02:00:09.991825 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:09.991787    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674200-6vx7v" event={"ID":"44700fbd-7ea3-4b56-b9df-e465e8bdac75","Type":"ContainerDied","Data":"8222151c0ccbd2290773ead2bbf9b9f513f6de63eb2720d9cb7c21cacea54dcd"}
Jun 03 02:00:09.991965 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:09.991831    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8222151c0ccbd2290773ead2bbf9b9f513f6de63eb2720d9cb7c21cacea54dcd"
Jun 03 02:00:09.991965 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:09.991806    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674200-6vx7v"
Jun 03 02:00:23.380073 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:23.380040    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:00:32.870126 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:00:32.870091    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:01:04.868815 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:01:04.868772    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:01:13.265711 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:01:13.265673    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:01:21.973998 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:01:21.973964    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:01:30.471534 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:01:30.471499    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:01:38.770019 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:01:38.769987    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:01:56.776708 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:01:56.776672    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:02:08.773299 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:02:08.773221    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:02:56.175819 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:02:56.175786    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:03:02.475832 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:03:02.475794    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:03:09.571067 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:03:09.571032    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:03:19.104584 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:03:19.104544    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:03:28.370119 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:03:28.370083    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:03:37.478539 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:03:37.478494    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:03:46.575999 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:03:46.575918    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:03:53.176904 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:03:53.176862    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:04:04.072545 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:04:04.072502    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:04:10.979232 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:04:10.979195    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:04:19.871634 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:04:19.871594    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:04:28.570455 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:04:28.570419    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:04:38.972293 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:04:38.972254    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:04:45.676199 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:04:45.676159    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:04:56.481499 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:04:56.481438    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:05:02.574185 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:05:02.574143    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:05:13.578226 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:05:13.578151    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:05:20.271630 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:05:20.271593    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:07:39.077126 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:07:39.077091    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:07:47.470728 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:07:47.470689    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:08:09.278281 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:08:09.278197    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:08:18.785419 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:08:18.785381    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:08:27.989968 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:08:27.989933    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:08:38.697017 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:08:38.696979    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:08:47.383653 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:08:47.383620    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:08:56.987052 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:08:56.987014    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:09:07.170871 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:09:07.170834    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:09:16.578564 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:09:16.578526    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:09:25.469710 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:09:25.469669    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:09:36.671990 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:09:36.671951    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:09:45.472646 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:09:45.472612    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:10:21.078652 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:10:21.078617    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:11:03.873123 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:11:03.873086    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:11:10.777684 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:11:10.777590    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:11:21.186041 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:11:21.186007    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:11:28.366805 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:11:28.366766    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:11:37.077304 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:11:37.077267    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:11:50.182968 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:11:50.182933    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:11:59.392428 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:11:59.392383    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:12:07.872123 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:12:07.872087    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:12:18.668933 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:12:18.668895    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:12:25.476737 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:12:25.476689    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:12:35.676436 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:12:35.676401    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:12:47.474689 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:12:47.474613    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:13:04.774145 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:13:04.774105    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:13:13.976345 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:13:13.976306    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:13:23.187858 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:13:23.187826    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:13:29.572073 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:13:29.572040    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:13:46.882047 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:13:46.882005    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:13:55.575403 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:13:55.575364    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:14:04.875531 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:14:04.875494    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:14:13.882986 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:14:13.882952    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:14:22.888948 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:14:22.888907    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:14:30.070861 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:14:30.070825    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:14:38.473033 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:14:38.473000    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:14:52.382263 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:14:52.382216    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:15:00.135709 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.135670    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29674215-vzq24"]
Jun 03 02:15:00.136172 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.135971    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44700fbd-7ea3-4b56-b9df-e465e8bdac75" containerName="cleanup"
Jun 03 02:15:00.136172 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.135982    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="44700fbd-7ea3-4b56-b9df-e465e8bdac75" containerName="cleanup"
Jun 03 02:15:00.136172 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.136039    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="44700fbd-7ea3-4b56-b9df-e465e8bdac75" containerName="cleanup"
Jun 03 02:15:00.138926 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.138909    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674215-vzq24"
Jun 03 02:15:00.143129 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.143114    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6nkl5\""
Jun 03 02:15:00.166389 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.166354    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29674215-vzq24"]
Jun 03 02:15:00.233768 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.233729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dfbd\" (UniqueName: \"kubernetes.io/projected/4d8db161-cd22-401a-9130-2a5c32d01808-kube-api-access-9dfbd\") pod \"maas-api-key-cleanup-29674215-vzq24\" (UID: \"4d8db161-cd22-401a-9130-2a5c32d01808\") " pod="opendatahub/maas-api-key-cleanup-29674215-vzq24"
Jun 03 02:15:00.335030 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.334990    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9dfbd\" (UniqueName: \"kubernetes.io/projected/4d8db161-cd22-401a-9130-2a5c32d01808-kube-api-access-9dfbd\") pod \"maas-api-key-cleanup-29674215-vzq24\" (UID: \"4d8db161-cd22-401a-9130-2a5c32d01808\") " pod="opendatahub/maas-api-key-cleanup-29674215-vzq24"
Jun 03 02:15:00.344957 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.344933    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dfbd\" (UniqueName: \"kubernetes.io/projected/4d8db161-cd22-401a-9130-2a5c32d01808-kube-api-access-9dfbd\") pod \"maas-api-key-cleanup-29674215-vzq24\" (UID: \"4d8db161-cd22-401a-9130-2a5c32d01808\") " pod="opendatahub/maas-api-key-cleanup-29674215-vzq24"
Jun 03 02:15:00.448769 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.448729    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674215-vzq24"
Jun 03 02:15:00.581318 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.581285    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29674215-vzq24"]
Jun 03 02:15:00.584126 ip-10-0-128-28 kubenswrapper[2575]: W0603 02:15:00.584099    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8db161_cd22_401a_9130_2a5c32d01808.slice/crio-8fe893929b745066a205bf22a6f61bedb1507d3377892d18c0c881da1eca57b9 WatchSource:0}: Error finding container 8fe893929b745066a205bf22a6f61bedb1507d3377892d18c0c881da1eca57b9: Status 404 returned error can't find the container with id 8fe893929b745066a205bf22a6f61bedb1507d3377892d18c0c881da1eca57b9
Jun 03 02:15:00.585956 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.585939    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 02:15:00.685538 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:00.685503    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674215-vzq24" event={"ID":"4d8db161-cd22-401a-9130-2a5c32d01808","Type":"ContainerStarted","Data":"8fe893929b745066a205bf22a6f61bedb1507d3377892d18c0c881da1eca57b9"}
Jun 03 02:15:01.690078 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:01.690045    2575 generic.go:358] "Generic (PLEG): container finished" podID="4d8db161-cd22-401a-9130-2a5c32d01808" containerID="2ae927d806e2f321df299a096f1b42b04f9076ee0b8b9a980396e876e6e95922" exitCode=0
Jun 03 02:15:01.690514 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:01.690084    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674215-vzq24" event={"ID":"4d8db161-cd22-401a-9130-2a5c32d01808","Type":"ContainerDied","Data":"2ae927d806e2f321df299a096f1b42b04f9076ee0b8b9a980396e876e6e95922"}
Jun 03 02:15:02.819745 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:02.819717    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674215-vzq24"
Jun 03 02:15:02.874567 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:02.874529    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:15:02.958350 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:02.958262    2575 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dfbd\" (UniqueName: \"kubernetes.io/projected/4d8db161-cd22-401a-9130-2a5c32d01808-kube-api-access-9dfbd\") pod \"4d8db161-cd22-401a-9130-2a5c32d01808\" (UID: \"4d8db161-cd22-401a-9130-2a5c32d01808\") "
Jun 03 02:15:02.960732 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:02.960707    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d8db161-cd22-401a-9130-2a5c32d01808-kube-api-access-9dfbd" (OuterVolumeSpecName: "kube-api-access-9dfbd") pod "4d8db161-cd22-401a-9130-2a5c32d01808" (UID: "4d8db161-cd22-401a-9130-2a5c32d01808"). InnerVolumeSpecName "kube-api-access-9dfbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 02:15:03.059102 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:03.059065    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dfbd\" (UniqueName: \"kubernetes.io/projected/4d8db161-cd22-401a-9130-2a5c32d01808-kube-api-access-9dfbd\") on node \"ip-10-0-128-28.ec2.internal\" DevicePath \"\""
Jun 03 02:15:03.698027 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:03.697988    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29674215-vzq24" event={"ID":"4d8db161-cd22-401a-9130-2a5c32d01808","Type":"ContainerDied","Data":"8fe893929b745066a205bf22a6f61bedb1507d3377892d18c0c881da1eca57b9"}
Jun 03 02:15:03.698027 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:03.698028    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fe893929b745066a205bf22a6f61bedb1507d3377892d18c0c881da1eca57b9"
Jun 03 02:15:03.698228 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:03.698043    2575 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29674215-vzq24"
Jun 03 02:15:16.672234 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:16.672198    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:15:26.779299 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:26.779262    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:15:35.576217 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:35.576181    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:15:46.375177 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:46.375098    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:15:57.676287 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:15:57.676245    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:16:14.367550 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:16:14.367515    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:16:23.172811 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:16:23.172761    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:16:32.185541 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:16:32.185500    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:16:39.970877 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:16:39.970833    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:17:05.074385 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:05.074347    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:17:17.775256 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:17.775216    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-5rv89"]
Jun 03 02:17:23.601280 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:23.601244    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fc588bfc4-6l4vd_f0a9d747-e231-4825-8809-1562041369e3/authorino/0.log"
Jun 03 02:17:28.945910 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:28.945876    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29674200-6vx7v_44700fbd-7ea3-4b56-b9df-e465e8bdac75/cleanup/0.log"
Jun 03 02:17:29.064725 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:29.064692    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29674215-vzq24_4d8db161-cd22-401a-9130-2a5c32d01808/cleanup/0.log"
Jun 03 02:17:29.177144 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:29.177114    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69665ccb6d-v2wsp_5591f8ed-6707-4775-be94-eaa5f2b340c7/manager/0.log"
Jun 03 02:17:29.635259 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:29.635231    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f9cd4ffb9-884f5_79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f/copy-manifests/0.log"
Jun 03 02:17:29.642069 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:29.642044    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f9cd4ffb9-884f5_79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f/manager/0.log"
Jun 03 02:17:31.147099 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:31.147068    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fc588bfc4-6l4vd_f0a9d747-e231-4825-8809-1562041369e3/authorino/0.log"
Jun 03 02:17:31.487000 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:31.486973    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-n5h6p_6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb/kuadrant-console-plugin/0.log"
Jun 03 02:17:31.853020 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:31.852948    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-5rv89_8c3411e8-bde6-487d-bc9f-a3cd05b81a72/limitador/0.log"
Jun 03 02:17:32.536262 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:32.536235    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-889cb89c5-69lsj_26b8ec99-86f4-4518-880c-b4d1b15c0e70/kube-auth-proxy/0.log"
Jun 03 02:17:32.900563 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:32.900493    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-75d9d88b9-tv9hg_52e07907-90d0-4d57-bef6-c23d246ba0aa/payload-pre-processing/0.log"
Jun 03 02:17:37.779157 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.779120    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x4cvb/must-gather-rhs2d"]
Jun 03 02:17:37.779552 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.779400    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d8db161-cd22-401a-9130-2a5c32d01808" containerName="cleanup"
Jun 03 02:17:37.779552 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.779410    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d8db161-cd22-401a-9130-2a5c32d01808" containerName="cleanup"
Jun 03 02:17:37.779552 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.779483    2575 memory_manager.go:356] "RemoveStaleState removing state" podUID="4d8db161-cd22-401a-9130-2a5c32d01808" containerName="cleanup"
Jun 03 02:17:37.782529 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.782514    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4cvb/must-gather-rhs2d"
Jun 03 02:17:37.784868 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.784843    2575 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x4cvb\"/\"default-dockercfg-fv2mg\""
Jun 03 02:17:37.784969 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.784909    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x4cvb\"/\"kube-root-ca.crt\""
Jun 03 02:17:37.785020 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.784984    2575 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x4cvb\"/\"openshift-service-ca.crt\""
Jun 03 02:17:37.800488 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.800448    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4cvb/must-gather-rhs2d"]
Jun 03 02:17:37.875873 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.875837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvfn2\" (UniqueName: \"kubernetes.io/projected/74ef70bc-2283-4765-ab62-39e3d783c7d0-kube-api-access-nvfn2\") pod \"must-gather-rhs2d\" (UID: \"74ef70bc-2283-4765-ab62-39e3d783c7d0\") " pod="openshift-must-gather-x4cvb/must-gather-rhs2d"
Jun 03 02:17:37.875873 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.875877    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/74ef70bc-2283-4765-ab62-39e3d783c7d0-must-gather-output\") pod \"must-gather-rhs2d\" (UID: \"74ef70bc-2283-4765-ab62-39e3d783c7d0\") " pod="openshift-must-gather-x4cvb/must-gather-rhs2d"
Jun 03 02:17:37.977206 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.977166    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nvfn2\" (UniqueName: \"kubernetes.io/projected/74ef70bc-2283-4765-ab62-39e3d783c7d0-kube-api-access-nvfn2\") pod \"must-gather-rhs2d\" (UID: \"74ef70bc-2283-4765-ab62-39e3d783c7d0\") " pod="openshift-must-gather-x4cvb/must-gather-rhs2d"
Jun 03 02:17:37.977206 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.977208    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/74ef70bc-2283-4765-ab62-39e3d783c7d0-must-gather-output\") pod \"must-gather-rhs2d\" (UID: \"74ef70bc-2283-4765-ab62-39e3d783c7d0\") " pod="openshift-must-gather-x4cvb/must-gather-rhs2d"
Jun 03 02:17:37.977520 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.977505    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/74ef70bc-2283-4765-ab62-39e3d783c7d0-must-gather-output\") pod \"must-gather-rhs2d\" (UID: \"74ef70bc-2283-4765-ab62-39e3d783c7d0\") " pod="openshift-must-gather-x4cvb/must-gather-rhs2d"
Jun 03 02:17:37.985701 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:37.985678    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvfn2\" (UniqueName: \"kubernetes.io/projected/74ef70bc-2283-4765-ab62-39e3d783c7d0-kube-api-access-nvfn2\") pod \"must-gather-rhs2d\" (UID: \"74ef70bc-2283-4765-ab62-39e3d783c7d0\") " pod="openshift-must-gather-x4cvb/must-gather-rhs2d"
Jun 03 02:17:38.092002 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:38.091920    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4cvb/must-gather-rhs2d"
Jun 03 02:17:38.224077 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:38.224038    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4cvb/must-gather-rhs2d"]
Jun 03 02:17:38.226950 ip-10-0-128-28 kubenswrapper[2575]: W0603 02:17:38.226914    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74ef70bc_2283_4765_ab62_39e3d783c7d0.slice/crio-63ef8216830ac75f9f3b8b146d3bb8ec426dea43dccb5d8273fe8d174eccaaf3 WatchSource:0}: Error finding container 63ef8216830ac75f9f3b8b146d3bb8ec426dea43dccb5d8273fe8d174eccaaf3: Status 404 returned error can't find the container with id 63ef8216830ac75f9f3b8b146d3bb8ec426dea43dccb5d8273fe8d174eccaaf3
Jun 03 02:17:39.177489 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:39.177442    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4cvb/must-gather-rhs2d" event={"ID":"74ef70bc-2283-4765-ab62-39e3d783c7d0","Type":"ContainerStarted","Data":"63ef8216830ac75f9f3b8b146d3bb8ec426dea43dccb5d8273fe8d174eccaaf3"}
Jun 03 02:17:40.183211 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:40.183171    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4cvb/must-gather-rhs2d" event={"ID":"74ef70bc-2283-4765-ab62-39e3d783c7d0","Type":"ContainerStarted","Data":"cc9003377346f4aab3d4905d4d5baddbf5a88a247f07b87bd5c041737cfded52"}
Jun 03 02:17:40.183211 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:40.183220    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4cvb/must-gather-rhs2d" event={"ID":"74ef70bc-2283-4765-ab62-39e3d783c7d0","Type":"ContainerStarted","Data":"b104444491d8d54a00526d847103a65c06988ab61307af13e8174cd1267c8c11"}
Jun 03 02:17:40.199819 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:40.199759    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-x4cvb/must-gather-rhs2d" podStartSLOduration=2.21281564 podStartE2EDuration="3.199740748s" podCreationTimestamp="2026-06-03 02:17:37 +0000 UTC" firstStartedPulling="2026-06-03 02:17:38.228796324 +0000 UTC m=+2264.295386901" lastFinishedPulling="2026-06-03 02:17:39.215721431 +0000 UTC m=+2265.282312009" observedRunningTime="2026-06-03 02:17:40.19887666 +0000 UTC m=+2266.265467260" watchObservedRunningTime="2026-06-03 02:17:40.199740748 +0000 UTC m=+2266.266331346"
Jun 03 02:17:41.045521 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:41.045456    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d8xk6_23b03bcf-4e82-41c6-ba74-9adeef24601a/global-pull-secret-syncer/0.log"
Jun 03 02:17:41.164030 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:41.163999    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mtm54_a94e5062-a17b-4233-a08c-815d443426ae/konnectivity-agent/0.log"
Jun 03 02:17:41.216983 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:41.216941    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-28.ec2.internal_23d8c441f7d9cf4fc58ff38513145034/haproxy/0.log"
Jun 03 02:17:45.358500 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:45.358443    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fc588bfc4-6l4vd_f0a9d747-e231-4825-8809-1562041369e3/authorino/0.log"
Jun 03 02:17:45.435936 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:45.435901    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-n5h6p_6c3bfd1f-e8e1-4eae-aa59-e0c230c86beb/kuadrant-console-plugin/0.log"
Jun 03 02:17:45.578751 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:45.578712    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-5rv89_8c3411e8-bde6-487d-bc9f-a3cd05b81a72/limitador/0.log"
Jun 03 02:17:47.441341 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:47.441310    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ssqrd_f7e20e00-2d75-4eac-81ce-8174e1708cf5/node-exporter/0.log"
Jun 03 02:17:47.462601 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:47.462573    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ssqrd_f7e20e00-2d75-4eac-81ce-8174e1708cf5/kube-rbac-proxy/0.log"
Jun 03 02:17:47.484457 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:47.484432    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ssqrd_f7e20e00-2d75-4eac-81ce-8174e1708cf5/init-textfile/0.log"
Jun 03 02:17:49.340373 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:49.340343    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-7rc7v_ba3954ce-9e0f-4878-b9b2-a393fef74854/networking-console-plugin/0.log"
Jun 03 02:17:51.701834 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.701799    2575 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"]
Jun 03 02:17:51.707036 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.707014    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.710936 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.710912    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"]
Jun 03 02:17:51.789975 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.789947    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d6x6x_bf23fc51-f1a1-437d-8d16-b763938cd7ed/dns/0.log"
Jun 03 02:17:51.800765 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.800737    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a33953f3-9827-4808-beb5-9d978a8db32e-proc\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.800919 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.800796    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a33953f3-9827-4808-beb5-9d978a8db32e-podres\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.800919 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.800825    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a33953f3-9827-4808-beb5-9d978a8db32e-lib-modules\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.800919 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.800869    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a33953f3-9827-4808-beb5-9d978a8db32e-sys\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.800919 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.800903    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7djs\" (UniqueName: \"kubernetes.io/projected/a33953f3-9827-4808-beb5-9d978a8db32e-kube-api-access-n7djs\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.813927 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.813909    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d6x6x_bf23fc51-f1a1-437d-8d16-b763938cd7ed/kube-rbac-proxy/0.log"
Jun 03 02:17:51.885406 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.885383    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-49zpw_0739bcf0-bee6-4fcf-be88-6bd78ed71465/dns-node-resolver/0.log"
Jun 03 02:17:51.902186 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.902160    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a33953f3-9827-4808-beb5-9d978a8db32e-proc\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.902297 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.902194    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a33953f3-9827-4808-beb5-9d978a8db32e-podres\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.902297 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.902211    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a33953f3-9827-4808-beb5-9d978a8db32e-lib-modules\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.902297 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.902281    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a33953f3-9827-4808-beb5-9d978a8db32e-proc\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.902495 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.902283    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a33953f3-9827-4808-beb5-9d978a8db32e-sys\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.902495 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.902317    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a33953f3-9827-4808-beb5-9d978a8db32e-podres\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.902495 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.902322    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a33953f3-9827-4808-beb5-9d978a8db32e-lib-modules\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.902495 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.902354    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a33953f3-9827-4808-beb5-9d978a8db32e-sys\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.902495 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.902362    2575 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7djs\" (UniqueName: \"kubernetes.io/projected/a33953f3-9827-4808-beb5-9d978a8db32e-kube-api-access-n7djs\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:51.910487 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:51.910450    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7djs\" (UniqueName: \"kubernetes.io/projected/a33953f3-9827-4808-beb5-9d978a8db32e-kube-api-access-n7djs\") pod \"perf-node-gather-daemonset-5sjwx\" (UID: \"a33953f3-9827-4808-beb5-9d978a8db32e\") " pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:52.019428 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:52.019335    2575 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:52.161198 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:52.161141    2575 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"]
Jun 03 02:17:52.163583 ip-10-0-128-28 kubenswrapper[2575]: W0603 02:17:52.163541    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda33953f3_9827_4808_beb5_9d978a8db32e.slice/crio-bb4d38ea7ff496668cfc10abb1aeb887cbbf06b2e68152d890f76fb65e4ec0ba WatchSource:0}: Error finding container bb4d38ea7ff496668cfc10abb1aeb887cbbf06b2e68152d890f76fb65e4ec0ba: Status 404 returned error can't find the container with id bb4d38ea7ff496668cfc10abb1aeb887cbbf06b2e68152d890f76fb65e4ec0ba
Jun 03 02:17:52.239247 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:52.239214    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx" event={"ID":"a33953f3-9827-4808-beb5-9d978a8db32e","Type":"ContainerStarted","Data":"bb4d38ea7ff496668cfc10abb1aeb887cbbf06b2e68152d890f76fb65e4ec0ba"}
Jun 03 02:17:52.457150 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:52.457115    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v6pmr_d1bb080f-a4e1-4cbc-8954-ddd6a29939f0/node-ca/0.log"
Jun 03 02:17:53.243830 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:53.243787    2575 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx" event={"ID":"a33953f3-9827-4808-beb5-9d978a8db32e","Type":"ContainerStarted","Data":"20ef37bc23d5eda7f398119243c1da415b1d2ca52e8e9cd59b0d76f0940bc6c1"}
Jun 03 02:17:53.244242 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:53.243909    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:17:53.260981 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:53.260935    2575 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx" podStartSLOduration=2.260920559 podStartE2EDuration="2.260920559s" podCreationTimestamp="2026-06-03 02:17:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 02:17:53.259795694 +0000 UTC m=+2279.326386293" watchObservedRunningTime="2026-06-03 02:17:53.260920559 +0000 UTC m=+2279.327511157"
Jun 03 02:17:53.344687 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:53.344655    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-889cb89c5-69lsj_26b8ec99-86f4-4518-880c-b4d1b15c0e70/kube-auth-proxy/0.log"
Jun 03 02:17:53.471234 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:53.471202    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-75d9d88b9-tv9hg_52e07907-90d0-4d57-bef6-c23d246ba0aa/payload-pre-processing/0.log"
Jun 03 02:17:54.083326 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:54.083298    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f9b9x_681b8472-6edf-4780-8b1e-4621ebfa1772/serve-healthcheck-canary/0.log"
Jun 03 02:17:54.536229 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:54.536200    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8k275_f8ea660a-c934-4cc5-9f78-bdf4b074ae84/kube-rbac-proxy/0.log"
Jun 03 02:17:54.556324 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:54.556297    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8k275_f8ea660a-c934-4cc5-9f78-bdf4b074ae84/exporter/0.log"
Jun 03 02:17:54.576040 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:54.576012    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8k275_f8ea660a-c934-4cc5-9f78-bdf4b074ae84/extractor/0.log"
Jun 03 02:17:56.961354 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:56.961325    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29674200-6vx7v_44700fbd-7ea3-4b56-b9df-e465e8bdac75/cleanup/0.log"
Jun 03 02:17:56.984002 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:56.983972    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29674215-vzq24_4d8db161-cd22-401a-9130-2a5c32d01808/cleanup/0.log"
Jun 03 02:17:57.062420 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:57.062381    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69665ccb6d-v2wsp_5591f8ed-6707-4775-be94-eaa5f2b340c7/manager/0.log"
Jun 03 02:17:57.197953 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:57.197921    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f9cd4ffb9-884f5_79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f/manager/0.log"
Jun 03 02:17:57.218090 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:57.218028    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f9cd4ffb9-884f5_79d6fbbd-8f8a-4fde-89b6-d5d477cdce3f/copy-manifests/0.log"
Jun 03 02:17:58.652125 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:58.652100    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bc87d8b78-dmqvr_e3bd324c-791c-4973-ab35-1d4254773892/manager/0.log"
Jun 03 02:17:59.257968 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:17:59.257936    2575 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x4cvb/perf-node-gather-daemonset-5sjwx"
Jun 03 02:18:04.734462 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:04.734433    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8bp44_d1e17d65-b640-4e47-8a9c-48b82f1c5d19/kube-multus-additional-cni-plugins/0.log"
Jun 03 02:18:04.755995 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:04.755963    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8bp44_d1e17d65-b640-4e47-8a9c-48b82f1c5d19/egress-router-binary-copy/0.log"
Jun 03 02:18:04.776772 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:04.776745    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8bp44_d1e17d65-b640-4e47-8a9c-48b82f1c5d19/cni-plugins/0.log"
Jun 03 02:18:04.798984 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:04.798960    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8bp44_d1e17d65-b640-4e47-8a9c-48b82f1c5d19/bond-cni-plugin/0.log"
Jun 03 02:18:04.819898 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:04.819876    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8bp44_d1e17d65-b640-4e47-8a9c-48b82f1c5d19/routeoverride-cni/0.log"
Jun 03 02:18:04.842102 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:04.842080    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8bp44_d1e17d65-b640-4e47-8a9c-48b82f1c5d19/whereabouts-cni-bincopy/0.log"
Jun 03 02:18:04.862580 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:04.862556    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8bp44_d1e17d65-b640-4e47-8a9c-48b82f1c5d19/whereabouts-cni/0.log"
Jun 03 02:18:05.208440 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:05.208403    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dpfst_fd99af95-239e-443d-9728-d39e3d460a6a/kube-multus/0.log"
Jun 03 02:18:05.328778 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:05.328750    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gnbxx_0986221d-f836-4f45-983e-f6aa7b4b7b1d/network-metrics-daemon/0.log"
Jun 03 02:18:05.347793 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:05.347771    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gnbxx_0986221d-f836-4f45-983e-f6aa7b4b7b1d/kube-rbac-proxy/0.log"
Jun 03 02:18:06.456046 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:06.456013    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8jxk_8609ed51-6f91-4a98-877b-082601476a8b/ovn-controller/0.log"
Jun 03 02:18:06.483789 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:06.483754    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8jxk_8609ed51-6f91-4a98-877b-082601476a8b/ovn-acl-logging/0.log"
Jun 03 02:18:06.501861 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:06.501835    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8jxk_8609ed51-6f91-4a98-877b-082601476a8b/kube-rbac-proxy-node/0.log"
Jun 03 02:18:06.523131 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:06.523105    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8jxk_8609ed51-6f91-4a98-877b-082601476a8b/kube-rbac-proxy-ovn-metrics/0.log"
Jun 03 02:18:06.541091 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:06.541066    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8jxk_8609ed51-6f91-4a98-877b-082601476a8b/northd/0.log"
Jun 03 02:18:06.560840 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:06.560815    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8jxk_8609ed51-6f91-4a98-877b-082601476a8b/nbdb/0.log"
Jun 03 02:18:06.581730 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:06.581703    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8jxk_8609ed51-6f91-4a98-877b-082601476a8b/sbdb/0.log"
Jun 03 02:18:06.685967 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:06.685935    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8jxk_8609ed51-6f91-4a98-877b-082601476a8b/ovnkube-controller/0.log"
Jun 03 02:18:08.015266 ip-10-0-128-28 kubenswrapper[2575]: I0603 02:18:08.015238    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2w4c2_93e979a5-f2c5-4ba7-baae-859678f21bcf/network-check-target-container/0.log"