May 21 15:31:30.309424 ip-10-0-135-228 systemd[1]: Starting Kubernetes Kubelet...
May 21 15:31:30.757679 ip-10-0-135-228 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 15:31:30.757679 ip-10-0-135-228 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 15:31:30.757679 ip-10-0-135-228 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 15:31:30.757679 ip-10-0-135-228 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 15:31:30.757679 ip-10-0-135-228 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 15:31:30.761189 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.761085    2569 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 15:31:30.763916 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763901    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:31:30.763916 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763916    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763920    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763923    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763926    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763930    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763933    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763935    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763938    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763940    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763944    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763950    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763953    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763955    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763958    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763961    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763963    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763966    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763968    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763971    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763974    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:31:30.763982 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763976    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763979    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763981    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763984    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763987    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763990    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763992    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763995    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.763998    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764001    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764003    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764006    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764009    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764011    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764014    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764016    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764019    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764021    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764024    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:31:30.764600 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764027    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764029    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764031    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764034    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764038    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764042    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764045    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764048    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764051    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764053    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764056    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764058    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764061    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764064    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764067    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764070    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764073    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764076    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764079    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764081    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:31:30.765076 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764084    2569 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764087    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764090    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764093    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764095    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764098    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764100    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764103    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764106    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764108    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764111    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764114    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764116    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764130    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764133    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764136    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764138    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764141    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764144    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764149    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:31:30.765608 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764152    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:31:30.766090 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764157    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:31:30.766090 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764159    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:31:30.766090 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764162    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:31:30.766090 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764164    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:31:30.766090 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.764167    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:31:30.767921 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767903    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:31:30.767921 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767917    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:31:30.767921 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767921    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:31:30.767921 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767924    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:31:30.767921 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767927    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767931    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767934    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767938    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767942    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767947    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767951    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767954    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767957    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767960    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767962    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767965    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767968    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767970    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767973    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767975    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767978    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767981    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767984    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:31:30.768116 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767986    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767989    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767991    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767994    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767996    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.767999    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768001    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768004    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768008    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768010    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768013    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768015    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768018    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768020    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768023    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768026    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768029    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768032    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768034    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768037    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:31:30.768603 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768040    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768043    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768045    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768048    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768051    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768053    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768056    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768058    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768061    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768064    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768066    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768069    2569 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768072    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768075    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768077    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768080    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768082    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768085    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768087    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768090    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:31:30.769149 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768092    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768095    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768097    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768100    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768103    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768105    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768108    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768111    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768114    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768117    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768132    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768134    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768137    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768140    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768143    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768147    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768149    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768153    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768155    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768158    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:31:30.769650 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768161    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768164    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768166    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768242    2569 flags.go:64] FLAG: --address="0.0.0.0"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768250    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768257    2569 flags.go:64] FLAG: --anonymous-auth="true"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768261    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768265    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768268    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768273    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768277    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768281    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768284    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768287    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768290    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768294    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768297    2569 flags.go:64] FLAG: --cgroup-root=""
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768300    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768303    2569 flags.go:64] FLAG: --client-ca-file=""
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768307    2569 flags.go:64] FLAG: --cloud-config=""
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768310    2569 flags.go:64] FLAG: --cloud-provider="external"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768313    2569 flags.go:64] FLAG: --cluster-dns="[]"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768318    2569 flags.go:64] FLAG: --cluster-domain=""
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768321    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 15:31:30.770156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768324    2569 flags.go:64] FLAG: --config-dir=""
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768327    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768330    2569 flags.go:64] FLAG: --container-log-max-files="5"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768334    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768339    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768343    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768346    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768349    2569 flags.go:64] FLAG: --contention-profiling="false"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768353    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768355    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768359    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768362    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768366    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768369    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768372    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768374    2569 flags.go:64] FLAG: --enable-load-reader="false"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768377    2569 flags.go:64] FLAG: --enable-server="true"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768380    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768385    2569 flags.go:64] FLAG: --event-burst="100"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768388    2569 flags.go:64] FLAG: --event-qps="50"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768391    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768395    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768398    2569 flags.go:64] FLAG: --eviction-hard=""
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768402    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 15:31:30.770738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768405    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768408    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768411    2569 flags.go:64] FLAG: --eviction-soft=""
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768415    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768417    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768420    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768423    2569 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768426    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768429    2569 flags.go:64] FLAG: --fail-swap-on="true"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768432    2569 flags.go:64] FLAG: --feature-gates=""
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768436    2569 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768440    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768443    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768447    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768450    2569 flags.go:64] FLAG: --healthz-port="10248"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768453    2569 flags.go:64] FLAG: --help="false"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768456    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-135-228.ec2.internal"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768459    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768462    2569 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768465    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768469    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768472    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768475    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 15:31:30.771335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768478    2569 flags.go:64] FLAG: --image-service-endpoint=""
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768481    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768483    2569 flags.go:64] FLAG: --kube-api-burst="100"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768486    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768489    2569 flags.go:64] FLAG: --kube-api-qps="50"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768492    2569 flags.go:64] FLAG: --kube-reserved=""
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768496    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768499    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768502    2569 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768505    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768508    2569 flags.go:64] FLAG: --lock-file=""
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768511    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768514    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768517    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768523    2569 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768526    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768529    2569 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768532    2569 flags.go:64] FLAG: --logging-format="text"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768535    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768539    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768542    2569 flags.go:64] FLAG: --manifest-url=""
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768544    2569 flags.go:64] FLAG: --manifest-url-header=""
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768549    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768554    2569 flags.go:64] FLAG: --max-open-files="1000000"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768558    2569 flags.go:64] FLAG: --max-pods="110"
May 21 15:31:30.771906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768561    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768564    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768567    2569 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768570    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768573    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768576    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768580    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768587    2569 flags.go:64] FLAG: --node-status-max-images="50"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768590    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768593    2569 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768596    2569 flags.go:64] FLAG: --pod-cidr=""
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768599    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768605    2569 flags.go:64] FLAG: --pod-manifest-path=""
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768608    2569 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768616    2569 flags.go:64] FLAG: --pods-per-core="0"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768618    2569 flags.go:64] FLAG: --port="10250"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768622    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768625    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08ce40990487dd7ae"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768628    2569 flags.go:64] FLAG: --qos-reserved=""
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768631    2569 flags.go:64] FLAG: --read-only-port="10255"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768633    2569 flags.go:64] FLAG: --register-node="true"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768636    2569 flags.go:64] FLAG: --register-schedulable="true"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768639    2569 flags.go:64] FLAG: --register-with-taints=""
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768643    2569 flags.go:64] FLAG: --registry-burst="10"
May 21 15:31:30.772521 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768646    2569 flags.go:64] FLAG: --registry-qps="5"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768649    2569 flags.go:64] FLAG: --reserved-cpus=""
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768651    2569 flags.go:64] FLAG: --reserved-memory=""
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768655    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768658    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768661    2569 flags.go:64] FLAG: --rotate-certificates="false"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768664    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768667    2569 flags.go:64] FLAG: --runonce="false"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768670    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768674    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768676    2569 flags.go:64] FLAG: --seccomp-default="false"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768680    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768683    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768686    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768689    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768692    2569 flags.go:64] FLAG: --storage-driver-password="root"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768695    2569 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768698    2569 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768701    2569 flags.go:64] FLAG: --storage-driver-user="root"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768704    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768707    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768709    2569 flags.go:64] FLAG: --system-cgroups=""
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768714    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768719    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768721    2569 flags.go:64] FLAG: --tls-cert-file=""
May 21 15:31:30.773136 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768724    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768729    2569 flags.go:64] FLAG: --tls-min-version=""
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768732    2569 flags.go:64] FLAG: --tls-private-key-file=""
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768734    2569 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768737    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768740    2569 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768743    2569 flags.go:64] FLAG: --v="2"
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768747    2569 flags.go:64] FLAG: --version="false"
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768752    2569 flags.go:64] FLAG: --vmodule=""
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768756    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.768759    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768849    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768853    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768856    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768858    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768862    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768864    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768867    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768870    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768872    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768875    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768878    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:31:30.773748 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768880    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768883    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768885    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768888    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768890    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768893    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768895    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768899    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768902    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768904    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768907    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768909    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768912    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768915    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768917    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768920    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768922    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768925    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768928    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768930    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:31:30.774324 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768933    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768935    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768938    2569 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768940    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768943    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768945    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768949    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768951    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768954    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768957    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768959    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768962    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768964    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768967    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768970    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768972    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768975    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768977    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768980    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768984    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:31:30.774852 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768987    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768989    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768993    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.768997    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769000    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769004    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769007    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769010    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769013    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769016    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769019    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769021    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769025    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769028    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769031    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769033    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769036    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769038    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769041    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:31:30.775386 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769044    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769049    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769052    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769055    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769057    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769060    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769062    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769065    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769067    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769070    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769072    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769075    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769079    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769081    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769084    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.769087    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:31:30.775843 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.769692    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.776138    2569 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.776156    2569 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776204    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776210    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776213    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776216    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776220    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776223    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776226    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776228    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776231    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776234    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776237    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776240    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776242    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776245    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776248    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776250    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776253    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:31:30.776307 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776256    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776259    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776263    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776266    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776269    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776272    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776275    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776277    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776280    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776282    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776285    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776288    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776291    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776293    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776298    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776301    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776304    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776307    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776310    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776312    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:31:30.776802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776315    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776318    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776321    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776323    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776327    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776331    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776334    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776337    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776340    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776342    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776345    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776348    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776351    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776353    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776356    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776358    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776361    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776364    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776366    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:31:30.777305 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776369    2569 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776371    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776374    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776376    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776379    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776382    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776384    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776388    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776391    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776394    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776396    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776399    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776402    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776405    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776407    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776410    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776413    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776415    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776418    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776420    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:31:30.777791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776423    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776425    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776428    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776430    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776433    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776435    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776438    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776440    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776443    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776446    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.776450    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776544    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776548    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776551    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776554    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 15:31:30.778304 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776557    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776560    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776563    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776566    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776568    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776571    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776575    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776578    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776580    2569 feature_gate.go:328] unrecognized feature gate: Example
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776583    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776585    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776588    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776590    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776593    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776595    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776598    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776601    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776604    2569 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776606    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776609    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 15:31:30.778678 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776612    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776614    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776617    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776620    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776622    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776624    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776627    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776629    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776632    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776634    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776637    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776639    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776642    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776644    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776647    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776650    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776652    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776655    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776657    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776661    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 15:31:30.779173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776664    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776666    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776669    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776671    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776674    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776677    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776680    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776683    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776687    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776689    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776692    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776695    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776697    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776701    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776704    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776707    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776710    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776713    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776716    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 15:31:30.779684 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776718    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776721    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776724    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776727    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776729    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776732    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776735    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776737    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776740    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776744    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776746    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776749    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776751    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776754    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776757    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776760    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776762    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776765    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776767    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776770    2569 feature_gate.go:328] unrecognized feature gate: Example2
May 21 15:31:30.780187 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776773    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 15:31:30.780704 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776775    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 15:31:30.780704 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:30.776778    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 15:31:30.780704 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.776783    2569 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 15:31:30.780704 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.777606    2569 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 15:31:30.780704 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.780019    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 15:31:30.781022 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.781011    2569 server.go:1019] "Starting client certificate rotation"
May 21 15:31:30.781168 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.781105    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 15:31:30.781168 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.781163    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 15:31:30.806589 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.806568    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 15:31:30.808620 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.808600    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 15:31:30.824227 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.824204    2569 log.go:25] "Validated CRI v1 runtime API"
May 21 15:31:30.829510 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.829493    2569 log.go:25] "Validated CRI v1 image API"
May 21 15:31:30.830739 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.830722    2569 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 15:31:30.835583 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.835561    2569 fs.go:135] Filesystem UUIDs: map[0c8b95b3-81d2-4c02-a1bb-1fd1d762e427:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fed53bab-b26f-43fe-949a-e897d587643d:/dev/nvme0n1p3]
May 21 15:31:30.835668 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.835581    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 15:31:30.838881 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.838862    2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 15:31:30.839892 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.839788    2569 manager.go:217] Machine: {Timestamp:2026-05-21 15:31:30.839289484 +0000 UTC m=+0.409654587 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114121 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ebb6aa3ed6cc86022ff04adc85b56 SystemUUID:ec2ebb6a-a3ed-6cc8-6022-ff04adc85b56 BootID:917cb86e-d81c-481f-91c6-ccda9aed6be9 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:af:d7:26:27:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:af:d7:26:27:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:2a:76:2b:b8:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 15:31:30.839892 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.839888    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 15:31:30.839985 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.839971    2569 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 15:31:30.841981 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.841959    2569 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 15:31:30.842145 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.841983    2569 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 15:31:30.842199 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.842157    2569 topology_manager.go:138] "Creating topology manager with none policy"
May 21 15:31:30.842199 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.842166    2569 container_manager_linux.go:306] "Creating device plugin manager"
May 21 15:31:30.842199 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.842173    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 15:31:30.842199 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.842186    2569 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 15:31:30.844393 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.844382    2569 state_mem.go:36] "Initialized new in-memory state store"
May 21 15:31:30.844503 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.844494    2569 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 15:31:30.846962 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.846951    2569 kubelet.go:491] "Attempting to sync node with API server"
May 21 15:31:30.847003 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.846968    2569 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 15:31:30.847825 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.847815    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 15:31:30.847863 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.847831    2569 kubelet.go:397] "Adding apiserver pod source"
May 21 15:31:30.847863 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.847840    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 15:31:30.849095 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.849083    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 15:31:30.849155 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.849102    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 15:31:30.852421 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.852405    2569 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 15:31:30.854556 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.854542    2569 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 15:31:30.855515 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.855503    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 15:31:30.855559 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.855520    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 15:31:30.855559 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.855529    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 15:31:30.855559 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.855537    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 15:31:30.855640 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.855563    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 15:31:30.855640 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.855569    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 15:31:30.855640 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.855575    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 15:31:30.855640 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.855580    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 15:31:30.855640 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.855610    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 15:31:30.855640 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.855620    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 15:31:30.855640 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.855630    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 15:31:30.855968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.855959    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 15:31:30.856775 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.856766    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 15:31:30.856807 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.856776    2569 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 15:31:30.859390 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:30.859369    2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 15:31:30.859461 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:30.859438    2569 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 15:31:30.859513 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.859500    2569 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-228.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 15:31:30.860221 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.860170    2569 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 15:31:30.860274 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.860264    2569 server.go:1295] "Started kubelet"
May 21 15:31:30.860392 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.860341    2569 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 15:31:30.861298 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.861265    2569 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 15:31:30.861706 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.861667    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 15:31:30.862015 ip-10-0-135-228 systemd[1]: Started Kubernetes Kubelet.
May 21 15:31:30.862500 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.862457    2569 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 15:31:30.865405 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.865389    2569 server.go:317] "Adding debug handlers to kubelet server"
May 21 15:31:30.869846 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.869830    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 15:31:30.870420 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.870405    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 15:31:30.870586 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.870573    2569 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 15:31:30.870786 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.870775    2569 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 15:31:30.870996 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.870974    2569 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 15:31:30.871098 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.871080    2569 reconstruct.go:97] "Volume reconstruction finished"
May 21 15:31:30.871098 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.871089    2569 reconciler.go:26] "Reconciler: start to sync state"
May 21 15:31:30.872081 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:30.872051    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-228.ec2.internal\" not found"
May 21 15:31:30.873555 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.873536    2569 factory.go:153] Registering CRI-O factory
May 21 15:31:30.873555 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.873557    2569 factory.go:223] Registration of the crio container factory successfully
May 21 15:31:30.873681 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.873612    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 15:31:30.873681 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.873621    2569 factory.go:55] Registering systemd factory
May 21 15:31:30.873681 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.873629    2569 factory.go:223] Registration of the systemd container factory successfully
May 21 15:31:30.873681 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.873651    2569 factory.go:103] Registering Raw factory
May 21 15:31:30.873681 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.873665    2569 manager.go:1196] Started watching for new ooms in manager
May 21 15:31:30.874258 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.874241    2569 manager.go:319] Starting recovery of all containers
May 21 15:31:30.874396 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:30.874377    2569 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 15:31:30.878556 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.878528    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c7k7g"
May 21 15:31:30.880660 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:30.880622    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 21 15:31:30.880791 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:30.880774    2569 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 21 15:31:30.881822 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:30.880701    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-228.ec2.internal.18b19e66800ca1d0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-228.ec2.internal,UID:ip-10-0-135-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-228.ec2.internal,},FirstTimestamp:2026-05-21 15:31:30.86022088 +0000 UTC m=+0.430585984,LastTimestamp:2026-05-21 15:31:30.86022088 +0000 UTC m=+0.430585984,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-228.ec2.internal,}"
May 21 15:31:30.884765 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.884596    2569 manager.go:324] Recovery completed
May 21 15:31:30.885619 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.885535    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c7k7g"
May 21 15:31:30.886050 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:30.886029    2569 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 21 15:31:30.889564 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.889531    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:31:30.891791 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.891774    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:31:30.891862 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.891803    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:31:30.891862 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.891815    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasSufficientPID"
May 21 15:31:30.892393 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.892376    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 15:31:30.892393 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.892391    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 15:31:30.892487 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.892406    2569 state_mem.go:36] "Initialized new in-memory state store"
May 21 15:31:30.894839 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.894823    2569 policy_none.go:49] "None policy: Start"
May 21 15:31:30.894839 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.894841    2569 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 15:31:30.894939 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.894852    2569 state_mem.go:35] "Initializing new in-memory state store"
May 21 15:31:30.947833 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.941510    2569 manager.go:341] "Starting Device Plugin manager"
May 21 15:31:30.947833 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:30.941545    2569 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 15:31:30.947833 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.941556    2569 server.go:85] "Starting device plugin registration server"
May 21 15:31:30.947833 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.941835    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 15:31:30.947833 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.941847    2569 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 15:31:30.947833 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.941937    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 15:31:30.947833 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.942030    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 15:31:30.947833 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:30.942039    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 15:31:30.947833 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:30.942591    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 15:31:30.947833 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:30.942635    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-228.ec2.internal\" not found"
May 21 15:31:31.018781 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.018681    2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 15:31:31.019855 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.019835    2569 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 15:31:31.019919 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.019872    2569 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 15:31:31.019919 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.019897    2569 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 15:31:31.019919 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.019907    2569 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 15:31:31.020008 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.019950    2569 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 15:31:31.022230 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.022209    2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:31:31.042238 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.042217    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:31:31.043088 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.043074    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:31:31.043165 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.043103    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:31:31.043165 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.043115    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasSufficientPID"
May 21 15:31:31.043165 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.043154    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-228.ec2.internal"
May 21 15:31:31.052512 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.052490    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-228.ec2.internal"
May 21 15:31:31.052621 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.052515    2569 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-228.ec2.internal\": node \"ip-10-0-135-228.ec2.internal\" not found"
May 21 15:31:31.069417 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.069392    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-228.ec2.internal\" not found"
May 21 15:31:31.120226 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.120194    2569 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-228.ec2.internal"]
May 21 15:31:31.120364 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.120276    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:31:31.121665 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.121649    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:31:31.121740 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.121678    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:31:31.121740 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.121689    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasSufficientPID"
May 21 15:31:31.123004 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.122990    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:31:31.123189 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.123173    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.123252 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.123211    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:31:31.123815 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.123797    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:31:31.123890 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.123799    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:31:31.123890 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.123851    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:31:31.123890 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.123864    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasSufficientPID"
May 21 15:31:31.123890 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.123826    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:31:31.124065 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.123907    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasSufficientPID"
May 21 15:31:31.125163 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.125147    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.125249 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.125175    2569 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 15:31:31.125883 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.125867    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasSufficientMemory"
May 21 15:31:31.125950 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.125898    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasNoDiskPressure"
May 21 15:31:31.125950 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.125911    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeHasSufficientPID"
May 21 15:31:31.140689 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.140670    2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-228.ec2.internal\" not found" node="ip-10-0-135-228.ec2.internal"
May 21 15:31:31.145093 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.145078    2569 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-228.ec2.internal\" not found" node="ip-10-0-135-228.ec2.internal"
May 21 15:31:31.169890 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.169870    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-228.ec2.internal\" not found"
May 21 15:31:31.173182 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.173167    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27163b0b4d11eb786bd8e6e6beb8eef2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal\" (UID: \"27163b0b4d11eb786bd8e6e6beb8eef2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.173254 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.173188    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84c8e4097af05703cff843eeadfd9be2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-228.ec2.internal\" (UID: \"84c8e4097af05703cff843eeadfd9be2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.173254 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.173206    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27163b0b4d11eb786bd8e6e6beb8eef2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal\" (UID: \"27163b0b4d11eb786bd8e6e6beb8eef2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.270914 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.270826    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-228.ec2.internal\" not found"
May 21 15:31:31.274161 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.274136    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27163b0b4d11eb786bd8e6e6beb8eef2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal\" (UID: \"27163b0b4d11eb786bd8e6e6beb8eef2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.274246 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.274173    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27163b0b4d11eb786bd8e6e6beb8eef2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal\" (UID: \"27163b0b4d11eb786bd8e6e6beb8eef2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.274246 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.274206    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27163b0b4d11eb786bd8e6e6beb8eef2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal\" (UID: \"27163b0b4d11eb786bd8e6e6beb8eef2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.274246 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.274178    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27163b0b4d11eb786bd8e6e6beb8eef2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal\" (UID: \"27163b0b4d11eb786bd8e6e6beb8eef2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.274246 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.274237    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84c8e4097af05703cff843eeadfd9be2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-228.ec2.internal\" (UID: \"84c8e4097af05703cff843eeadfd9be2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.274390 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.274259    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84c8e4097af05703cff843eeadfd9be2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-228.ec2.internal\" (UID: \"84c8e4097af05703cff843eeadfd9be2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.371601 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.371564    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-228.ec2.internal\" not found"
May 21 15:31:31.443912 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.443893    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.447674 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.447653    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.472398 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.472375    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-228.ec2.internal\" not found"
May 21 15:31:31.572907 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.572821    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-228.ec2.internal\" not found"
May 21 15:31:31.673319 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.673293    2569 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-135-228.ec2.internal\" not found"
May 21 15:31:31.702167 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.702136    2569 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:31:31.773295 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.773270    2569 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:31:31.780387 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.780363    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 15:31:31.780524 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.780505    2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 15:31:31.780582 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.780539    2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 15:31:31.780582 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.780539    2569 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 15:31:31.848607 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.848532    2569 apiserver.go:52] "Watching apiserver"
May 21 15:31:31.862799 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.862769    2569 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 15:31:31.865017 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.864992    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-89lm9","openshift-multus/multus-dcqgg","openshift-multus/network-metrics-daemon-g7zsx","openshift-network-diagnostics/network-check-target-r4m92","openshift-network-operator/iptables-alerter-r7x4f","kube-system/konnectivity-agent-jn5f7","openshift-cluster-node-tuning-operator/tuned-4mxvd","openshift-ovn-kubernetes/ovnkube-node-5nwgj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk","openshift-image-registry/node-ca-7rj7l"]
May 21 15:31:31.867637 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.867616    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.868875 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.868851    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.869597 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.869580    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 15:31:31.869673 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.869595    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 15:31:31.869673 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.869657    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 15:31:31.869762 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.869679    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-prks4\""
May 21 15:31:31.869850 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.869834    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 15:31:31.869887 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.869835    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 15:31:31.869981 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.869966    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:31.870042 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.869966    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 15:31:31.870112 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.870024    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:31.871149 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.871135    2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.871360 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.871345    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kzvz4\""
May 21 15:31:31.871404 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.871345    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 15:31:31.871436 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.871417    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:31.871475 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.871461    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r7x4f"
May 21 15:31:31.871508 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.871478    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:31.872789 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.872773    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jn5f7"
May 21 15:31:31.873335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.873320    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5lwz9\""
May 21 15:31:31.873418 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.873377    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 15:31:31.873535 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.873522    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 15:31:31.873697 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.873687    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 15:31:31.874019 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.874008    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.875256 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.875008    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 15:31:31.875256 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.875074    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 15:31:31.875256 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.875084    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xf4nx\""
May 21 15:31:31.875844 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.875821    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.876983 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.876962    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 15:31:31.876983 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.876970    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/844ed311-7755-4dd5-8f12-7049aaa3f8bf-os-release\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.877145 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877005    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-multus-cni-dir\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.877145 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877031    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 15:31:31.877145 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877040    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-os-release\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.877145 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877070    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-run-netns\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.877145 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877101    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-var-lib-cni-multus\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.877376 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877155    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-run-multus-certs\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.877376 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877185    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvlp9\" (UniqueName: \"kubernetes.io/projected/21a1cf79-c675-4148-bad3-7dd74906f7d0-kube-api-access-kvlp9\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.877376 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877230    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jmrrv\""
May 21 15:31:31.877376 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877232    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/844ed311-7755-4dd5-8f12-7049aaa3f8bf-system-cni-dir\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.877550 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877389    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2fqx\" (UniqueName: \"kubernetes.io/projected/844ed311-7755-4dd5-8f12-7049aaa3f8bf-kube-api-access-g2fqx\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.877550 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877424    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-etc-kubernetes\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.877550 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877470    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92cgk\" (UniqueName: \"kubernetes.io/projected/d73ccee2-a400-46cf-9cf6-17e874c9d12f-kube-api-access-92cgk\") pod \"iptables-alerter-r7x4f\" (UID: \"d73ccee2-a400-46cf-9cf6-17e874c9d12f\") " pod="openshift-network-operator/iptables-alerter-r7x4f"
May 21 15:31:31.877680 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877586    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/844ed311-7755-4dd5-8f12-7049aaa3f8bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.877680 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877634    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-cnibin\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.877680 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877670    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-multus-socket-dir-parent\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.877809 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877703    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-var-lib-kubelet\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.877858 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877801    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/844ed311-7755-4dd5-8f12-7049aaa3f8bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.877905 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877855    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-var-lib-cni-bin\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.877905 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877890    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-hostroot\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.877989 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877928    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:31.877989 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877960    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/844ed311-7755-4dd5-8f12-7049aaa3f8bf-cnibin\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.878077 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.877991    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-system-cni-dir\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.878077 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.878022    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/844ed311-7755-4dd5-8f12-7049aaa3f8bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.878196 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.878082    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/844ed311-7755-4dd5-8f12-7049aaa3f8bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.878196 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.878142    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21a1cf79-c675-4148-bad3-7dd74906f7d0-cni-binary-copy\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.878298 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.878192    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d73ccee2-a400-46cf-9cf6-17e874c9d12f-iptables-alerter-script\") pod \"iptables-alerter-r7x4f\" (UID: \"d73ccee2-a400-46cf-9cf6-17e874c9d12f\") " pod="openshift-network-operator/iptables-alerter-r7x4f"
May 21 15:31:31.878298 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.878228    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d73ccee2-a400-46cf-9cf6-17e874c9d12f-host-slash\") pod \"iptables-alerter-r7x4f\" (UID: \"d73ccee2-a400-46cf-9cf6-17e874c9d12f\") " pod="openshift-network-operator/iptables-alerter-r7x4f"
May 21 15:31:31.878298 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.878253    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:31.878298 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.878289    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-run-k8s-cni-cncf-io\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.878484 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.878321    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 15:31:31.878484 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.878336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-multus-conf-dir\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.878484 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.878371    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21a1cf79-c675-4148-bad3-7dd74906f7d0-multus-daemon-config\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.878484 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.878444    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzp4c\" (UniqueName: \"kubernetes.io/projected/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-kube-api-access-pzp4c\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:31.878659 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.878476    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzkpg\" (UniqueName: \"kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg\") pod \"network-check-target-r4m92\" (UID: \"d6b5ee0b-6719-4632-8db4-cfd2163ce895\") " pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:31.879232 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.879212    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 15:31:31.879294 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.879228    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 15:31:31.879430 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.879294    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 15:31:31.879493 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.879479    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 15:31:31.879547 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.879500    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rnk6p\""
May 21 15:31:31.879547 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.879535    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 15:31:31.880053 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.880038    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7rj7l"
May 21 15:31:31.880857 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.880841    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tjt6s\""
May 21 15:31:31.881076 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.881060    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 15:31:31.881169 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.881093    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 15:31:31.881273 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.881258    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 15:31:31.882029 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.882014    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 15:31:31.882221 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.882203    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2qxzh\""
May 21 15:31:31.882379 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.882365    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 15:31:31.882453 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.882400    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 15:31:31.883146 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.883116    2569 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 15:31:31.884155 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.884140    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 15:31:31.884223 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.884197    2569 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-228.ec2.internal"
May 21 15:31:31.885867 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.885850    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal"]
May 21 15:31:31.887756 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.887728    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 15:26:30 +0000 UTC" deadline="2027-12-07 01:51:05.350073003 +0000 UTC"
May 21 15:31:31.887818 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.887756    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13546h19m33.462320299s"
May 21 15:31:31.893411 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.893394    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-228.ec2.internal"]
May 21 15:31:31.893494 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.893485    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 15:31:31.909291 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.909269    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qsmnb"
May 21 15:31:31.922721 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.922706    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qsmnb"
May 21 15:31:31.971756 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.971738    2569 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 15:31:31.979287 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979234    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/844ed311-7755-4dd5-8f12-7049aaa3f8bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.979396 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979290    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d73ccee2-a400-46cf-9cf6-17e874c9d12f-iptables-alerter-script\") pod \"iptables-alerter-r7x4f\" (UID: \"d73ccee2-a400-46cf-9cf6-17e874c9d12f\") " pod="openshift-network-operator/iptables-alerter-r7x4f"
May 21 15:31:31.979396 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979378    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d73ccee2-a400-46cf-9cf6-17e874c9d12f-host-slash\") pod \"iptables-alerter-r7x4f\" (UID: \"d73ccee2-a400-46cf-9cf6-17e874c9d12f\") " pod="openshift-network-operator/iptables-alerter-r7x4f"
May 21 15:31:31.979501 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979419    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d73ccee2-a400-46cf-9cf6-17e874c9d12f-host-slash\") pod \"iptables-alerter-r7x4f\" (UID: \"d73ccee2-a400-46cf-9cf6-17e874c9d12f\") " pod="openshift-network-operator/iptables-alerter-r7x4f"
May 21 15:31:31.979501 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979440    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-run-ovn\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.979501 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979481    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-node-log\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.979688 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979591    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-cni-bin\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.979688 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979627    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a98a1f8-3069-4b7d-9709-95b0b4a4652d-host\") pod \"node-ca-7rj7l\" (UID: \"9a98a1f8-3069-4b7d-9709-95b0b4a4652d\") " pod="openshift-image-registry/node-ca-7rj7l"
May 21 15:31:31.979781 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979685    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-run\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.979880 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979844    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-run-k8s-cni-cncf-io\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.979956 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979910    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21a1cf79-c675-4148-bad3-7dd74906f7d0-multus-daemon-config\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.980009 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979955    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-kubelet\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.980009 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979942    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-run-k8s-cni-cncf-io\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.980009 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.979995    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11df5362-95e9-46d0-a74e-475d26d60112-ovnkube-config\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.980162 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980041    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb2tj\" (UniqueName: \"kubernetes.io/projected/2fe32665-35c8-4ac6-953c-c90107d9d5ff-kube-api-access-rb2tj\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:31.980162 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980082    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzp4c\" (UniqueName: \"kubernetes.io/projected/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-kube-api-access-pzp4c\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:31.980162 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980138    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-modprobe-d\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.980301 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980043    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/844ed311-7755-4dd5-8f12-7049aaa3f8bf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.980301 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980195    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-multus-cni-dir\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.980301 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980234    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-run-netns\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.980301 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980280    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-var-lib-cni-multus\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.980481 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980358    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-var-lib-cni-multus\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.980481 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980383    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-multus-cni-dir\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.980481 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980406    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d73ccee2-a400-46cf-9cf6-17e874c9d12f-iptables-alerter-script\") pod \"iptables-alerter-r7x4f\" (UID: \"d73ccee2-a400-46cf-9cf6-17e874c9d12f\") " pod="openshift-network-operator/iptables-alerter-r7x4f"
May 21 15:31:31.980481 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980435    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-run-multus-certs\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.980663 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980494    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-run-netns\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.980663 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980506    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-run-multus-certs\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.980663 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980513    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-etc-kubernetes\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.980663 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980626    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-etc-kubernetes\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.980855 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-systemd-units\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.980855 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980748    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-log-socket\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.980855 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980778    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.980855 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980809    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-registration-dir\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:31.980855 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980832    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/21a1cf79-c675-4148-bad3-7dd74906f7d0-multus-daemon-config\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.981086 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980837    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-var-lib-kubelet\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.981086 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980955    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-host\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.981086 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.980991    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpdfm\" (UniqueName: \"kubernetes.io/projected/527e6cf0-c43f-4dd0-8f50-d377846deb14-kube-api-access-bpdfm\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.981086 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981060    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/844ed311-7755-4dd5-8f12-7049aaa3f8bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.981303 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981091    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-cnibin\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.981303 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981169    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-multus-socket-dir-parent\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.981303 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981206    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-cni-netd\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.981449 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981366    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a98a1f8-3069-4b7d-9709-95b0b4a4652d-serviceca\") pod \"node-ca-7rj7l\" (UID: \"9a98a1f8-3069-4b7d-9709-95b0b4a4652d\") " pod="openshift-image-registry/node-ca-7rj7l"
May 21 15:31:31.981449 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981402    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-var-lib-cni-bin\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.981546 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981429    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-hostroot\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.981546 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981501    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-run-netns\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.981640 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981562    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11df5362-95e9-46d0-a74e-475d26d60112-env-overrides\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.981640 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981624    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/960c4f63-b8b9-4b57-b57c-a0f90791c561-agent-certs\") pod \"konnectivity-agent-jn5f7\" (UID: \"960c4f63-b8b9-4b57-b57c-a0f90791c561\") " pod="kube-system/konnectivity-agent-jn5f7"
May 21 15:31:31.981744 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981654    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-sys\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.981744 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981680    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-slash\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.981869 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981825    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-etc-openvswitch\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.981932 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981892    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/960c4f63-b8b9-4b57-b57c-a0f90791c561-konnectivity-ca\") pod \"konnectivity-agent-jn5f7\" (UID: \"960c4f63-b8b9-4b57-b57c-a0f90791c561\") " pod="kube-system/konnectivity-agent-jn5f7"
May 21 15:31:31.981985 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981945    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-sysctl-conf\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.982036 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.981976    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-tuned\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.982036 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982024    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-socket-dir\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:31.982144 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982054    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/844ed311-7755-4dd5-8f12-7049aaa3f8bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.982144 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982088    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21a1cf79-c675-4148-bad3-7dd74906f7d0-cni-binary-copy\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.982249 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982145    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-sys-fs\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:31.982249 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982180    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-multus-conf-dir\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.982341 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982261    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzkpg\" (UniqueName: \"kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg\") pod \"network-check-target-r4m92\" (UID: \"d6b5ee0b-6719-4632-8db4-cfd2163ce895\") " pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:31.982392 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11df5362-95e9-46d0-a74e-475d26d60112-ovn-node-metrics-cert\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.982481 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982380    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkckx\" (UniqueName: \"kubernetes.io/projected/11df5362-95e9-46d0-a74e-475d26d60112-kube-api-access-xkckx\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.982535 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982477    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/844ed311-7755-4dd5-8f12-7049aaa3f8bf-os-release\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.982581 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982530    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-os-release\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.982628 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-var-lib-openvswitch\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.982683 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982663    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.982734 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982658    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-var-lib-cni-bin\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.982734 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982722    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-hostroot\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.982823 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982725    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kvlp9\" (UniqueName: \"kubernetes.io/projected/21a1cf79-c675-4148-bad3-7dd74906f7d0-kube-api-access-kvlp9\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.983026 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.982894    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-multus-conf-dir\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.983095 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983014    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-multus-socket-dir-parent\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.983173 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983097    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/844ed311-7755-4dd5-8f12-7049aaa3f8bf-system-cni-dir\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.983173 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983103    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-cnibin\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.983269 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983179    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2fqx\" (UniqueName: \"kubernetes.io/projected/844ed311-7755-4dd5-8f12-7049aaa3f8bf-kube-api-access-g2fqx\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.983269 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983195    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/844ed311-7755-4dd5-8f12-7049aaa3f8bf-os-release\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.983269 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983206    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-os-release\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.983397 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983291    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/844ed311-7755-4dd5-8f12-7049aaa3f8bf-cni-binary-copy\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.983397 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983302    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92cgk\" (UniqueName: \"kubernetes.io/projected/d73ccee2-a400-46cf-9cf6-17e874c9d12f-kube-api-access-92cgk\") pod \"iptables-alerter-r7x4f\" (UID: \"d73ccee2-a400-46cf-9cf6-17e874c9d12f\") " pod="openshift-network-operator/iptables-alerter-r7x4f"
May 21 15:31:31.983397 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983362    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-run-openvswitch\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.983556 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983453    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/21a1cf79-c675-4148-bad3-7dd74906f7d0-cni-binary-copy\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.983865 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983821    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11df5362-95e9-46d0-a74e-475d26d60112-ovnkube-script-lib\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.983865 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983540    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/844ed311-7755-4dd5-8f12-7049aaa3f8bf-system-cni-dir\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.983865 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983398    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/844ed311-7755-4dd5-8f12-7049aaa3f8bf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.984052 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983870    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:31.984052 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983934    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-var-lib-kubelet\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.984052 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.983979    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-run-systemd\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:31.984052 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984002    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-host-var-lib-kubelet\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.984052 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984048    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-device-dir\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:31.984318 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984074    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:31.984318 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984101    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-kubernetes\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.984318 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984138    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-systemd\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.984318 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984192    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-lib-modules\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.984318 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984220    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/844ed311-7755-4dd5-8f12-7049aaa3f8bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.984318 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984247    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:31.984318 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984291    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs454\" (UniqueName: \"kubernetes.io/projected/9a98a1f8-3069-4b7d-9709-95b0b4a4652d-kube-api-access-gs454\") pod \"node-ca-7rj7l\" (UID: \"9a98a1f8-3069-4b7d-9709-95b0b4a4652d\") " pod="openshift-image-registry/node-ca-7rj7l"
May 21 15:31:31.984318 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984319    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-sysctl-d\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.984622 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.984329    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:31:31.984622 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984341    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/527e6cf0-c43f-4dd0-8f50-d377846deb14-tmp\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.984622 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984351    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/844ed311-7755-4dd5-8f12-7049aaa3f8bf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.984622 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984371    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/844ed311-7755-4dd5-8f12-7049aaa3f8bf-cnibin\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.984622 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984403    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-system-cni-dir\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.984622 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984432    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/844ed311-7755-4dd5-8f12-7049aaa3f8bf-cnibin\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:31.984622 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.984466    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs podName:5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:32.484439396 +0000 UTC m=+2.054804490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs") pod "network-metrics-daemon-g7zsx" (UID: "5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:31:31.984622 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984491    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-sysconfig\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:31.984622 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.984497    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/21a1cf79-c675-4148-bad3-7dd74906f7d0-system-cni-dir\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.985663 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.985643    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 15:31:31.988656 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.988637    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzp4c\" (UniqueName: \"kubernetes.io/projected/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-kube-api-access-pzp4c\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:31.990170 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.990153    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:31:31.990170 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.990172    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:31:31.990330 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.990183    2569 projected.go:194] Error preparing data for projected volume kube-api-access-kzkpg for pod openshift-network-diagnostics/network-check-target-r4m92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:31:31.990330 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:31.990252    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg podName:d6b5ee0b-6719-4632-8db4-cfd2163ce895 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:32.490234192 +0000 UTC m=+2.060599305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kzkpg" (UniqueName: "kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg") pod "network-check-target-r4m92" (UID: "d6b5ee0b-6719-4632-8db4-cfd2163ce895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:31:31.993371 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.993338    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvlp9\" (UniqueName: \"kubernetes.io/projected/21a1cf79-c675-4148-bad3-7dd74906f7d0-kube-api-access-kvlp9\") pod \"multus-dcqgg\" (UID: \"21a1cf79-c675-4148-bad3-7dd74906f7d0\") " pod="openshift-multus/multus-dcqgg"
May 21 15:31:31.993679 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.993660    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92cgk\" (UniqueName: \"kubernetes.io/projected/d73ccee2-a400-46cf-9cf6-17e874c9d12f-kube-api-access-92cgk\") pod \"iptables-alerter-r7x4f\" (UID: \"d73ccee2-a400-46cf-9cf6-17e874c9d12f\") " pod="openshift-network-operator/iptables-alerter-r7x4f"
May 21 15:31:31.994045 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:31.994022    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2fqx\" (UniqueName: \"kubernetes.io/projected/844ed311-7755-4dd5-8f12-7049aaa3f8bf-kube-api-access-g2fqx\") pod \"multus-additional-cni-plugins-89lm9\" (UID: \"844ed311-7755-4dd5-8f12-7049aaa3f8bf\") " pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:32.085361 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085327    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11df5362-95e9-46d0-a74e-475d26d60112-ovn-node-metrics-cert\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.085361 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085366    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkckx\" (UniqueName: \"kubernetes.io/projected/11df5362-95e9-46d0-a74e-475d26d60112-kube-api-access-xkckx\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.085571 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085394    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-var-lib-openvswitch\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.085571 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085422    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.085571 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085461    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-run-openvswitch\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.085571 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085513    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-run-openvswitch\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.085571 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085512    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11df5362-95e9-46d0-a74e-475d26d60112-ovnkube-script-lib\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.085571 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085556    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-var-lib-openvswitch\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.085571 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085529    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.085571 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085559    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085592    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-run-systemd\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085614    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-device-dir\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085635    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085671    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-kubernetes\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085673    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085693    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-systemd\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085717    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-device-dir\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085731    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-lib-modules\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085735    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-systemd\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085761    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-run-systemd\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085780    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-kubernetes\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085786    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gs454\" (UniqueName: \"kubernetes.io/projected/9a98a1f8-3069-4b7d-9709-95b0b4a4652d-kube-api-access-gs454\") pod \"node-ca-7rj7l\" (UID: \"9a98a1f8-3069-4b7d-9709-95b0b4a4652d\") " pod="openshift-image-registry/node-ca-7rj7l"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085839    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-sysctl-d\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085860    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-lib-modules\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085890    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/527e6cf0-c43f-4dd0-8f50-d377846deb14-tmp\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085916    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-sysconfig\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.085968 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085931    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-sysctl-d\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085941    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-run-ovn\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085936    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-etc-selinux\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085964    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-node-log\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085989    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-cni-bin\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.085987    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-run-ovn\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086001    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-sysconfig\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086014    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a98a1f8-3069-4b7d-9709-95b0b4a4652d-host\") pod \"node-ca-7rj7l\" (UID: \"9a98a1f8-3069-4b7d-9709-95b0b4a4652d\") " pod="openshift-image-registry/node-ca-7rj7l"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086040    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-node-log\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086045    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-run\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086048    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a98a1f8-3069-4b7d-9709-95b0b4a4652d-host\") pod \"node-ca-7rj7l\" (UID: \"9a98a1f8-3069-4b7d-9709-95b0b4a4652d\") " pod="openshift-image-registry/node-ca-7rj7l"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086049    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-cni-bin\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086088    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-run\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086097    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-kubelet\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086144    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11df5362-95e9-46d0-a74e-475d26d60112-ovnkube-config\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086154    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11df5362-95e9-46d0-a74e-475d26d60112-ovnkube-script-lib\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086173    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rb2tj\" (UniqueName: \"kubernetes.io/projected/2fe32665-35c8-4ac6-953c-c90107d9d5ff-kube-api-access-rb2tj\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086188    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-kubelet\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.086766 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086203    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-modprobe-d\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086233    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-systemd-units\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086276    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-log-socket\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086303    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086313    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-modprobe-d\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086343    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-registration-dir\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086362    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-log-socket\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086384    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-var-lib-kubelet\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086402    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-systemd-units\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086408    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-host\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086418    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-run-ovn-kubernetes\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086432    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpdfm\" (UniqueName: \"kubernetes.io/projected/527e6cf0-c43f-4dd0-8f50-d377846deb14-kube-api-access-bpdfm\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086462    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-registration-dir\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086460    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-cni-netd\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086470    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-var-lib-kubelet\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086506    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a98a1f8-3069-4b7d-9709-95b0b4a4652d-serviceca\") pod \"node-ca-7rj7l\" (UID: \"9a98a1f8-3069-4b7d-9709-95b0b4a4652d\") " pod="openshift-image-registry/node-ca-7rj7l"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086531    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-host\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.087664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086536    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-run-netns\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086567    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11df5362-95e9-46d0-a74e-475d26d60112-env-overrides\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086593    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/960c4f63-b8b9-4b57-b57c-a0f90791c561-agent-certs\") pod \"konnectivity-agent-jn5f7\" (UID: \"960c4f63-b8b9-4b57-b57c-a0f90791c561\") " pod="kube-system/konnectivity-agent-jn5f7"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086605    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11df5362-95e9-46d0-a74e-475d26d60112-ovnkube-config\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086618    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-sys\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086507    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-cni-netd\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086642    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-slash\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086683    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-etc-openvswitch\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086712    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/960c4f63-b8b9-4b57-b57c-a0f90791c561-konnectivity-ca\") pod \"konnectivity-agent-jn5f7\" (UID: \"960c4f63-b8b9-4b57-b57c-a0f90791c561\") " pod="kube-system/konnectivity-agent-jn5f7"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086738    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-sysctl-conf\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086762    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-run-netns\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086774    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-tuned\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086801    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-socket-dir\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086820    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-sys\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086830    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-sys-fs\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086919    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a98a1f8-3069-4b7d-9709-95b0b4a4652d-serviceca\") pod \"node-ca-7rj7l\" (UID: \"9a98a1f8-3069-4b7d-9709-95b0b4a4652d\") " pod="openshift-image-registry/node-ca-7rj7l"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086925    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-sys-fs\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.086967    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-host-slash\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.088446 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.087044    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-sysctl-conf\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.089233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.087089    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11df5362-95e9-46d0-a74e-475d26d60112-etc-openvswitch\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.089233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.087192    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11df5362-95e9-46d0-a74e-475d26d60112-env-overrides\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.089233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.087244    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2fe32665-35c8-4ac6-953c-c90107d9d5ff-socket-dir\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.089233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.087599    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/960c4f63-b8b9-4b57-b57c-a0f90791c561-konnectivity-ca\") pod \"konnectivity-agent-jn5f7\" (UID: \"960c4f63-b8b9-4b57-b57c-a0f90791c561\") " pod="kube-system/konnectivity-agent-jn5f7"
May 21 15:31:32.089233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.088430    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/527e6cf0-c43f-4dd0-8f50-d377846deb14-tmp\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.089233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.088489    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11df5362-95e9-46d0-a74e-475d26d60112-ovn-node-metrics-cert\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.089233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.089187    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/527e6cf0-c43f-4dd0-8f50-d377846deb14-etc-tuned\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.089440 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.089267    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/960c4f63-b8b9-4b57-b57c-a0f90791c561-agent-certs\") pod \"konnectivity-agent-jn5f7\" (UID: \"960c4f63-b8b9-4b57-b57c-a0f90791c561\") " pod="kube-system/konnectivity-agent-jn5f7"
May 21 15:31:32.090235 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.090222    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 15:31:32.093609 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.093585    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkckx\" (UniqueName: \"kubernetes.io/projected/11df5362-95e9-46d0-a74e-475d26d60112-kube-api-access-xkckx\") pod \"ovnkube-node-5nwgj\" (UID: \"11df5362-95e9-46d0-a74e-475d26d60112\") " pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.093689 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.093618    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb2tj\" (UniqueName: \"kubernetes.io/projected/2fe32665-35c8-4ac6-953c-c90107d9d5ff-kube-api-access-rb2tj\") pod \"aws-ebs-csi-driver-node-frldk\" (UID: \"2fe32665-35c8-4ac6-953c-c90107d9d5ff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.093739 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.093717    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs454\" (UniqueName: \"kubernetes.io/projected/9a98a1f8-3069-4b7d-9709-95b0b4a4652d-kube-api-access-gs454\") pod \"node-ca-7rj7l\" (UID: \"9a98a1f8-3069-4b7d-9709-95b0b4a4652d\") " pod="openshift-image-registry/node-ca-7rj7l"
May 21 15:31:32.094094 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.094069    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpdfm\" (UniqueName: \"kubernetes.io/projected/527e6cf0-c43f-4dd0-8f50-d377846deb14-kube-api-access-bpdfm\") pod \"tuned-4mxvd\" (UID: \"527e6cf0-c43f-4dd0-8f50-d377846deb14\") " pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.174908 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:32.174862    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c8e4097af05703cff843eeadfd9be2.slice/crio-8c08addbf18332f1b5831ce5cfd174bde3cada0c31c9fbb99b699a4a2dbb7122 WatchSource:0}: Error finding container 8c08addbf18332f1b5831ce5cfd174bde3cada0c31c9fbb99b699a4a2dbb7122: Status 404 returned error can't find the container with id 8c08addbf18332f1b5831ce5cfd174bde3cada0c31c9fbb99b699a4a2dbb7122
May 21 15:31:32.202907 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.202882    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-89lm9"
May 21 15:31:32.209514 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:32.209494    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod844ed311_7755_4dd5_8f12_7049aaa3f8bf.slice/crio-2897eba6711a9d948a873a2ef923ac6afd7e2786519f0765174a22905254c10d WatchSource:0}: Error finding container 2897eba6711a9d948a873a2ef923ac6afd7e2786519f0765174a22905254c10d: Status 404 returned error can't find the container with id 2897eba6711a9d948a873a2ef923ac6afd7e2786519f0765174a22905254c10d
May 21 15:31:32.224445 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.224425    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dcqgg"
May 21 15:31:32.229553 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:32.229529    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a1cf79_c675_4148_bad3_7dd74906f7d0.slice/crio-a5b58181b95621d9e0b4254e2b32ff2b019aec1e59180a277522dd62cf6e7a7d WatchSource:0}: Error finding container a5b58181b95621d9e0b4254e2b32ff2b019aec1e59180a277522dd62cf6e7a7d: Status 404 returned error can't find the container with id a5b58181b95621d9e0b4254e2b32ff2b019aec1e59180a277522dd62cf6e7a7d
May 21 15:31:32.231198 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.231166    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r7x4f"
May 21 15:31:32.236411 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:32.236390    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73ccee2_a400_46cf_9cf6_17e874c9d12f.slice/crio-16512d5d49500cc32b87e3860eca7cd5060f629e4f3409af07cd8d0e4fffe960 WatchSource:0}: Error finding container 16512d5d49500cc32b87e3860eca7cd5060f629e4f3409af07cd8d0e4fffe960: Status 404 returned error can't find the container with id 16512d5d49500cc32b87e3860eca7cd5060f629e4f3409af07cd8d0e4fffe960
May 21 15:31:32.242268 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.242252    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jn5f7"
May 21 15:31:32.249441 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:32.249421    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960c4f63_b8b9_4b57_b57c_a0f90791c561.slice/crio-dcf822242744f5e304a10e1f098f70b24dbfa5692b058db74530957c527e651a WatchSource:0}: Error finding container dcf822242744f5e304a10e1f098f70b24dbfa5692b058db74530957c527e651a: Status 404 returned error can't find the container with id dcf822242744f5e304a10e1f098f70b24dbfa5692b058db74530957c527e651a
May 21 15:31:32.263519 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.263497    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4mxvd"
May 21 15:31:32.269264 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:32.269245    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527e6cf0_c43f_4dd0_8f50_d377846deb14.slice/crio-01303c9e9dbe63cc3a1c2c2a015c9ad5de62f4e6f3b5f54ca54732869c5f5bcb WatchSource:0}: Error finding container 01303c9e9dbe63cc3a1c2c2a015c9ad5de62f4e6f3b5f54ca54732869c5f5bcb: Status 404 returned error can't find the container with id 01303c9e9dbe63cc3a1c2c2a015c9ad5de62f4e6f3b5f54ca54732869c5f5bcb
May 21 15:31:32.270249 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.270235    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:32.275686 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:32.275666    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11df5362_95e9_46d0_a74e_475d26d60112.slice/crio-be754df18747f61d14b6959b092e491a7cc0b163d579ad3f3694352073b0960a WatchSource:0}: Error finding container be754df18747f61d14b6959b092e491a7cc0b163d579ad3f3694352073b0960a: Status 404 returned error can't find the container with id be754df18747f61d14b6959b092e491a7cc0b163d579ad3f3694352073b0960a
May 21 15:31:32.290286 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.290263    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk"
May 21 15:31:32.296535 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:32.296516    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe32665_35c8_4ac6_953c_c90107d9d5ff.slice/crio-89473e95b46d696eb51e75223a5ef90196fe07cadf23ae4ceb2a98407c1e81cb WatchSource:0}: Error finding container 89473e95b46d696eb51e75223a5ef90196fe07cadf23ae4ceb2a98407c1e81cb: Status 404 returned error can't find the container with id 89473e95b46d696eb51e75223a5ef90196fe07cadf23ae4ceb2a98407c1e81cb
May 21 15:31:32.301252 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.301235    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7rj7l"
May 21 15:31:32.308495 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:32.308475    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a98a1f8_3069_4b7d_9709_95b0b4a4652d.slice/crio-9d022642be95111cdf79b0e39a2b929023ef144c40a9e8e48b1e7f1a116eca62 WatchSource:0}: Error finding container 9d022642be95111cdf79b0e39a2b929023ef144c40a9e8e48b1e7f1a116eca62: Status 404 returned error can't find the container with id 9d022642be95111cdf79b0e39a2b929023ef144c40a9e8e48b1e7f1a116eca62
May 21 15:31:32.329519 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.329501    2569 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:31:32.490096 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.490001    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:32.490254 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:32.490112    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:31:32.490254 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:32.490178    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs podName:5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:33.490160636 +0000 UTC m=+3.060525735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs") pod "network-metrics-daemon-g7zsx" (UID: "5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:31:32.590739 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.590709    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzkpg\" (UniqueName: \"kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg\") pod \"network-check-target-r4m92\" (UID: \"d6b5ee0b-6719-4632-8db4-cfd2163ce895\") " pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:32.590887 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:32.590843    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:31:32.590887 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:32.590857    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:31:32.590887 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:32.590866    2569 projected.go:194] Error preparing data for projected volume kube-api-access-kzkpg for pod openshift-network-diagnostics/network-check-target-r4m92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:31:32.591010 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:32.590924    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg podName:d6b5ee0b-6719-4632-8db4-cfd2163ce895 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:33.590905666 +0000 UTC m=+3.161270760 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzkpg" (UniqueName: "kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg") pod "network-check-target-r4m92" (UID: "d6b5ee0b-6719-4632-8db4-cfd2163ce895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:31:32.925283 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.925193    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 15:26:31 +0000 UTC" deadline="2027-11-16 14:03:54.514061804 +0000 UTC"
May 21 15:31:32.925283 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.925236    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13054h32m21.588830326s"
May 21 15:31:32.957734 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.957701    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-2kc9w"]
May 21 15:31:32.959960 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.959940    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2kc9w"
May 21 15:31:32.963668 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.962479    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 15:31:32.963668 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.962664    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 15:31:32.963668 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.962682    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5mcjn\""
May 21 15:31:32.994145 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.994070    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shxzn\" (UniqueName: \"kubernetes.io/projected/aa952ca3-14e6-4a2b-8b6d-200407069d9a-kube-api-access-shxzn\") pod \"node-resolver-2kc9w\" (UID: \"aa952ca3-14e6-4a2b-8b6d-200407069d9a\") " pod="openshift-dns/node-resolver-2kc9w"
May 21 15:31:32.994294 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.994145    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa952ca3-14e6-4a2b-8b6d-200407069d9a-tmp-dir\") pod \"node-resolver-2kc9w\" (UID: \"aa952ca3-14e6-4a2b-8b6d-200407069d9a\") " pod="openshift-dns/node-resolver-2kc9w"
May 21 15:31:32.994294 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:32.994180    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa952ca3-14e6-4a2b-8b6d-200407069d9a-hosts-file\") pod \"node-resolver-2kc9w\" (UID: \"aa952ca3-14e6-4a2b-8b6d-200407069d9a\") " pod="openshift-dns/node-resolver-2kc9w"
May 21 15:31:33.023015 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.022984    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:33.023190 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:33.023108    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:33.048306 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.048250    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r7x4f" event={"ID":"d73ccee2-a400-46cf-9cf6-17e874c9d12f","Type":"ContainerStarted","Data":"16512d5d49500cc32b87e3860eca7cd5060f629e4f3409af07cd8d0e4fffe960"}
May 21 15:31:33.057247 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.057199    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal" event={"ID":"27163b0b4d11eb786bd8e6e6beb8eef2","Type":"ContainerStarted","Data":"3da731c35241b6730b1ed9ed176571e1f838149e482601c412061ed07aac0888"}
May 21 15:31:33.092942 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.092904    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7rj7l" event={"ID":"9a98a1f8-3069-4b7d-9709-95b0b4a4652d","Type":"ContainerStarted","Data":"9d022642be95111cdf79b0e39a2b929023ef144c40a9e8e48b1e7f1a116eca62"}
May 21 15:31:33.094662 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.094616    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa952ca3-14e6-4a2b-8b6d-200407069d9a-hosts-file\") pod \"node-resolver-2kc9w\" (UID: \"aa952ca3-14e6-4a2b-8b6d-200407069d9a\") " pod="openshift-dns/node-resolver-2kc9w"
May 21 15:31:33.094789 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.094697    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-shxzn\" (UniqueName: \"kubernetes.io/projected/aa952ca3-14e6-4a2b-8b6d-200407069d9a-kube-api-access-shxzn\") pod \"node-resolver-2kc9w\" (UID: \"aa952ca3-14e6-4a2b-8b6d-200407069d9a\") " pod="openshift-dns/node-resolver-2kc9w"
May 21 15:31:33.094789 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.094740    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa952ca3-14e6-4a2b-8b6d-200407069d9a-tmp-dir\") pod \"node-resolver-2kc9w\" (UID: \"aa952ca3-14e6-4a2b-8b6d-200407069d9a\") " pod="openshift-dns/node-resolver-2kc9w"
May 21 15:31:33.094789 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.094754    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/aa952ca3-14e6-4a2b-8b6d-200407069d9a-hosts-file\") pod \"node-resolver-2kc9w\" (UID: \"aa952ca3-14e6-4a2b-8b6d-200407069d9a\") " pod="openshift-dns/node-resolver-2kc9w"
May 21 15:31:33.094932 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.094884    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj" event={"ID":"11df5362-95e9-46d0-a74e-475d26d60112","Type":"ContainerStarted","Data":"be754df18747f61d14b6959b092e491a7cc0b163d579ad3f3694352073b0960a"}
May 21 15:31:33.095279 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.095257    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa952ca3-14e6-4a2b-8b6d-200407069d9a-tmp-dir\") pod \"node-resolver-2kc9w\" (UID: \"aa952ca3-14e6-4a2b-8b6d-200407069d9a\") " pod="openshift-dns/node-resolver-2kc9w"
May 21 15:31:33.096625 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.096597    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jn5f7" event={"ID":"960c4f63-b8b9-4b57-b57c-a0f90791c561","Type":"ContainerStarted","Data":"dcf822242744f5e304a10e1f098f70b24dbfa5692b058db74530957c527e651a"}
May 21 15:31:33.108591 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.108559    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dcqgg" event={"ID":"21a1cf79-c675-4148-bad3-7dd74906f7d0","Type":"ContainerStarted","Data":"a5b58181b95621d9e0b4254e2b32ff2b019aec1e59180a277522dd62cf6e7a7d"}
May 21 15:31:33.116238 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.116188    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shxzn\" (UniqueName: \"kubernetes.io/projected/aa952ca3-14e6-4a2b-8b6d-200407069d9a-kube-api-access-shxzn\") pod \"node-resolver-2kc9w\" (UID: \"aa952ca3-14e6-4a2b-8b6d-200407069d9a\") " pod="openshift-dns/node-resolver-2kc9w"
May 21 15:31:33.118979 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.118960    2569 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:31:33.124223 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.124183    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89lm9" event={"ID":"844ed311-7755-4dd5-8f12-7049aaa3f8bf","Type":"ContainerStarted","Data":"2897eba6711a9d948a873a2ef923ac6afd7e2786519f0765174a22905254c10d"}
May 21 15:31:33.132694 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.132668    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-228.ec2.internal" event={"ID":"84c8e4097af05703cff843eeadfd9be2","Type":"ContainerStarted","Data":"8c08addbf18332f1b5831ce5cfd174bde3cada0c31c9fbb99b699a4a2dbb7122"}
May 21 15:31:33.143830 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.143777    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk" event={"ID":"2fe32665-35c8-4ac6-953c-c90107d9d5ff","Type":"ContainerStarted","Data":"89473e95b46d696eb51e75223a5ef90196fe07cadf23ae4ceb2a98407c1e81cb"}
May 21 15:31:33.149294 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.149267    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4mxvd" event={"ID":"527e6cf0-c43f-4dd0-8f50-d377846deb14","Type":"ContainerStarted","Data":"01303c9e9dbe63cc3a1c2c2a015c9ad5de62f4e6f3b5f54ca54732869c5f5bcb"}
May 21 15:31:33.276625 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.276533    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2kc9w"
May 21 15:31:33.300802 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:31:33.300769    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa952ca3_14e6_4a2b_8b6d_200407069d9a.slice/crio-a21a81aef0fe65313ba26375c674cad62de07dc5b9e5aa7844607aa3e1484e33 WatchSource:0}: Error finding container a21a81aef0fe65313ba26375c674cad62de07dc5b9e5aa7844607aa3e1484e33: Status 404 returned error can't find the container with id a21a81aef0fe65313ba26375c674cad62de07dc5b9e5aa7844607aa3e1484e33
May 21 15:31:33.498892 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.498857    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:33.499081 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:33.499007    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:31:33.499081 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:33.499073    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs podName:5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:35.499054054 +0000 UTC m=+5.069419154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs") pod "network-metrics-daemon-g7zsx" (UID: "5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:31:33.599505 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.599425    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzkpg\" (UniqueName: \"kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg\") pod \"network-check-target-r4m92\" (UID: \"d6b5ee0b-6719-4632-8db4-cfd2163ce895\") " pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:33.599673 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:33.599621    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:31:33.599673 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:33.599645    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:31:33.599673 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:33.599659    2569 projected.go:194] Error preparing data for projected volume kube-api-access-kzkpg for pod openshift-network-diagnostics/network-check-target-r4m92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:31:33.599836 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:33.599718    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg podName:d6b5ee0b-6719-4632-8db4-cfd2163ce895 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:35.599698344 +0000 UTC m=+5.170063440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzkpg" (UniqueName: "kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg") pod "network-check-target-r4m92" (UID: "d6b5ee0b-6719-4632-8db4-cfd2163ce895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:31:33.928408 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.928294    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 15:26:31 +0000 UTC" deadline="2027-11-13 04:41:25.196744368 +0000 UTC"
May 21 15:31:33.928408 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:33.928333    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12973h9m51.268415156s"
May 21 15:31:34.020776 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:34.020741    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:34.020944 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:34.020895    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:34.170988 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:34.170917    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2kc9w" event={"ID":"aa952ca3-14e6-4a2b-8b6d-200407069d9a","Type":"ContainerStarted","Data":"a21a81aef0fe65313ba26375c674cad62de07dc5b9e5aa7844607aa3e1484e33"}
May 21 15:31:34.263965 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:34.263624    2569 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:31:34.897777 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:34.897555    2569 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 15:31:35.021735 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:35.021216    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:35.021735 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:35.021357    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:35.517676 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:35.517586    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:35.517878 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:35.517755    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:31:35.517878 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:35.517838    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs podName:5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:39.517808628 +0000 UTC m=+9.088173735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs") pod "network-metrics-daemon-g7zsx" (UID: "5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:31:35.618930 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:35.618889    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzkpg\" (UniqueName: \"kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg\") pod \"network-check-target-r4m92\" (UID: \"d6b5ee0b-6719-4632-8db4-cfd2163ce895\") " pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:35.619115 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:35.619092    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:31:35.619115 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:35.619110    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:31:35.619115 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:35.619139    2569 projected.go:194] Error preparing data for projected volume kube-api-access-kzkpg for pod openshift-network-diagnostics/network-check-target-r4m92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:31:35.619343 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:35.619197    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg podName:d6b5ee0b-6719-4632-8db4-cfd2163ce895 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:39.619179937 +0000 UTC m=+9.189545041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzkpg" (UniqueName: "kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg") pod "network-check-target-r4m92" (UID: "d6b5ee0b-6719-4632-8db4-cfd2163ce895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:31:36.020870 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:36.020838    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:36.021059 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:36.020970    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:37.021114 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:37.020328    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:37.021114 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:37.020701    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:38.020833 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:38.020740    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:38.020980 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:38.020883    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:39.021173 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:39.021117    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:39.021631 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:39.021267    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:39.550810 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:39.550770    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:39.550998 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:39.550936    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:31:39.551061 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:39.550999    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs podName:5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:47.550979081 +0000 UTC m=+17.121344186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs") pod "network-metrics-daemon-g7zsx" (UID: "5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:31:39.651387 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:39.651348    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzkpg\" (UniqueName: \"kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg\") pod \"network-check-target-r4m92\" (UID: \"d6b5ee0b-6719-4632-8db4-cfd2163ce895\") " pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:39.651561 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:39.651536    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:31:39.651561 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:39.651561    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:31:39.651670 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:39.651575    2569 projected.go:194] Error preparing data for projected volume kube-api-access-kzkpg for pod openshift-network-diagnostics/network-check-target-r4m92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:31:39.651670 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:39.651633    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg podName:d6b5ee0b-6719-4632-8db4-cfd2163ce895 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:47.651614898 +0000 UTC m=+17.221980011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzkpg" (UniqueName: "kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg") pod "network-check-target-r4m92" (UID: "d6b5ee0b-6719-4632-8db4-cfd2163ce895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:31:40.020680 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:40.020601    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:40.020846 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:40.020746    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:41.021396 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:41.021355    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:41.021835 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:41.021467    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:42.021027 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:42.020986    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:42.021228 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:42.021158    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:43.020764 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:43.020729    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:43.021187 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:43.020853    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:44.021097 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:44.021066    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:44.021544 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:44.021198    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:45.020904 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:45.020869    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:45.021096 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:45.021017    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:46.021096 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:46.021058    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:46.021536 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:46.021193    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:47.021040 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:47.020998    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:47.021221 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:47.021168    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:47.609564 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:47.609526    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:47.609742 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:47.609648    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:31:47.609742 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:47.609712    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs podName:5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:03.609692688 +0000 UTC m=+33.180057786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs") pod "network-metrics-daemon-g7zsx" (UID: "5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:31:47.710219 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:47.710181    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzkpg\" (UniqueName: \"kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg\") pod \"network-check-target-r4m92\" (UID: \"d6b5ee0b-6719-4632-8db4-cfd2163ce895\") " pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:47.710417 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:47.710372    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:31:47.710417 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:47.710392    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:31:47.710417 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:47.710403    2569 projected.go:194] Error preparing data for projected volume kube-api-access-kzkpg for pod openshift-network-diagnostics/network-check-target-r4m92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:31:47.710546 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:47.710483    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg podName:d6b5ee0b-6719-4632-8db4-cfd2163ce895 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:03.710466666 +0000 UTC m=+33.280831782 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzkpg" (UniqueName: "kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg") pod "network-check-target-r4m92" (UID: "d6b5ee0b-6719-4632-8db4-cfd2163ce895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:31:48.020869 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:48.020831    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:48.021037 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:48.020952    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:49.020767 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:49.020733    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:49.021188 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:49.020848    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:50.020952 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:50.020920    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:50.021419 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:50.021059    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:51.021554 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:51.021526    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:51.021970 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:51.021841    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:51.227479 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:51.227450    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jqksv"]
May 21 15:31:51.242256 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:51.242225    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:51.242390 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:51.242300    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqksv" podUID="1146ae6f-be79-4860-889b-38ed20369c04"
May 21 15:31:51.335698 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:51.335623    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1146ae6f-be79-4860-889b-38ed20369c04-kubelet-config\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:51.335698 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:51.335677    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1146ae6f-be79-4860-889b-38ed20369c04-dbus\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:51.335893 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:51.335759    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:51.436356 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:51.436327    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:51.436506 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:51.436368    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1146ae6f-be79-4860-889b-38ed20369c04-kubelet-config\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:51.436506 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:51.436441    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1146ae6f-be79-4860-889b-38ed20369c04-kubelet-config\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:51.436506 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:51.436485    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 15:31:51.436506 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:51.436490    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1146ae6f-be79-4860-889b-38ed20369c04-dbus\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:51.436703 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:51.436551    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret podName:1146ae6f-be79-4860-889b-38ed20369c04 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:51.936530093 +0000 UTC m=+21.506895199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret") pod "global-pull-secret-syncer-jqksv" (UID: "1146ae6f-be79-4860-889b-38ed20369c04") : object "kube-system"/"original-pull-secret" not registered
May 21 15:31:51.436703 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:51.436622    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1146ae6f-be79-4860-889b-38ed20369c04-dbus\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:51.940862 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:51.940836    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:51.940966 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:51.940929    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 15:31:51.941011 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:51.940980    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret podName:1146ae6f-be79-4860-889b-38ed20369c04 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:52.94096626 +0000 UTC m=+22.511331350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret") pod "global-pull-secret-syncer-jqksv" (UID: "1146ae6f-be79-4860-889b-38ed20369c04") : object "kube-system"/"original-pull-secret" not registered
May 21 15:31:52.020505 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:52.020480    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:52.020606 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:52.020583    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:52.211188 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:52.210991    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:31:52.211816 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:52.211679    2569 generic.go:358] "Generic (PLEG): container finished" podID="11df5362-95e9-46d0-a74e-475d26d60112" containerID="b5a3d10dced6474dc658f3598c5add7cd6ec5c00d2d4c5ea7b293eb73b327f2d" exitCode=1
May 21 15:31:52.211816 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:52.211757    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj" event={"ID":"11df5362-95e9-46d0-a74e-475d26d60112","Type":"ContainerStarted","Data":"024b158571c007ecb3b8619628b3b347550af910e6fda5c71fdfe83a6af5f480"}
May 21 15:31:52.211816 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:52.211785    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj" event={"ID":"11df5362-95e9-46d0-a74e-475d26d60112","Type":"ContainerStarted","Data":"8af1d016490ae929e37005de3c1802decf75a4aa2e5c3ba5f5329fb702ea6b79"}
May 21 15:31:52.211816 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:52.211802    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj" event={"ID":"11df5362-95e9-46d0-a74e-475d26d60112","Type":"ContainerDied","Data":"b5a3d10dced6474dc658f3598c5add7cd6ec5c00d2d4c5ea7b293eb73b327f2d"}
May 21 15:31:52.212022 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:52.211828    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj" event={"ID":"11df5362-95e9-46d0-a74e-475d26d60112","Type":"ContainerStarted","Data":"ef195ffb6bd57d31c01c62416bcdd13c63d889bd4fd5ac20a76eadc1fcde2074"}
May 21 15:31:52.216707 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:52.216681    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dcqgg" event={"ID":"21a1cf79-c675-4148-bad3-7dd74906f7d0","Type":"ContainerStarted","Data":"651748f565f5f4ab268660ef785744d8ffa1cf3e0bc412faab9bad29c5f6f308"}
May 21 15:31:52.220497 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:52.220268    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-228.ec2.internal" event={"ID":"84c8e4097af05703cff843eeadfd9be2","Type":"ContainerStarted","Data":"95104db6a90e4a50d85e7dad6a588ed14e7d8b7943b2c1a263ad80ba1f72b5d7"}
May 21 15:31:52.228810 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:52.228784    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4mxvd" event={"ID":"527e6cf0-c43f-4dd0-8f50-d377846deb14","Type":"ContainerStarted","Data":"ddff80f5deed840b5fbf9bbe0c6d5cfef17de0b9077566f71aec158d8c805f2d"}
May 21 15:31:52.237787 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:52.237647    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-dcqgg" podStartSLOduration=1.439568335 podStartE2EDuration="21.237626739s" podCreationTimestamp="2026-05-21 15:31:31 +0000 UTC" firstStartedPulling="2026-05-21 15:31:32.230866975 +0000 UTC m=+1.801232066" lastFinishedPulling="2026-05-21 15:31:52.028925365 +0000 UTC m=+21.599290470" observedRunningTime="2026-05-21 15:31:52.233961005 +0000 UTC m=+21.804326119" watchObservedRunningTime="2026-05-21 15:31:52.237626739 +0000 UTC m=+21.807991853"
May 21 15:31:52.247143 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:52.247079    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-228.ec2.internal" podStartSLOduration=21.247064077 podStartE2EDuration="21.247064077s" podCreationTimestamp="2026-05-21 15:31:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:31:52.246187215 +0000 UTC m=+21.816552330" watchObservedRunningTime="2026-05-21 15:31:52.247064077 +0000 UTC m=+21.817429189"
May 21 15:31:52.948217 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:52.947990    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:52.948419 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:52.948157    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 15:31:52.948419 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:52.948331    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret podName:1146ae6f-be79-4860-889b-38ed20369c04 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:54.948315693 +0000 UTC m=+24.518680784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret") pod "global-pull-secret-syncer-jqksv" (UID: "1146ae6f-be79-4860-889b-38ed20369c04") : object "kube-system"/"original-pull-secret" not registered
May 21 15:31:53.020838 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.020800    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:53.021034 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.020802    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:53.021034 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:53.020923    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:53.021174 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:53.021033    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqksv" podUID="1146ae6f-be79-4860-889b-38ed20369c04"
May 21 15:31:53.232935 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.232888    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7rj7l" event={"ID":"9a98a1f8-3069-4b7d-9709-95b0b4a4652d","Type":"ContainerStarted","Data":"8358d46fe02441175f3fd98a9c43f0fffaef7a5b4cf7e10ef324698efea9c371"}
May 21 15:31:53.235681 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.235657    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:31:53.236051 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.236009    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj" event={"ID":"11df5362-95e9-46d0-a74e-475d26d60112","Type":"ContainerStarted","Data":"08a9e7363d5ee9645f4987b97669d5f8bdb27681393eb5f1303ded5115efd8e3"}
May 21 15:31:53.236173 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.236060    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj" event={"ID":"11df5362-95e9-46d0-a74e-475d26d60112","Type":"ContainerStarted","Data":"75b2ac98212cbbc666e2f253510a390fb9f74df574be44cc99869d02a6d35da9"}
May 21 15:31:53.237421 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.237396    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jn5f7" event={"ID":"960c4f63-b8b9-4b57-b57c-a0f90791c561","Type":"ContainerStarted","Data":"e5ba0bf5d42606ba1f14b095f6d3d99d3674f97e63acf79520b837860dceb27b"}
May 21 15:31:53.238894 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.238872    2569 generic.go:358] "Generic (PLEG): container finished" podID="844ed311-7755-4dd5-8f12-7049aaa3f8bf" containerID="d27511559eee3d13d2b669dd4088c1ef9cd80bb00d17487d8a4d8a5961a3fee8" exitCode=0
May 21 15:31:53.238982 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.238958    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89lm9" event={"ID":"844ed311-7755-4dd5-8f12-7049aaa3f8bf","Type":"ContainerDied","Data":"d27511559eee3d13d2b669dd4088c1ef9cd80bb00d17487d8a4d8a5961a3fee8"}
May 21 15:31:53.240335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.240302    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2kc9w" event={"ID":"aa952ca3-14e6-4a2b-8b6d-200407069d9a","Type":"ContainerStarted","Data":"226d457d1ecffc1b79367266afd94367887b7b05e0d66f0f605c0cbaf96d008a"}
May 21 15:31:53.241835 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.241808    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk" event={"ID":"2fe32665-35c8-4ac6-953c-c90107d9d5ff","Type":"ContainerStarted","Data":"044a8a9bdd02553b24e900567106a2383802b415eb94a90e2d6d85ab5cfd5fb8"}
May 21 15:31:53.243254 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.243230    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r7x4f" event={"ID":"d73ccee2-a400-46cf-9cf6-17e874c9d12f","Type":"ContainerStarted","Data":"fb52eb1612de15e4927fa6716033a3a666810d0f74ca3213b7a78cb2b9847a2c"}
May 21 15:31:53.244869 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.244847    2569 generic.go:358] "Generic (PLEG): container finished" podID="27163b0b4d11eb786bd8e6e6beb8eef2" containerID="33bb3afc9d130329e63d9484dba6f1ef20adc1ad193eb5c9fc33ef390d0a19f4" exitCode=0
May 21 15:31:53.244966 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.244944    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal" event={"ID":"27163b0b4d11eb786bd8e6e6beb8eef2","Type":"ContainerDied","Data":"33bb3afc9d130329e63d9484dba6f1ef20adc1ad193eb5c9fc33ef390d0a19f4"}
May 21 15:31:53.246614 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.246574    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4mxvd" podStartSLOduration=2.919507373 podStartE2EDuration="22.246561786s" podCreationTimestamp="2026-05-21 15:31:31 +0000 UTC" firstStartedPulling="2026-05-21 15:31:32.270317453 +0000 UTC m=+1.840682544" lastFinishedPulling="2026-05-21 15:31:51.597371861 +0000 UTC m=+21.167736957" observedRunningTime="2026-05-21 15:31:52.260076534 +0000 UTC m=+21.830441647" watchObservedRunningTime="2026-05-21 15:31:53.246561786 +0000 UTC m=+22.816926898"
May 21 15:31:53.247048 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.247017    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7rj7l" podStartSLOduration=11.389849741 podStartE2EDuration="22.247006218s" podCreationTimestamp="2026-05-21 15:31:31 +0000 UTC" firstStartedPulling="2026-05-21 15:31:32.30980637 +0000 UTC m=+1.880171461" lastFinishedPulling="2026-05-21 15:31:43.166962834 +0000 UTC m=+12.737327938" observedRunningTime="2026-05-21 15:31:53.246350277 +0000 UTC m=+22.816715390" watchObservedRunningTime="2026-05-21 15:31:53.247006218 +0000 UTC m=+22.817371332"
May 21 15:31:53.260649 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.260611    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r7x4f" podStartSLOduration=2.903092283 podStartE2EDuration="22.260600013s" podCreationTimestamp="2026-05-21 15:31:31 +0000 UTC" firstStartedPulling="2026-05-21 15:31:32.237904345 +0000 UTC m=+1.808269436" lastFinishedPulling="2026-05-21 15:31:51.595412065 +0000 UTC m=+21.165777166" observedRunningTime="2026-05-21 15:31:53.260240456 +0000 UTC m=+22.830605580" watchObservedRunningTime="2026-05-21 15:31:53.260600013 +0000 UTC m=+22.830965126"
May 21 15:31:53.277713 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.277639    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jn5f7" podStartSLOduration=3.341584572 podStartE2EDuration="22.277623987s" podCreationTimestamp="2026-05-21 15:31:31 +0000 UTC" firstStartedPulling="2026-05-21 15:31:32.250828634 +0000 UTC m=+1.821193725" lastFinishedPulling="2026-05-21 15:31:51.186868036 +0000 UTC m=+20.757233140" observedRunningTime="2026-05-21 15:31:53.277195925 +0000 UTC m=+22.847561037" watchObservedRunningTime="2026-05-21 15:31:53.277623987 +0000 UTC m=+22.847989101"
May 21 15:31:53.292083 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.292050    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-2kc9w" podStartSLOduration=3.002506353 podStartE2EDuration="21.292040467s" podCreationTimestamp="2026-05-21 15:31:32 +0000 UTC" firstStartedPulling="2026-05-21 15:31:33.305905235 +0000 UTC m=+2.876270331" lastFinishedPulling="2026-05-21 15:31:51.595439336 +0000 UTC m=+21.165804445" observedRunningTime="2026-05-21 15:31:53.291684047 +0000 UTC m=+22.862049159" watchObservedRunningTime="2026-05-21 15:31:53.292040467 +0000 UTC m=+22.862405581"
May 21 15:31:53.742543 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.742518    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 15:31:53.954269 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.953986    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T15:31:53.742536551Z","UUID":"0c0e9917-1fd3-4bc3-9365-722a297a0646","Handler":null,"Name":"","Endpoint":""}
May 21 15:31:53.957505 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.957481    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 15:31:53.957629 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:53.957515    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 15:31:54.020740 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:54.020709    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:54.020968 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:54.020851    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:54.250061 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:54.249982    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk" event={"ID":"2fe32665-35c8-4ac6-953c-c90107d9d5ff","Type":"ContainerStarted","Data":"4b28d13bf41cdc8a739bde177460b28b427cc688f5d4d11072c5286be974326e"}
May 21 15:31:54.251762 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:54.251730    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal" event={"ID":"27163b0b4d11eb786bd8e6e6beb8eef2","Type":"ContainerStarted","Data":"2ad6e7c1b41eff15ffd676b05adfa9881aa5d0083482119ca3e73d20a110724a"}
May 21 15:31:54.967656 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:54.967573    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:54.967809 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:54.967748    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 15:31:54.967878 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:54.967826    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret podName:1146ae6f-be79-4860-889b-38ed20369c04 nodeName:}" failed. No retries permitted until 2026-05-21 15:31:58.967806698 +0000 UTC m=+28.538171803 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret") pod "global-pull-secret-syncer-jqksv" (UID: "1146ae6f-be79-4860-889b-38ed20369c04") : object "kube-system"/"original-pull-secret" not registered
May 21 15:31:55.020501 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:55.020471    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:55.020685 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:55.020603    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:55.020685 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:55.020655    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:55.021134 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:55.021060    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqksv" podUID="1146ae6f-be79-4860-889b-38ed20369c04"
May 21 15:31:55.254824 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:55.254741    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk" event={"ID":"2fe32665-35c8-4ac6-953c-c90107d9d5ff","Type":"ContainerStarted","Data":"49bd79f4a43c8537afc6f23364babd3c763e6c915c51caa658fb69e910d287bb"}
May 21 15:31:55.257287 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:55.257263    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:31:55.257585 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:55.257563    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj" event={"ID":"11df5362-95e9-46d0-a74e-475d26d60112","Type":"ContainerStarted","Data":"d4b6f607a1963a5402279b774b8c52108fdf4fda63898590fbdb4c2766ee6446"}
May 21 15:31:55.271549 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:55.271518    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-228.ec2.internal" podStartSLOduration=24.271507934 podStartE2EDuration="24.271507934s" podCreationTimestamp="2026-05-21 15:31:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:31:54.269759449 +0000 UTC m=+23.840124564" watchObservedRunningTime="2026-05-21 15:31:55.271507934 +0000 UTC m=+24.841873046"
May 21 15:31:55.271886 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:55.271866    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frldk" podStartSLOduration=1.932180322 podStartE2EDuration="24.271860058s" podCreationTimestamp="2026-05-21 15:31:31 +0000 UTC" firstStartedPulling="2026-05-21 15:31:32.297893799 +0000 UTC m=+1.868258894" lastFinishedPulling="2026-05-21 15:31:54.637573525 +0000 UTC m=+24.207938630" observedRunningTime="2026-05-21 15:31:55.270915107 +0000 UTC m=+24.841280219" watchObservedRunningTime="2026-05-21 15:31:55.271860058 +0000 UTC m=+24.842225190"
May 21 15:31:56.020412 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:56.020376    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:56.020596 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:56.020483    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:56.383056 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:56.383021    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jn5f7"
May 21 15:31:56.383578 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:56.383559    2569 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jn5f7"
May 21 15:31:57.020497 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:57.020239    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:57.020565 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:57.020289    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:57.020621 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:57.020580    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqksv" podUID="1146ae6f-be79-4860-889b-38ed20369c04"
May 21 15:31:57.020676 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:57.020627    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:57.265159 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:57.265074    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:31:57.265525 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:57.265492    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj" event={"ID":"11df5362-95e9-46d0-a74e-475d26d60112","Type":"ContainerStarted","Data":"0b470ffb3f9067aff4d8f29384cfa990a897785d2241bd4dac4eedd829093bc3"}
May 21 15:31:57.265769 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:57.265751    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jn5f7"
May 21 15:31:57.266000 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:57.265982    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:57.266085 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:57.266007    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:57.266085 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:57.266018    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:57.266429 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:57.266081    2569 scope.go:117] "RemoveContainer" containerID="b5a3d10dced6474dc658f3598c5add7cd6ec5c00d2d4c5ea7b293eb73b327f2d"
May 21 15:31:57.266964 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:57.266948    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jn5f7"
May 21 15:31:57.285082 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:57.285059    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:57.285200 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:57.285183    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:31:58.020258 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:58.020220    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:58.021003 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:58.020333    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:58.271245 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:58.271148    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:31:58.271574 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:58.271540    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj" event={"ID":"11df5362-95e9-46d0-a74e-475d26d60112","Type":"ContainerStarted","Data":"16f0ed9584d509921071d08c6635ecce6eea2f82e075da3966d616fbc16f5c36"}
May 21 15:31:58.298283 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:58.298230    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj" podStartSLOduration=7.939472851 podStartE2EDuration="27.298216334s" podCreationTimestamp="2026-05-21 15:31:31 +0000 UTC" firstStartedPulling="2026-05-21 15:31:32.276992703 +0000 UTC m=+1.847357793" lastFinishedPulling="2026-05-21 15:31:51.635736185 +0000 UTC m=+21.206101276" observedRunningTime="2026-05-21 15:31:58.296900916 +0000 UTC m=+27.867266053" watchObservedRunningTime="2026-05-21 15:31:58.298216334 +0000 UTC m=+27.868581446"
May 21 15:31:58.947879 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:58.947844    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g7zsx"]
May 21 15:31:58.948048 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:58.947963    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:31:58.948111 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:58.948083    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:31:58.950680 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:58.950654    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r4m92"]
May 21 15:31:58.950829 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:58.950776    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:31:58.950889 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:58.950862    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:31:58.951342 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:58.951317    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jqksv"]
May 21 15:31:58.951490 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:58.951422    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:58.951557 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:58.951505    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqksv" podUID="1146ae6f-be79-4860-889b-38ed20369c04"
May 21 15:31:59.000779 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:31:59.000742    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:31:59.000950 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:59.000910    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 15:31:59.001016 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:31:59.000992    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret podName:1146ae6f-be79-4860-889b-38ed20369c04 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:07.000969572 +0000 UTC m=+36.571334701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret") pod "global-pull-secret-syncer-jqksv" (UID: "1146ae6f-be79-4860-889b-38ed20369c04") : object "kube-system"/"original-pull-secret" not registered
May 21 15:32:00.020363 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:00.020182    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:32:00.020758 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:00.020442    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqksv" podUID="1146ae6f-be79-4860-889b-38ed20369c04"
May 21 15:32:01.021385 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:01.021313    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:32:01.021789 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:01.021414    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:32:01.021789 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:01.021481    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:32:01.021789 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:01.021560    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:32:01.279992 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:01.279912    2569 generic.go:358] "Generic (PLEG): container finished" podID="844ed311-7755-4dd5-8f12-7049aaa3f8bf" containerID="5c7712ab8d7a59b5ec5a74aee764a8dda2033362bc545d23fac9ad265c168e69" exitCode=0
May 21 15:32:01.279992 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:01.279959    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89lm9" event={"ID":"844ed311-7755-4dd5-8f12-7049aaa3f8bf","Type":"ContainerDied","Data":"5c7712ab8d7a59b5ec5a74aee764a8dda2033362bc545d23fac9ad265c168e69"}
May 21 15:32:02.020541 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:02.020507    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:32:02.020742 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:02.020622    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqksv" podUID="1146ae6f-be79-4860-889b-38ed20369c04"
May 21 15:32:03.020943 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:03.020861    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:32:03.020943 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:03.020872    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:32:03.021413 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:03.020967    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:32:03.021413 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:03.021082    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:32:03.285932 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:03.285851    2569 generic.go:358] "Generic (PLEG): container finished" podID="844ed311-7755-4dd5-8f12-7049aaa3f8bf" containerID="d3852b4788776ebc361bda2201d5a403da12b822c6ecfef6f32c51a6c041c131" exitCode=0
May 21 15:32:03.285932 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:03.285905    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89lm9" event={"ID":"844ed311-7755-4dd5-8f12-7049aaa3f8bf","Type":"ContainerDied","Data":"d3852b4788776ebc361bda2201d5a403da12b822c6ecfef6f32c51a6c041c131"}
May 21 15:32:03.640542 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:03.640513    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:32:03.640756 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:03.640665    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:03.640756 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:03.640735    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs podName:5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:35.640713567 +0000 UTC m=+65.211078659 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs") pod "network-metrics-daemon-g7zsx" (UID: "5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 15:32:03.741522 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:03.741485    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzkpg\" (UniqueName: \"kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg\") pod \"network-check-target-r4m92\" (UID: \"d6b5ee0b-6719-4632-8db4-cfd2163ce895\") " pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:32:03.741709 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:03.741626    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 15:32:03.741709 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:03.741645    2569 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 15:32:03.741709 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:03.741654    2569 projected.go:194] Error preparing data for projected volume kube-api-access-kzkpg for pod openshift-network-diagnostics/network-check-target-r4m92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:03.741709 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:03.741703    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg podName:d6b5ee0b-6719-4632-8db4-cfd2163ce895 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:35.741688487 +0000 UTC m=+65.312053577 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kzkpg" (UniqueName: "kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg") pod "network-check-target-r4m92" (UID: "d6b5ee0b-6719-4632-8db4-cfd2163ce895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 15:32:04.020550 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:04.020483    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:32:04.020680 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:04.020579    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jqksv" podUID="1146ae6f-be79-4860-889b-38ed20369c04"
May 21 15:32:05.021086 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.020909    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:32:05.021498 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.020909    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:32:05.021498 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:05.021172    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r4m92" podUID="d6b5ee0b-6719-4632-8db4-cfd2163ce895"
May 21 15:32:05.021498 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:05.021273    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:32:05.290639 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.290543    2569 generic.go:358] "Generic (PLEG): container finished" podID="844ed311-7755-4dd5-8f12-7049aaa3f8bf" containerID="de3c296a27c6c9e38b4b0e02532568ee514f03219c1d2173106ab2e11ea11417" exitCode=0
May 21 15:32:05.290639 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.290601    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89lm9" event={"ID":"844ed311-7755-4dd5-8f12-7049aaa3f8bf","Type":"ContainerDied","Data":"de3c296a27c6c9e38b4b0e02532568ee514f03219c1d2173106ab2e11ea11417"}
May 21 15:32:05.739817 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.739788    2569 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-135-228.ec2.internal" event="NodeReady"
May 21 15:32:05.739983 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.739914    2569 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 15:32:05.772857 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.772662    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"]
May 21 15:32:05.774643 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.774625    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:32:05.776724 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.776697    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-764fbcc997-s2gws"]
May 21 15:32:05.776973 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.776954    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 21 15:32:05.777180 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.776956    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 21 15:32:05.777298 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.777260    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-d4qrz\""
May 21 15:32:05.778474 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.778459    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk"]
May 21 15:32:05.778631 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.778613    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:05.780137 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.780106    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"]
May 21 15:32:05.780246 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.780232    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk"
May 21 15:32:05.780754 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.780721    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 21 15:32:05.780754 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.780739    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dpq6k\""
May 21 15:32:05.780754 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.780738    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 21 15:32:05.780941 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.780743    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 21 15:32:05.782003 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.781975    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"]
May 21 15:32:05.782181 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.782162    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:32:05.782488 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.782470    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 21 15:32:05.782569 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.782524    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-d27t6\""
May 21 15:32:05.782669 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.782646    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 21 15:32:05.782747 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.782688    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 21 15:32:05.782806 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.782790    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 21 15:32:05.783930 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.783915    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:05.784756 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.784739    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 21 15:32:05.786036 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.786015    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"]
May 21 15:32:05.786909 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.786749    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 21 15:32:05.786909 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.786763    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 21 15:32:05.787138 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.786934    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 21 15:32:05.787138 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.787036    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 21 15:32:05.788256 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.788235    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 21 15:32:05.793569 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.793421    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk"]
May 21 15:32:05.794307 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.794283    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"]
May 21 15:32:05.797169 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.797136    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-764fbcc997-s2gws"]
May 21 15:32:05.802640 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.802371    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4m6jg"]
May 21 15:32:05.804619 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.804598    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pxm7h"]
May 21 15:32:05.805005 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.804984    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:05.808506 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.807861    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:32:05.808506 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.807983    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 15:32:05.808506 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.808385    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5bcp9\""
May 21 15:32:05.808720 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.808530    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 15:32:05.810185 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.810097    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 15:32:05.810618 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.810535    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 15:32:05.810618 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.810554    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2wggx\""
May 21 15:32:05.810770 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.810664    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 15:32:05.815382 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.815360    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"]
May 21 15:32:05.816351 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.816332    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4m6jg"]
May 21 15:32:05.826860 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.826538    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pxm7h"]
May 21 15:32:05.858853 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.858818    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:32:05.858988 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.858891    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:32:05.959860 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.959823    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-ca\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:05.960038 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.959871    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-certificates\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:05.960038 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.959904    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:05.960038 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.959933    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:05.960038 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.959975    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d1b4f8c-380c-4a32-a48d-f3aa8d127303-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79f58b77f6-hzwbk\" (UID: \"2d1b4f8c-380c-4a32-a48d-f3aa8d127303\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk"
May 21 15:32:05.960038 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960006    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:32:05.960038 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960032    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsjdt\" (UniqueName: \"kubernetes.io/projected/c0e29668-1c2d-4d63-b5d5-50b338b6824e-kube-api-access-tsjdt\") pod \"klusterlet-addon-workmgr-fb9499d8c-d7fl4\" (UID: \"c0e29668-1c2d-4d63-b5d5-50b338b6824e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:32:05.960323 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960059    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8w82\" (UniqueName: \"kubernetes.io/projected/2d1b4f8c-380c-4a32-a48d-f3aa8d127303-kube-api-access-q8w82\") pod \"managed-serviceaccount-addon-agent-79f58b77f6-hzwbk\" (UID: \"2d1b4f8c-380c-4a32-a48d-f3aa8d127303\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk"
May 21 15:32:05.960323 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960085    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a1ca7e5-1b66-43e8-b816-aeffc758f649-ca-trust-extracted\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:05.960323 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960109    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs7l8\" (UniqueName: \"kubernetes.io/projected/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-kube-api-access-xs7l8\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:05.960323 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960173    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htqf8\" (UniqueName: \"kubernetes.io/projected/c0d3583c-f875-4e3b-b92b-5c68a8d24226-kube-api-access-htqf8\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:05.960323 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960199    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:05.960323 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960218    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0d3583c-f875-4e3b-b92b-5c68a8d24226-tmp-dir\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:05.960323 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960296    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:32:05.960633 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960326    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-hub\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:05.960633 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960350    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:05.960633 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960408    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0e29668-1c2d-4d63-b5d5-50b338b6824e-tmp\") pod \"klusterlet-addon-workmgr-fb9499d8c-d7fl4\" (UID: \"c0e29668-1c2d-4d63-b5d5-50b338b6824e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:32:05.960633 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:05.960451    2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 15:32:05.960633 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:05.960521    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert podName:66b1e4a6-a9d4-411c-9eb6-786ddc7ba269 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:06.460500195 +0000 UTC m=+36.030865293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-t7xs6" (UID: "66b1e4a6-a9d4-411c-9eb6-786ddc7ba269") : secret "networking-console-plugin-cert" not found
May 21 15:32:05.960633 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960541    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-bound-sa-token\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:05.960633 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960576    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:32:05.960957 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960721    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a1ca7e5-1b66-43e8-b816-aeffc758f649-trusted-ca\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:05.960957 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960747    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:32:05.960957 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960761    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a1ca7e5-1b66-43e8-b816-aeffc758f649-image-registry-private-configuration\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:05.960957 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960793    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c0e29668-1c2d-4d63-b5d5-50b338b6824e-klusterlet-config\") pod \"klusterlet-addon-workmgr-fb9499d8c-d7fl4\" (UID: \"c0e29668-1c2d-4d63-b5d5-50b338b6824e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:32:05.960957 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960816    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c46tw\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-kube-api-access-c46tw\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:05.960957 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960837    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a1ca7e5-1b66-43e8-b816-aeffc758f649-installation-pull-secrets\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:05.960957 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960869    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0d3583c-f875-4e3b-b92b-5c68a8d24226-config-volume\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:05.960957 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960931    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfrcc\" (UniqueName: \"kubernetes.io/projected/43637790-37ab-4877-bf45-1c61fa8909e5-kube-api-access-qfrcc\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:32:05.961283 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:05.960977    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.020630 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.020550    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:32:06.023262 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.023209    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 15:32:06.061976 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.061943    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-hub\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.061976 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.061980    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.062232 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062004    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0e29668-1c2d-4d63-b5d5-50b338b6824e-tmp\") pod \"klusterlet-addon-workmgr-fb9499d8c-d7fl4\" (UID: \"c0e29668-1c2d-4d63-b5d5-50b338b6824e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:32:06.062232 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062140    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-bound-sa-token\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.062232 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062207    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:32:06.062232 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062232    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a1ca7e5-1b66-43e8-b816-aeffc758f649-trusted-ca\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.062411 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062252    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a1ca7e5-1b66-43e8-b816-aeffc758f649-image-registry-private-configuration\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.062411 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062279    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c0e29668-1c2d-4d63-b5d5-50b338b6824e-klusterlet-config\") pod \"klusterlet-addon-workmgr-fb9499d8c-d7fl4\" (UID: \"c0e29668-1c2d-4d63-b5d5-50b338b6824e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:32:06.062411 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062308    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c46tw\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-kube-api-access-c46tw\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.062411 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062335    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a1ca7e5-1b66-43e8-b816-aeffc758f649-installation-pull-secrets\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.062411 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.062341    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:32:06.062411 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062362    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0d3583c-f875-4e3b-b92b-5c68a8d24226-config-volume\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:06.062411 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.062399    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert podName:43637790-37ab-4877-bf45-1c61fa8909e5 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:06.562379221 +0000 UTC m=+36.132744332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert") pod "ingress-canary-pxm7h" (UID: "43637790-37ab-4877-bf45-1c61fa8909e5") : secret "canary-serving-cert" not found
May 21 15:32:06.062697 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062420    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfrcc\" (UniqueName: \"kubernetes.io/projected/43637790-37ab-4877-bf45-1c61fa8909e5-kube-api-access-qfrcc\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:32:06.062697 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062452    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.062697 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062606    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-ca\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.062697 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062644    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-certificates\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.062697 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062673    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:06.062697 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062393    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0e29668-1c2d-4d63-b5d5-50b338b6824e-tmp\") pod \"klusterlet-addon-workmgr-fb9499d8c-d7fl4\" (UID: \"c0e29668-1c2d-4d63-b5d5-50b338b6824e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:32:06.062959 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062700    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.062959 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062741    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d1b4f8c-380c-4a32-a48d-f3aa8d127303-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79f58b77f6-hzwbk\" (UID: \"2d1b4f8c-380c-4a32-a48d-f3aa8d127303\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk"
May 21 15:32:06.062959 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062775    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjdt\" (UniqueName: \"kubernetes.io/projected/c0e29668-1c2d-4d63-b5d5-50b338b6824e-kube-api-access-tsjdt\") pod \"klusterlet-addon-workmgr-fb9499d8c-d7fl4\" (UID: \"c0e29668-1c2d-4d63-b5d5-50b338b6824e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:32:06.062959 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062815    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q8w82\" (UniqueName: \"kubernetes.io/projected/2d1b4f8c-380c-4a32-a48d-f3aa8d127303-kube-api-access-q8w82\") pod \"managed-serviceaccount-addon-agent-79f58b77f6-hzwbk\" (UID: \"2d1b4f8c-380c-4a32-a48d-f3aa8d127303\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk"
May 21 15:32:06.062959 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062838    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a1ca7e5-1b66-43e8-b816-aeffc758f649-ca-trust-extracted\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.062959 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062865    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xs7l8\" (UniqueName: \"kubernetes.io/projected/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-kube-api-access-xs7l8\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.062959 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062907    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htqf8\" (UniqueName: \"kubernetes.io/projected/c0d3583c-f875-4e3b-b92b-5c68a8d24226-kube-api-access-htqf8\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:06.062959 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062936    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.062959 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062954    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0d3583c-f875-4e3b-b92b-5c68a8d24226-config-volume\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:06.063403 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.062965    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0d3583c-f875-4e3b-b92b-5c68a8d24226-tmp-dir\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:06.063403 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.063333    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-certificates\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.063403 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.063344    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0d3583c-f875-4e3b-b92b-5c68a8d24226-tmp-dir\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:06.063525 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.063423    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:32:06.063525 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.063465    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls podName:c0d3583c-f875-4e3b-b92b-5c68a8d24226 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:06.563451442 +0000 UTC m=+36.133816536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls") pod "dns-default-4m6jg" (UID: "c0d3583c-f875-4e3b-b92b-5c68a8d24226") : secret "dns-default-metrics-tls" not found
May 21 15:32:06.063525 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.063520    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:32:06.063639 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.063529    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764fbcc997-s2gws: secret "image-registry-tls" not found
May 21 15:32:06.063639 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.063557    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls podName:9a1ca7e5-1b66-43e8-b816-aeffc758f649 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:06.563548722 +0000 UTC m=+36.133913827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls") pod "image-registry-764fbcc997-s2gws" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649") : secret "image-registry-tls" not found
May 21 15:32:06.063752 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.063735    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a1ca7e5-1b66-43e8-b816-aeffc758f649-trusted-ca\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.064417 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.064115    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.064417 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.064142    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a1ca7e5-1b66-43e8-b816-aeffc758f649-ca-trust-extracted\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.067755 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.067681    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a1ca7e5-1b66-43e8-b816-aeffc758f649-image-registry-private-configuration\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.067883 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.067776    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-hub\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.067883 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.067806    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.067997 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.067871    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a1ca7e5-1b66-43e8-b816-aeffc758f649-installation-pull-secrets\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.067997 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.067960    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.068422 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.068399    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d1b4f8c-380c-4a32-a48d-f3aa8d127303-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-79f58b77f6-hzwbk\" (UID: \"2d1b4f8c-380c-4a32-a48d-f3aa8d127303\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk"
May 21 15:32:06.068526 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.068500    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c0e29668-1c2d-4d63-b5d5-50b338b6824e-klusterlet-config\") pod \"klusterlet-addon-workmgr-fb9499d8c-d7fl4\" (UID: \"c0e29668-1c2d-4d63-b5d5-50b338b6824e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:32:06.069190 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.069169    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-ca\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.071050 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.071008    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-bound-sa-token\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.071577 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.071534    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c46tw\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-kube-api-access-c46tw\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.072634 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.072591    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsjdt\" (UniqueName: \"kubernetes.io/projected/c0e29668-1c2d-4d63-b5d5-50b338b6824e-kube-api-access-tsjdt\") pod \"klusterlet-addon-workmgr-fb9499d8c-d7fl4\" (UID: \"c0e29668-1c2d-4d63-b5d5-50b338b6824e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:32:06.073089 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.073062    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htqf8\" (UniqueName: \"kubernetes.io/projected/c0d3583c-f875-4e3b-b92b-5c68a8d24226-kube-api-access-htqf8\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:06.073217 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.073200    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs7l8\" (UniqueName: \"kubernetes.io/projected/0ffb12d9-7c11-4eb3-a341-7483f5b4da22-kube-api-access-xs7l8\") pod \"cluster-proxy-proxy-agent-59fcc96fcb-ckxnw\" (UID: \"0ffb12d9-7c11-4eb3-a341-7483f5b4da22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.073483 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.073461    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8w82\" (UniqueName: \"kubernetes.io/projected/2d1b4f8c-380c-4a32-a48d-f3aa8d127303-kube-api-access-q8w82\") pod \"managed-serviceaccount-addon-agent-79f58b77f6-hzwbk\" (UID: \"2d1b4f8c-380c-4a32-a48d-f3aa8d127303\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk"
May 21 15:32:06.073877 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.073856    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfrcc\" (UniqueName: \"kubernetes.io/projected/43637790-37ab-4877-bf45-1c61fa8909e5-kube-api-access-qfrcc\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:32:06.115078 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.115054    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk"
May 21 15:32:06.123781 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.123756    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:32:06.141474 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.141450    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:32:06.326107 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.326072    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"]
May 21 15:32:06.329319 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.329287    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"]
May 21 15:32:06.330304 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.330273    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk"]
May 21 15:32:06.332475 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:32:06.332453    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e29668_1c2d_4d63_b5d5_50b338b6824e.slice/crio-19ef409a44dceb6efc676acc62a166bcc1250bbb050cfc530544646b2be9e5ac WatchSource:0}: Error finding container 19ef409a44dceb6efc676acc62a166bcc1250bbb050cfc530544646b2be9e5ac: Status 404 returned error can't find the container with id 19ef409a44dceb6efc676acc62a166bcc1250bbb050cfc530544646b2be9e5ac
May 21 15:32:06.333681 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:32:06.333644    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d1b4f8c_380c_4a32_a48d_f3aa8d127303.slice/crio-2d4aaa58bf1ca3f9923fbbd535ba9ce6c85d0120a93b2e7a9e97c428daa64589 WatchSource:0}: Error finding container 2d4aaa58bf1ca3f9923fbbd535ba9ce6c85d0120a93b2e7a9e97c428daa64589: Status 404 returned error can't find the container with id 2d4aaa58bf1ca3f9923fbbd535ba9ce6c85d0120a93b2e7a9e97c428daa64589
May 21 15:32:06.335109 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:32:06.335079    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ffb12d9_7c11_4eb3_a341_7483f5b4da22.slice/crio-e0786ec02530ba2d01903e2cd8b4a51971933dc17b50624d597365131527aeb7 WatchSource:0}: Error finding container e0786ec02530ba2d01903e2cd8b4a51971933dc17b50624d597365131527aeb7: Status 404 returned error can't find the container with id e0786ec02530ba2d01903e2cd8b4a51971933dc17b50624d597365131527aeb7
May 21 15:32:06.467475 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.467438    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:32:06.467644 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.467580    2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 15:32:06.467644 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.467641    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert podName:66b1e4a6-a9d4-411c-9eb6-786ddc7ba269 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:07.467625546 +0000 UTC m=+37.037990643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-t7xs6" (UID: "66b1e4a6-a9d4-411c-9eb6-786ddc7ba269") : secret "networking-console-plugin-cert" not found
May 21 15:32:06.568447 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.568366    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:32:06.568447 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.568423    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:06.568625 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:06.568491    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:06.568625 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.568524    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:32:06.568625 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.568583    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls podName:c0d3583c-f875-4e3b-b92b-5c68a8d24226 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:07.568564531 +0000 UTC m=+37.138929637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls") pod "dns-default-4m6jg" (UID: "c0d3583c-f875-4e3b-b92b-5c68a8d24226") : secret "dns-default-metrics-tls" not found
May 21 15:32:06.568625 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.568584    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:32:06.568625 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.568603    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764fbcc997-s2gws: secret "image-registry-tls" not found
May 21 15:32:06.568625 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.568619    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:32:06.568891 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.568649    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls podName:9a1ca7e5-1b66-43e8-b816-aeffc758f649 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:07.568633815 +0000 UTC m=+37.138998926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls") pod "image-registry-764fbcc997-s2gws" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649") : secret "image-registry-tls" not found
May 21 15:32:06.568891 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:06.568667    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert podName:43637790-37ab-4877-bf45-1c61fa8909e5 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:07.568658154 +0000 UTC m=+37.139023245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert") pod "ingress-canary-pxm7h" (UID: "43637790-37ab-4877-bf45-1c61fa8909e5") : secret "canary-serving-cert" not found
May 21 15:32:07.020756 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.020718    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:32:07.020930 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.020718    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:32:07.025107 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.024283    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 15:32:07.025107 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.024671    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 15:32:07.025107 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.024686    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 15:32:07.025107 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.025019    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nkbpk\""
May 21 15:32:07.026007 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.025198    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qfdh8\""
May 21 15:32:07.073469 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.072746    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:32:07.076873 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.076819    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1146ae6f-be79-4860-889b-38ed20369c04-original-pull-secret\") pod \"global-pull-secret-syncer-jqksv\" (UID: \"1146ae6f-be79-4860-889b-38ed20369c04\") " pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:32:07.231958 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.231439    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jqksv"
May 21 15:32:07.299974 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.299848    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4" event={"ID":"c0e29668-1c2d-4d63-b5d5-50b338b6824e","Type":"ContainerStarted","Data":"19ef409a44dceb6efc676acc62a166bcc1250bbb050cfc530544646b2be9e5ac"}
May 21 15:32:07.302719 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.302687    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw" event={"ID":"0ffb12d9-7c11-4eb3-a341-7483f5b4da22","Type":"ContainerStarted","Data":"e0786ec02530ba2d01903e2cd8b4a51971933dc17b50624d597365131527aeb7"}
May 21 15:32:07.305037 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.304987    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk" event={"ID":"2d1b4f8c-380c-4a32-a48d-f3aa8d127303","Type":"ContainerStarted","Data":"2d4aaa58bf1ca3f9923fbbd535ba9ce6c85d0120a93b2e7a9e97c428daa64589"}
May 21 15:32:07.410400 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.410374    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jqksv"]
May 21 15:32:07.415871 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:32:07.415834    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1146ae6f_be79_4860_889b_38ed20369c04.slice/crio-00f6f0cdc76285e6de42943f4c7fe6a7e8d6d97102dd88e9a6b1e88c5f8223ea WatchSource:0}: Error finding container 00f6f0cdc76285e6de42943f4c7fe6a7e8d6d97102dd88e9a6b1e88c5f8223ea: Status 404 returned error can't find the container with id 00f6f0cdc76285e6de42943f4c7fe6a7e8d6d97102dd88e9a6b1e88c5f8223ea
May 21 15:32:07.475708 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.475668    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:32:07.475929 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:07.475908    2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 15:32:07.476010 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:07.475991    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert podName:66b1e4a6-a9d4-411c-9eb6-786ddc7ba269 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:09.475969372 +0000 UTC m=+39.046334480 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-t7xs6" (UID: "66b1e4a6-a9d4-411c-9eb6-786ddc7ba269") : secret "networking-console-plugin-cert" not found
May 21 15:32:07.576623 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.576523    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:32:07.576623 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.576610    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:07.576853 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:07.576642    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:07.576853 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:07.576778    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:32:07.576853 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:07.576794    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764fbcc997-s2gws: secret "image-registry-tls" not found
May 21 15:32:07.576853 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:07.576851    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls podName:9a1ca7e5-1b66-43e8-b816-aeffc758f649 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:09.576832366 +0000 UTC m=+39.147197459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls") pod "image-registry-764fbcc997-s2gws" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649") : secret "image-registry-tls" not found
May 21 15:32:07.577312 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:07.577291    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:32:07.577434 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:07.577343    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert podName:43637790-37ab-4877-bf45-1c61fa8909e5 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:09.577327929 +0000 UTC m=+39.147693035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert") pod "ingress-canary-pxm7h" (UID: "43637790-37ab-4877-bf45-1c61fa8909e5") : secret "canary-serving-cert" not found
May 21 15:32:07.577434 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:07.577407    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:32:07.577555 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:07.577439    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls podName:c0d3583c-f875-4e3b-b92b-5c68a8d24226 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:09.577428207 +0000 UTC m=+39.147793305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls") pod "dns-default-4m6jg" (UID: "c0d3583c-f875-4e3b-b92b-5c68a8d24226") : secret "dns-default-metrics-tls" not found
May 21 15:32:08.320567 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:08.320493    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jqksv" event={"ID":"1146ae6f-be79-4860-889b-38ed20369c04","Type":"ContainerStarted","Data":"00f6f0cdc76285e6de42943f4c7fe6a7e8d6d97102dd88e9a6b1e88c5f8223ea"}
May 21 15:32:09.496820 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:09.496209    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:32:09.496820 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:09.496362    2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 15:32:09.496820 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:09.496436    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert podName:66b1e4a6-a9d4-411c-9eb6-786ddc7ba269 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:13.496416059 +0000 UTC m=+43.066781164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-t7xs6" (UID: "66b1e4a6-a9d4-411c-9eb6-786ddc7ba269") : secret "networking-console-plugin-cert" not found
May 21 15:32:09.596799 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:09.596755    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:32:09.596967 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:09.596837    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:09.596967 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:09.596871    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:09.597103 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:09.596980    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:32:09.597103 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:09.596988    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:32:09.597103 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:09.597024    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764fbcc997-s2gws: secret "image-registry-tls" not found
May 21 15:32:09.597103 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:09.597043    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls podName:c0d3583c-f875-4e3b-b92b-5c68a8d24226 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:13.5970246 +0000 UTC m=+43.167389711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls") pod "dns-default-4m6jg" (UID: "c0d3583c-f875-4e3b-b92b-5c68a8d24226") : secret "dns-default-metrics-tls" not found
May 21 15:32:09.597103 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:09.596981    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:32:09.597103 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:09.597097    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert podName:43637790-37ab-4877-bf45-1c61fa8909e5 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:13.59708567 +0000 UTC m=+43.167450786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert") pod "ingress-canary-pxm7h" (UID: "43637790-37ab-4877-bf45-1c61fa8909e5") : secret "canary-serving-cert" not found
May 21 15:32:09.597425 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:09.597158    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls podName:9a1ca7e5-1b66-43e8-b816-aeffc758f649 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:13.597135676 +0000 UTC m=+43.167500777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls") pod "image-registry-764fbcc997-s2gws" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649") : secret "image-registry-tls" not found
May 21 15:32:13.530841 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:13.530799    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:32:13.531305 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:13.530961    2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 15:32:13.531305 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:13.531033    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert podName:66b1e4a6-a9d4-411c-9eb6-786ddc7ba269 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:21.531017995 +0000 UTC m=+51.101383086 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-t7xs6" (UID: "66b1e4a6-a9d4-411c-9eb6-786ddc7ba269") : secret "networking-console-plugin-cert" not found
May 21 15:32:13.631663 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:13.631627    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:32:13.631841 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:13.631683    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:13.631841 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:13.631709    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:13.631841 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:13.631794    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:32:13.631841 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:13.631814    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:32:13.631841 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:13.631829    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764fbcc997-s2gws: secret "image-registry-tls" not found
May 21 15:32:13.632079 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:13.631849    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:32:13.632079 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:13.631863    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert podName:43637790-37ab-4877-bf45-1c61fa8909e5 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:21.631841648 +0000 UTC m=+51.202206760 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert") pod "ingress-canary-pxm7h" (UID: "43637790-37ab-4877-bf45-1c61fa8909e5") : secret "canary-serving-cert" not found
May 21 15:32:13.632079 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:13.631885    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls podName:9a1ca7e5-1b66-43e8-b816-aeffc758f649 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:21.631875019 +0000 UTC m=+51.202240110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls") pod "image-registry-764fbcc997-s2gws" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649") : secret "image-registry-tls" not found
May 21 15:32:13.632079 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:13.631902    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls podName:c0d3583c-f875-4e3b-b92b-5c68a8d24226 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:21.63189246 +0000 UTC m=+51.202257552 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls") pod "dns-default-4m6jg" (UID: "c0d3583c-f875-4e3b-b92b-5c68a8d24226") : secret "dns-default-metrics-tls" not found
May 21 15:32:19.343851 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:19.343810    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk" event={"ID":"2d1b4f8c-380c-4a32-a48d-f3aa8d127303","Type":"ContainerStarted","Data":"020d395c7f6eb5f76185a374310d94dab292d3a7979fc724d464ec34706a69c4"}
May 21 15:32:19.346323 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:19.346300    2569 generic.go:358] "Generic (PLEG): container finished" podID="844ed311-7755-4dd5-8f12-7049aaa3f8bf" containerID="bdd71abe16493d202bb89660c3cbd1a9a620149229d0fe71ac0496516c9ffaae" exitCode=0
May 21 15:32:19.346448 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:19.346367    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89lm9" event={"ID":"844ed311-7755-4dd5-8f12-7049aaa3f8bf","Type":"ContainerDied","Data":"bdd71abe16493d202bb89660c3cbd1a9a620149229d0fe71ac0496516c9ffaae"}
May 21 15:32:19.347675 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:19.347656    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4" event={"ID":"c0e29668-1c2d-4d63-b5d5-50b338b6824e","Type":"ContainerStarted","Data":"af5d7618de5924a4f3995a4575793153e3325933eb41a70fb129e5ccf235ecb3"}
May 21 15:32:19.347884 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:19.347867    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:32:19.349059 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:19.349036    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw" event={"ID":"0ffb12d9-7c11-4eb3-a341-7483f5b4da22","Type":"ContainerStarted","Data":"16eb2c7405a3f4cff2487db6b329e81b10ad8e767a55087b556e70a5c0471e39"}
May 21 15:32:19.349816 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:19.349795    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:32:19.350356 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:19.350316    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jqksv" event={"ID":"1146ae6f-be79-4860-889b-38ed20369c04","Type":"ContainerStarted","Data":"9311bad20d04e4969f5a7babffff18520fa2ee2f98b0f647b7e62966526f8166"}
May 21 15:32:19.381595 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:19.381559    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk" podStartSLOduration=13.055514679 podStartE2EDuration="25.381548118s" podCreationTimestamp="2026-05-21 15:31:54 +0000 UTC" firstStartedPulling="2026-05-21 15:32:06.33582217 +0000 UTC m=+35.906187281" lastFinishedPulling="2026-05-21 15:32:18.661855628 +0000 UTC m=+48.232220720" observedRunningTime="2026-05-21 15:32:19.365006765 +0000 UTC m=+48.935371878" watchObservedRunningTime="2026-05-21 15:32:19.381548118 +0000 UTC m=+48.951913231"
May 21 15:32:19.381795 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:19.381774    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4" podStartSLOduration=13.037852108 podStartE2EDuration="25.381768873s" podCreationTimestamp="2026-05-21 15:31:54 +0000 UTC" firstStartedPulling="2026-05-21 15:32:06.335193313 +0000 UTC m=+35.905558407" lastFinishedPulling="2026-05-21 15:32:18.679110072 +0000 UTC m=+48.249475172" observedRunningTime="2026-05-21 15:32:19.380928451 +0000 UTC m=+48.951293566" watchObservedRunningTime="2026-05-21 15:32:19.381768873 +0000 UTC m=+48.952133986"
May 21 15:32:19.422719 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:19.422668    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jqksv" podStartSLOduration=17.177801986 podStartE2EDuration="28.422651097s" podCreationTimestamp="2026-05-21 15:31:51 +0000 UTC" firstStartedPulling="2026-05-21 15:32:07.417947045 +0000 UTC m=+36.988312153" lastFinishedPulling="2026-05-21 15:32:18.662796173 +0000 UTC m=+48.233161264" observedRunningTime="2026-05-21 15:32:19.421508634 +0000 UTC m=+48.991873748" watchObservedRunningTime="2026-05-21 15:32:19.422651097 +0000 UTC m=+48.993016214"
May 21 15:32:20.355510 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:20.355474    2569 generic.go:358] "Generic (PLEG): container finished" podID="844ed311-7755-4dd5-8f12-7049aaa3f8bf" containerID="cc173847681d9905411345e9f67d7b2c037fc2277f26629dae4300d3769b871f" exitCode=0
May 21 15:32:20.356026 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:20.355576    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89lm9" event={"ID":"844ed311-7755-4dd5-8f12-7049aaa3f8bf","Type":"ContainerDied","Data":"cc173847681d9905411345e9f67d7b2c037fc2277f26629dae4300d3769b871f"}
May 21 15:32:21.360191 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:21.360155    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-89lm9" event={"ID":"844ed311-7755-4dd5-8f12-7049aaa3f8bf","Type":"ContainerStarted","Data":"bab89af791e703303caf710dc59762c4875970fbf9cceef9bba93208e0db2245"}
May 21 15:32:21.387823 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:21.387772    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-89lm9" podStartSLOduration=3.935649503 podStartE2EDuration="50.387753788s" podCreationTimestamp="2026-05-21 15:31:31 +0000 UTC" firstStartedPulling="2026-05-21 15:31:32.210983291 +0000 UTC m=+1.781348382" lastFinishedPulling="2026-05-21 15:32:18.663087559 +0000 UTC m=+48.233452667" observedRunningTime="2026-05-21 15:32:21.386246925 +0000 UTC m=+50.956612038" watchObservedRunningTime="2026-05-21 15:32:21.387753788 +0000 UTC m=+50.958118905"
May 21 15:32:21.604344 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:21.604315    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:32:21.604437 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:21.604426    2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 15:32:21.604484 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:21.604477    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert podName:66b1e4a6-a9d4-411c-9eb6-786ddc7ba269 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:37.604463423 +0000 UTC m=+67.174828520 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-t7xs6" (UID: "66b1e4a6-a9d4-411c-9eb6-786ddc7ba269") : secret "networking-console-plugin-cert" not found
May 21 15:32:21.705069 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:21.705036    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:32:21.705233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:21.705082    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:21.705233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:21.705104    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:21.705233 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:21.705214    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:32:21.705233 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:21.705226    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:32:21.705363 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:21.705245    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764fbcc997-s2gws: secret "image-registry-tls" not found
May 21 15:32:21.705363 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:21.705215    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:32:21.705363 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:21.705275    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls podName:c0d3583c-f875-4e3b-b92b-5c68a8d24226 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:37.705257943 +0000 UTC m=+67.275623035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls") pod "dns-default-4m6jg" (UID: "c0d3583c-f875-4e3b-b92b-5c68a8d24226") : secret "dns-default-metrics-tls" not found
May 21 15:32:21.705363 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:21.705290    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls podName:9a1ca7e5-1b66-43e8-b816-aeffc758f649 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:37.705284325 +0000 UTC m=+67.275649415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls") pod "image-registry-764fbcc997-s2gws" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649") : secret "image-registry-tls" not found
May 21 15:32:21.705363 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:21.705311    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert podName:43637790-37ab-4877-bf45-1c61fa8909e5 nodeName:}" failed. No retries permitted until 2026-05-21 15:32:37.705304441 +0000 UTC m=+67.275669532 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert") pod "ingress-canary-pxm7h" (UID: "43637790-37ab-4877-bf45-1c61fa8909e5") : secret "canary-serving-cert" not found
May 21 15:32:22.365239 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:22.365198    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw" event={"ID":"0ffb12d9-7c11-4eb3-a341-7483f5b4da22","Type":"ContainerStarted","Data":"a97dc635f003aef7bf07acbd120f44324b3b14ce9c5b1e979d53e2749fbc8657"}
May 21 15:32:22.365239 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:22.365239    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw" event={"ID":"0ffb12d9-7c11-4eb3-a341-7483f5b4da22","Type":"ContainerStarted","Data":"8191c8804c38204e92e4a2f5df5233f0b83cfa5fab116d061387e8474af9ecca"}
May 21 15:32:22.383761 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:22.383714    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw" podStartSLOduration=13.282721586 podStartE2EDuration="28.383701603s" podCreationTimestamp="2026-05-21 15:31:54 +0000 UTC" firstStartedPulling="2026-05-21 15:32:06.33748082 +0000 UTC m=+35.907845910" lastFinishedPulling="2026-05-21 15:32:21.438460832 +0000 UTC m=+51.008825927" observedRunningTime="2026-05-21 15:32:22.382633242 +0000 UTC m=+51.952998357" watchObservedRunningTime="2026-05-21 15:32:22.383701603 +0000 UTC m=+51.954066716"
May 21 15:32:29.286291 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:29.286256    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5nwgj"
May 21 15:32:35.723666 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:35.723626    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:32:35.726065 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:35.726045    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 15:32:35.734017 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:35.733997    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 15:32:35.734080 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:35.734055    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs podName:5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7 nodeName:}" failed. No retries permitted until 2026-05-21 15:33:39.734037385 +0000 UTC m=+129.304402480 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs") pod "network-metrics-daemon-g7zsx" (UID: "5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7") : secret "metrics-daemon-secret" not found
May 21 15:32:35.824296 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:35.824261    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kzkpg\" (UniqueName: \"kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg\") pod \"network-check-target-r4m92\" (UID: \"d6b5ee0b-6719-4632-8db4-cfd2163ce895\") " pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:32:35.826610 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:35.826592    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 15:32:35.838064 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:35.838045    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 15:32:35.849199 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:35.849173    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzkpg\" (UniqueName: \"kubernetes.io/projected/d6b5ee0b-6719-4632-8db4-cfd2163ce895-kube-api-access-kzkpg\") pod \"network-check-target-r4m92\" (UID: \"d6b5ee0b-6719-4632-8db4-cfd2163ce895\") " pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:32:36.148915 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:36.148885    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nkbpk\""
May 21 15:32:36.156964 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:36.156944    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:32:36.272609 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:36.272579    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r4m92"]
May 21 15:32:36.275718 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:32:36.275693    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b5ee0b_6719_4632_8db4_cfd2163ce895.slice/crio-d2f602ff56276983542a19efe4a194b3ea73597d008b9365bd3ab2384fc27b2e WatchSource:0}: Error finding container d2f602ff56276983542a19efe4a194b3ea73597d008b9365bd3ab2384fc27b2e: Status 404 returned error can't find the container with id d2f602ff56276983542a19efe4a194b3ea73597d008b9365bd3ab2384fc27b2e
May 21 15:32:36.401154 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:36.401057    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r4m92" event={"ID":"d6b5ee0b-6719-4632-8db4-cfd2163ce895","Type":"ContainerStarted","Data":"d2f602ff56276983542a19efe4a194b3ea73597d008b9365bd3ab2384fc27b2e"}
May 21 15:32:37.637873 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:37.637833    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:32:37.638354 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:37.637988    2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 15:32:37.638354 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:37.638105    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert podName:66b1e4a6-a9d4-411c-9eb6-786ddc7ba269 nodeName:}" failed. No retries permitted until 2026-05-21 15:33:09.638083645 +0000 UTC m=+99.208448742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-t7xs6" (UID: "66b1e4a6-a9d4-411c-9eb6-786ddc7ba269") : secret "networking-console-plugin-cert" not found
May 21 15:32:37.738344 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:37.738307    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:32:37.738516 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:37.738364    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:32:37.738516 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:37.738388    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:32:37.738516 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:37.738454    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:32:37.738516 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:37.738499    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:32:37.738683 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:37.738523    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert podName:43637790-37ab-4877-bf45-1c61fa8909e5 nodeName:}" failed. No retries permitted until 2026-05-21 15:33:09.738503337 +0000 UTC m=+99.308868439 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert") pod "ingress-canary-pxm7h" (UID: "43637790-37ab-4877-bf45-1c61fa8909e5") : secret "canary-serving-cert" not found
May 21 15:32:37.738683 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:37.738547    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls podName:c0d3583c-f875-4e3b-b92b-5c68a8d24226 nodeName:}" failed. No retries permitted until 2026-05-21 15:33:09.738532272 +0000 UTC m=+99.308897363 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls") pod "dns-default-4m6jg" (UID: "c0d3583c-f875-4e3b-b92b-5c68a8d24226") : secret "dns-default-metrics-tls" not found
May 21 15:32:37.738683 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:37.738500    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:32:37.738683 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:37.738560    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764fbcc997-s2gws: secret "image-registry-tls" not found
May 21 15:32:37.738683 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:32:37.738580    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls podName:9a1ca7e5-1b66-43e8-b816-aeffc758f649 nodeName:}" failed. No retries permitted until 2026-05-21 15:33:09.738574351 +0000 UTC m=+99.308939442 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls") pod "image-registry-764fbcc997-s2gws" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649") : secret "image-registry-tls" not found
May 21 15:32:40.413444 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:40.413413    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r4m92" event={"ID":"d6b5ee0b-6719-4632-8db4-cfd2163ce895","Type":"ContainerStarted","Data":"84adb0b55cf7c5f7f28d02f91b523a352c33b5b2ad8fe569e20cadcbdb3ff94f"}
May 21 15:32:41.416102 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:41.416068    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:32:41.431214 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:32:41.431172    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r4m92" podStartSLOduration=66.430847916 podStartE2EDuration="1m10.431158545s" podCreationTimestamp="2026-05-21 15:31:31 +0000 UTC" firstStartedPulling="2026-05-21 15:32:36.27762368 +0000 UTC m=+65.847988785" lastFinishedPulling="2026-05-21 15:32:40.277934308 +0000 UTC m=+69.848299414" observedRunningTime="2026-05-21 15:32:41.4310047 +0000 UTC m=+71.001369814" watchObservedRunningTime="2026-05-21 15:32:41.431158545 +0000 UTC m=+71.001523657"
May 21 15:33:09.685989 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:33:09.685928    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:33:09.686493 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:33:09.686079    2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 15:33:09.686493 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:33:09.686176    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert podName:66b1e4a6-a9d4-411c-9eb6-786ddc7ba269 nodeName:}" failed. No retries permitted until 2026-05-21 15:34:13.686157407 +0000 UTC m=+163.256522499 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-t7xs6" (UID: "66b1e4a6-a9d4-411c-9eb6-786ddc7ba269") : secret "networking-console-plugin-cert" not found
May 21 15:33:09.786305 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:33:09.786266    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:33:09.786432 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:33:09.786313    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:33:09.786432 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:33:09.786333    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:33:09.786432 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:33:09.786412    2569 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 21 15:33:09.786432 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:33:09.786422    2569 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-764fbcc997-s2gws: secret "image-registry-tls" not found
May 21 15:33:09.786432 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:33:09.786420    2569 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 15:33:09.786599 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:33:09.786463    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls podName:9a1ca7e5-1b66-43e8-b816-aeffc758f649 nodeName:}" failed. No retries permitted until 2026-05-21 15:34:13.786450224 +0000 UTC m=+163.356815316 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls") pod "image-registry-764fbcc997-s2gws" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649") : secret "image-registry-tls" not found
May 21 15:33:09.786599 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:33:09.786481    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert podName:43637790-37ab-4877-bf45-1c61fa8909e5 nodeName:}" failed. No retries permitted until 2026-05-21 15:34:13.786468859 +0000 UTC m=+163.356833950 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert") pod "ingress-canary-pxm7h" (UID: "43637790-37ab-4877-bf45-1c61fa8909e5") : secret "canary-serving-cert" not found
May 21 15:33:09.786599 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:33:09.786532    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 15:33:09.786599 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:33:09.786592    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls podName:c0d3583c-f875-4e3b-b92b-5c68a8d24226 nodeName:}" failed. No retries permitted until 2026-05-21 15:34:13.786579002 +0000 UTC m=+163.356944094 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls") pod "dns-default-4m6jg" (UID: "c0d3583c-f875-4e3b-b92b-5c68a8d24226") : secret "dns-default-metrics-tls" not found
May 21 15:33:12.420812 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:33:12.420783    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r4m92"
May 21 15:33:39.816299 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:33:39.816242    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:33:39.816709 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:33:39.816387    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 15:33:39.816709 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:33:39.816475    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs podName:5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7 nodeName:}" failed. No retries permitted until 2026-05-21 15:35:41.816458718 +0000 UTC m=+251.386823809 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs") pod "network-metrics-daemon-g7zsx" (UID: "5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7") : secret "metrics-daemon-secret" not found
May 21 15:34:00.575011 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:00.574985    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2kc9w_aa952ca3-14e6-4a2b-8b6d-200407069d9a/dns-node-resolver/0.log"
May 21 15:34:01.773724 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:01.773689    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7rj7l_9a98a1f8-3069-4b7d-9709-95b0b4a4652d/node-ca/0.log"
May 21 15:34:08.788876 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:34:08.788761    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6" podUID="66b1e4a6-a9d4-411c-9eb6-786ddc7ba269"
May 21 15:34:08.796955 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:34:08.796919    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-764fbcc997-s2gws" podUID="9a1ca7e5-1b66-43e8-b816-aeffc758f649"
May 21 15:34:08.847419 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:34:08.847380    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4m6jg" podUID="c0d3583c-f875-4e3b-b92b-5c68a8d24226"
May 21 15:34:08.852600 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:34:08.852574    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-pxm7h" podUID="43637790-37ab-4877-bf45-1c61fa8909e5"
May 21 15:34:09.613447 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:09.613410    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4m6jg"
May 21 15:34:09.613612 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:09.613410    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:34:09.613612 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:09.613410    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:34:09.613706 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:09.613410    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:34:10.038047 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:34:10.038003    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-g7zsx" podUID="5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7"
May 21 15:34:13.697394 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.697355    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:34:13.697766 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:34:13.697474    2569 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 21 15:34:13.697766 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:34:13.697529    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert podName:66b1e4a6-a9d4-411c-9eb6-786ddc7ba269 nodeName:}" failed. No retries permitted until 2026-05-21 15:36:15.697515573 +0000 UTC m=+285.267880664 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-t7xs6" (UID: "66b1e4a6-a9d4-411c-9eb6-786ddc7ba269") : secret "networking-console-plugin-cert" not found
May 21 15:34:13.798418 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.798386    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:34:13.798418 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.798422    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:34:13.798605 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.798484    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:34:13.800858 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.800827    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0d3583c-f875-4e3b-b92b-5c68a8d24226-metrics-tls\") pod \"dns-default-4m6jg\" (UID: \"c0d3583c-f875-4e3b-b92b-5c68a8d24226\") " pod="openshift-dns/dns-default-4m6jg"
May 21 15:34:13.800858 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.800847    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls\") pod \"image-registry-764fbcc997-s2gws\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") " pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:34:13.801047 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.800833    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43637790-37ab-4877-bf45-1c61fa8909e5-cert\") pod \"ingress-canary-pxm7h\" (UID: \"43637790-37ab-4877-bf45-1c61fa8909e5\") " pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:34:13.816580 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.816558    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5bcp9\""
May 21 15:34:13.817591 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.817574    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dpq6k\""
May 21 15:34:13.817689 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.817575    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2wggx\""
May 21 15:34:13.824591 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.824571    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pxm7h"
May 21 15:34:13.824678 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.824656    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4m6jg"
May 21 15:34:13.824765 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.824749    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:34:13.961599 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.961507    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4m6jg"]
May 21 15:34:13.966378 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:34:13.966284    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d3583c_f875_4e3b_b92b_5c68a8d24226.slice/crio-4d0d16dae7acac097da9ee0f4e5bda7f5ed77f3b003c644704a15be99d089350 WatchSource:0}: Error finding container 4d0d16dae7acac097da9ee0f4e5bda7f5ed77f3b003c644704a15be99d089350: Status 404 returned error can't find the container with id 4d0d16dae7acac097da9ee0f4e5bda7f5ed77f3b003c644704a15be99d089350
May 21 15:34:13.975859 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:13.975835    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pxm7h"]
May 21 15:34:13.978871 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:34:13.978849    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43637790_37ab_4877_bf45_1c61fa8909e5.slice/crio-8ded5cb9cfa97c3f0f3d89b258384111bd75da91ac983c55d81467c281bd8ce9 WatchSource:0}: Error finding container 8ded5cb9cfa97c3f0f3d89b258384111bd75da91ac983c55d81467c281bd8ce9: Status 404 returned error can't find the container with id 8ded5cb9cfa97c3f0f3d89b258384111bd75da91ac983c55d81467c281bd8ce9
May 21 15:34:14.006584 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:14.006560    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-764fbcc997-s2gws"]
May 21 15:34:14.009173 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:34:14.009150    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1ca7e5_1b66_43e8_b816_aeffc758f649.slice/crio-e02d12ee4c2acc5104f224d2d89fed3e032005723013001c83119a45104f6d0f WatchSource:0}: Error finding container e02d12ee4c2acc5104f224d2d89fed3e032005723013001c83119a45104f6d0f: Status 404 returned error can't find the container with id e02d12ee4c2acc5104f224d2d89fed3e032005723013001c83119a45104f6d0f
May 21 15:34:14.627282 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:14.627235    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4m6jg" event={"ID":"c0d3583c-f875-4e3b-b92b-5c68a8d24226","Type":"ContainerStarted","Data":"4d0d16dae7acac097da9ee0f4e5bda7f5ed77f3b003c644704a15be99d089350"}
May 21 15:34:14.628887 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:14.628830    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764fbcc997-s2gws" event={"ID":"9a1ca7e5-1b66-43e8-b816-aeffc758f649","Type":"ContainerStarted","Data":"4d415b2b8a743abd88659f44f0f688a34aa0ea39ef1393272e1bced04a70be8b"}
May 21 15:34:14.628887 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:14.628867    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764fbcc997-s2gws" event={"ID":"9a1ca7e5-1b66-43e8-b816-aeffc758f649","Type":"ContainerStarted","Data":"e02d12ee4c2acc5104f224d2d89fed3e032005723013001c83119a45104f6d0f"}
May 21 15:34:14.629068 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:14.628970    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:34:14.630426 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:14.630393    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pxm7h" event={"ID":"43637790-37ab-4877-bf45-1c61fa8909e5","Type":"ContainerStarted","Data":"8ded5cb9cfa97c3f0f3d89b258384111bd75da91ac983c55d81467c281bd8ce9"}
May 21 15:34:14.650091 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:14.648934    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-764fbcc997-s2gws" podStartSLOduration=163.648919257 podStartE2EDuration="2m43.648919257s" podCreationTimestamp="2026-05-21 15:31:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:34:14.648043334 +0000 UTC m=+164.218408448" watchObservedRunningTime="2026-05-21 15:34:14.648919257 +0000 UTC m=+164.219284371"
May 21 15:34:16.636956 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:16.636918    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4m6jg" event={"ID":"c0d3583c-f875-4e3b-b92b-5c68a8d24226","Type":"ContainerStarted","Data":"94f9639cf756e020a12ef3eea66a67fa3c11f320e0198c1129435b5fe270dbbf"}
May 21 15:34:16.636956 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:16.636959    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4m6jg" event={"ID":"c0d3583c-f875-4e3b-b92b-5c68a8d24226","Type":"ContainerStarted","Data":"f744001fe5ce67be83f88bd1a44e8c0603f9ae0d971e714acc6a3191742626ae"}
May 21 15:34:16.637423 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:16.637041    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4m6jg"
May 21 15:34:16.638203 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:16.638184    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pxm7h" event={"ID":"43637790-37ab-4877-bf45-1c61fa8909e5","Type":"ContainerStarted","Data":"9af77ad624e80d1259ebfba7792de822234eeedbcf644db6aa34e94e53a6ba02"}
May 21 15:34:16.653648 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:16.653600    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4m6jg" podStartSLOduration=130.008784694 podStartE2EDuration="2m11.653588303s" podCreationTimestamp="2026-05-21 15:32:05 +0000 UTC" firstStartedPulling="2026-05-21 15:34:13.968379342 +0000 UTC m=+163.538744434" lastFinishedPulling="2026-05-21 15:34:15.613182949 +0000 UTC m=+165.183548043" observedRunningTime="2026-05-21 15:34:16.65246942 +0000 UTC m=+166.222834534" watchObservedRunningTime="2026-05-21 15:34:16.653588303 +0000 UTC m=+166.223953416"
May 21 15:34:16.666739 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:16.666681    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pxm7h" podStartSLOduration=129.399594193 podStartE2EDuration="2m11.666666872s" podCreationTimestamp="2026-05-21 15:32:05 +0000 UTC" firstStartedPulling="2026-05-21 15:34:13.980794848 +0000 UTC m=+163.551159943" lastFinishedPulling="2026-05-21 15:34:16.247867517 +0000 UTC m=+165.818232622" observedRunningTime="2026-05-21 15:34:16.666496159 +0000 UTC m=+166.236861273" watchObservedRunningTime="2026-05-21 15:34:16.666666872 +0000 UTC m=+166.237031986"
May 21 15:34:19.348984 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:19.348928    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4" podUID="c0e29668-1c2d-4d63-b5d5-50b338b6824e" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
May 21 15:34:19.650250 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:19.650216    2569 generic.go:358] "Generic (PLEG): container finished" podID="c0e29668-1c2d-4d63-b5d5-50b338b6824e" containerID="af5d7618de5924a4f3995a4575793153e3325933eb41a70fb129e5ccf235ecb3" exitCode=1
May 21 15:34:19.650423 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:19.650290    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4" event={"ID":"c0e29668-1c2d-4d63-b5d5-50b338b6824e","Type":"ContainerDied","Data":"af5d7618de5924a4f3995a4575793153e3325933eb41a70fb129e5ccf235ecb3"}
May 21 15:34:19.650657 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:19.650639    2569 scope.go:117] "RemoveContainer" containerID="af5d7618de5924a4f3995a4575793153e3325933eb41a70fb129e5ccf235ecb3"
May 21 15:34:19.651412 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:19.651394    2569 generic.go:358] "Generic (PLEG): container finished" podID="2d1b4f8c-380c-4a32-a48d-f3aa8d127303" containerID="020d395c7f6eb5f76185a374310d94dab292d3a7979fc724d464ec34706a69c4" exitCode=255
May 21 15:34:19.651463 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:19.651426    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk" event={"ID":"2d1b4f8c-380c-4a32-a48d-f3aa8d127303","Type":"ContainerDied","Data":"020d395c7f6eb5f76185a374310d94dab292d3a7979fc724d464ec34706a69c4"}
May 21 15:34:19.651723 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:19.651707    2569 scope.go:117] "RemoveContainer" containerID="020d395c7f6eb5f76185a374310d94dab292d3a7979fc724d464ec34706a69c4"
May 21 15:34:20.655639 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:20.655542    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-79f58b77f6-hzwbk" event={"ID":"2d1b4f8c-380c-4a32-a48d-f3aa8d127303","Type":"ContainerStarted","Data":"9bd617b9c6960987b580228abf3dba26016690d26ff6005c4c3befd42e8173d1"}
May 21 15:34:20.656933 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:20.656915    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4" event={"ID":"c0e29668-1c2d-4d63-b5d5-50b338b6824e","Type":"ContainerStarted","Data":"ab0feb5e746a7c64da361eb11c731c3314bfce588dfc306c05ab97fbfb3f34a6"}
May 21 15:34:20.657164 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:20.657144    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:34:20.657720 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:20.657697    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-fb9499d8c-d7fl4"
May 21 15:34:21.021950 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:21.021872    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:34:22.703303 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.703257    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2xmq2"]
May 21 15:34:22.705300 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.705284    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.707707 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.707680    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jgjmm\""
May 21 15:34:22.708529 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.708495    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 15:34:22.708636 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.708553    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 15:34:22.708636 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.708568    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 15:34:22.708636 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.708573    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 15:34:22.716439 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.716413    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2xmq2"]
May 21 15:34:22.771558 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.771531    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efcee921-20bb-4c9f-a677-8220cf42d49c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.771730 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.771629    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efcee921-20bb-4c9f-a677-8220cf42d49c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.771730 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.771659    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/efcee921-20bb-4c9f-a677-8220cf42d49c-data-volume\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.771838 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.771755    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/efcee921-20bb-4c9f-a677-8220cf42d49c-crio-socket\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.771838 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.771816    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df44h\" (UniqueName: \"kubernetes.io/projected/efcee921-20bb-4c9f-a677-8220cf42d49c-kube-api-access-df44h\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.872780 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.872745    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/efcee921-20bb-4c9f-a677-8220cf42d49c-data-volume\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.872952 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.872810    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/efcee921-20bb-4c9f-a677-8220cf42d49c-crio-socket\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.872952 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.872840    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-df44h\" (UniqueName: \"kubernetes.io/projected/efcee921-20bb-4c9f-a677-8220cf42d49c-kube-api-access-df44h\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.872952 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.872879    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efcee921-20bb-4c9f-a677-8220cf42d49c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.872952 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.872937    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/efcee921-20bb-4c9f-a677-8220cf42d49c-crio-socket\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.873215 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.873027    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efcee921-20bb-4c9f-a677-8220cf42d49c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.873215 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.873148    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/efcee921-20bb-4c9f-a677-8220cf42d49c-data-volume\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.873451 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.873425    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/efcee921-20bb-4c9f-a677-8220cf42d49c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.875167 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.875146    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/efcee921-20bb-4c9f-a677-8220cf42d49c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:22.889954 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:22.889931    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-df44h\" (UniqueName: \"kubernetes.io/projected/efcee921-20bb-4c9f-a677-8220cf42d49c-kube-api-access-df44h\") pod \"insights-runtime-extractor-2xmq2\" (UID: \"efcee921-20bb-4c9f-a677-8220cf42d49c\") " pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:23.013629 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:23.013556    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2xmq2"
May 21 15:34:23.132203 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:23.132113    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2xmq2"]
May 21 15:34:23.135663 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:34:23.135634    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefcee921_20bb_4c9f_a677_8220cf42d49c.slice/crio-63b075fb657502823a6b227bc362b86fb18af4f42a7999c230f1b3d13242a357 WatchSource:0}: Error finding container 63b075fb657502823a6b227bc362b86fb18af4f42a7999c230f1b3d13242a357: Status 404 returned error can't find the container with id 63b075fb657502823a6b227bc362b86fb18af4f42a7999c230f1b3d13242a357
May 21 15:34:23.665857 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:23.665821    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2xmq2" event={"ID":"efcee921-20bb-4c9f-a677-8220cf42d49c","Type":"ContainerStarted","Data":"7126b42d418549f72ee2d9bcaf1adf281c5c83733b0aeb0eda09569a2831421b"}
May 21 15:34:23.665857 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:23.665859    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2xmq2" event={"ID":"efcee921-20bb-4c9f-a677-8220cf42d49c","Type":"ContainerStarted","Data":"63b075fb657502823a6b227bc362b86fb18af4f42a7999c230f1b3d13242a357"}
May 21 15:34:24.670685 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:24.670650    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2xmq2" event={"ID":"efcee921-20bb-4c9f-a677-8220cf42d49c","Type":"ContainerStarted","Data":"9dc38f00896759c9b70dfa9dd9bf3cc2c7cfccbf11e093b3e50c3e17551b921b"}
May 21 15:34:26.643618 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:26.643588    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4m6jg"
May 21 15:34:26.682452 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:26.682412    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2xmq2" event={"ID":"efcee921-20bb-4c9f-a677-8220cf42d49c","Type":"ContainerStarted","Data":"21dc3a671217a21d7af800fc9b5063a23fd7a6dc223a5ba2a14947723d61c6bb"}
May 21 15:34:26.698547 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:26.698499    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2xmq2" podStartSLOduration=2.096558109 podStartE2EDuration="4.698484738s" podCreationTimestamp="2026-05-21 15:34:22 +0000 UTC" firstStartedPulling="2026-05-21 15:34:23.192569606 +0000 UTC m=+172.762934697" lastFinishedPulling="2026-05-21 15:34:25.794496229 +0000 UTC m=+175.364861326" observedRunningTime="2026-05-21 15:34:26.697575306 +0000 UTC m=+176.267940420" watchObservedRunningTime="2026-05-21 15:34:26.698484738 +0000 UTC m=+176.268849851"
May 21 15:34:33.829285 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:33.829246    2569 patch_prober.go:28] interesting pod/image-registry-764fbcc997-s2gws container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 21 15:34:33.829842 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:33.829303    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-764fbcc997-s2gws" podUID="9a1ca7e5-1b66-43e8-b816-aeffc758f649" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 15:34:35.637854 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:35.637822    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:34:37.316755 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.316723    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cg4hz"]
May 21 15:34:37.319749 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.319732    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.321652 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.321627    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 15:34:37.322190 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.322170    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 15:34:37.322334 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.322308    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kt8nz\""
May 21 15:34:37.322649 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.322633    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 15:34:37.322712 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.322690    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 15:34:37.322774 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.322717    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 15:34:37.323056 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.323040    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 15:34:37.395139 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.395093    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-accelerators-collector-config\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.395257 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.395161    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-wtmp\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.395257 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.395183    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-tls\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.395257 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.395220    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-textfile\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.395257 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.395255    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p69v2\" (UniqueName: \"kubernetes.io/projected/987c4315-162b-49a3-a91f-d550a74aedbe-kube-api-access-p69v2\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.395409 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.395285    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/987c4315-162b-49a3-a91f-d550a74aedbe-root\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.395409 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.395321    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/987c4315-162b-49a3-a91f-d550a74aedbe-sys\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.395409 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.395349    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/987c4315-162b-49a3-a91f-d550a74aedbe-metrics-client-ca\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.395409 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.395369    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.495744 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.495719    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-textfile\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.495851 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.495747    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p69v2\" (UniqueName: \"kubernetes.io/projected/987c4315-162b-49a3-a91f-d550a74aedbe-kube-api-access-p69v2\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.495851 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.495768    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/987c4315-162b-49a3-a91f-d550a74aedbe-root\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.495851 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.495792    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/987c4315-162b-49a3-a91f-d550a74aedbe-sys\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.495851 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.495814    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/987c4315-162b-49a3-a91f-d550a74aedbe-metrics-client-ca\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.495851 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.495839    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.496043 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.495852    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/987c4315-162b-49a3-a91f-d550a74aedbe-root\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.496043 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.495865    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/987c4315-162b-49a3-a91f-d550a74aedbe-sys\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.496043 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.495900    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-accelerators-collector-config\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.496043 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.495935    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-wtmp\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.496043 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.495954    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-tls\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.496303 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.496086    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-textfile\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.496303 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.496101    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-wtmp\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.496455 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.496437    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/987c4315-162b-49a3-a91f-d550a74aedbe-metrics-client-ca\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.496609 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.496587    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-accelerators-collector-config\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.498302 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.498279    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-tls\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.498382 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.498307    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/987c4315-162b-49a3-a91f-d550a74aedbe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.502453 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.502431    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p69v2\" (UniqueName: \"kubernetes.io/projected/987c4315-162b-49a3-a91f-d550a74aedbe-kube-api-access-p69v2\") pod \"node-exporter-cg4hz\" (UID: \"987c4315-162b-49a3-a91f-d550a74aedbe\") " pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.629183 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.629153    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cg4hz"
May 21 15:34:37.640222 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:34:37.640177    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987c4315_162b_49a3_a91f_d550a74aedbe.slice/crio-baf6983a11e4160a8f99ede2088ccf7ff0373dc2745b378b581d3f1b25987565 WatchSource:0}: Error finding container baf6983a11e4160a8f99ede2088ccf7ff0373dc2745b378b581d3f1b25987565: Status 404 returned error can't find the container with id baf6983a11e4160a8f99ede2088ccf7ff0373dc2745b378b581d3f1b25987565
May 21 15:34:37.710074 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:37.710040    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cg4hz" event={"ID":"987c4315-162b-49a3-a91f-d550a74aedbe","Type":"ContainerStarted","Data":"baf6983a11e4160a8f99ede2088ccf7ff0373dc2745b378b581d3f1b25987565"}
May 21 15:34:38.713645 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:38.713611    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cg4hz" event={"ID":"987c4315-162b-49a3-a91f-d550a74aedbe","Type":"ContainerStarted","Data":"66be77369dd9bc144115e71bdb4d834088874f24334ce329fa87189c0fac5f4c"}
May 21 15:34:39.718235 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:39.718198    2569 generic.go:358] "Generic (PLEG): container finished" podID="987c4315-162b-49a3-a91f-d550a74aedbe" containerID="66be77369dd9bc144115e71bdb4d834088874f24334ce329fa87189c0fac5f4c" exitCode=0
May 21 15:34:39.718579 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:39.718256    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cg4hz" event={"ID":"987c4315-162b-49a3-a91f-d550a74aedbe","Type":"ContainerDied","Data":"66be77369dd9bc144115e71bdb4d834088874f24334ce329fa87189c0fac5f4c"}
May 21 15:34:39.718579 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:39.718285    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cg4hz" event={"ID":"987c4315-162b-49a3-a91f-d550a74aedbe","Type":"ContainerStarted","Data":"1e1cacc725d2cda5625b6b7498df62b7555e0a9cc15e60a6e1e0bd4a03c324c3"}
May 21 15:34:39.718579 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:39.718301    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cg4hz" event={"ID":"987c4315-162b-49a3-a91f-d550a74aedbe","Type":"ContainerStarted","Data":"0e96372899c481f71e5f5bbc4acf157438b800266b951e4cf4d5dc385305e939"}
May 21 15:34:39.740197 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:39.740143    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cg4hz" podStartSLOduration=1.8342143850000001 podStartE2EDuration="2.740111011s" podCreationTimestamp="2026-05-21 15:34:37 +0000 UTC" firstStartedPulling="2026-05-21 15:34:37.642618846 +0000 UTC m=+187.212983942" lastFinishedPulling="2026-05-21 15:34:38.548515473 +0000 UTC m=+188.118880568" observedRunningTime="2026-05-21 15:34:39.738580086 +0000 UTC m=+189.308945202" watchObservedRunningTime="2026-05-21 15:34:39.740111011 +0000 UTC m=+189.310476180"
May 21 15:34:44.447534 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:44.447495    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-764fbcc997-s2gws"]
May 21 15:34:56.142620 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:34:56.142577    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw" podUID="0ffb12d9-7c11-4eb3-a341-7483f5b4da22" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 15:35:06.146734 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:06.146692    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw" podUID="0ffb12d9-7c11-4eb3-a341-7483f5b4da22" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 15:35:09.466471 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.466412    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-764fbcc997-s2gws" podUID="9a1ca7e5-1b66-43e8-b816-aeffc758f649" containerName="registry" containerID="cri-o://4d415b2b8a743abd88659f44f0f688a34aa0ea39ef1393272e1bced04a70be8b" gracePeriod=30
May 21 15:35:09.697626 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.697604    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:35:09.746327 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.746256    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls\") pod \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") "
May 21 15:35:09.746327 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.746294    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a1ca7e5-1b66-43e8-b816-aeffc758f649-trusted-ca\") pod \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") "
May 21 15:35:09.746327 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.746323    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a1ca7e5-1b66-43e8-b816-aeffc758f649-ca-trust-extracted\") pod \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") "
May 21 15:35:09.746562 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.746355    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-certificates\") pod \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") "
May 21 15:35:09.746562 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.746409    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-bound-sa-token\") pod \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") "
May 21 15:35:09.746562 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.746445    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c46tw\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-kube-api-access-c46tw\") pod \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") "
May 21 15:35:09.746562 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.746496    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a1ca7e5-1b66-43e8-b816-aeffc758f649-image-registry-private-configuration\") pod \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") "
May 21 15:35:09.746562 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.746526    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a1ca7e5-1b66-43e8-b816-aeffc758f649-installation-pull-secrets\") pod \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\" (UID: \"9a1ca7e5-1b66-43e8-b816-aeffc758f649\") "
May 21 15:35:09.746800 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.746772    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a1ca7e5-1b66-43e8-b816-aeffc758f649-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9a1ca7e5-1b66-43e8-b816-aeffc758f649" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:35:09.746919 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.746893    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9a1ca7e5-1b66-43e8-b816-aeffc758f649" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 15:35:09.748993 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.748967    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9a1ca7e5-1b66-43e8-b816-aeffc758f649" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:35:09.749115 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.749017    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a1ca7e5-1b66-43e8-b816-aeffc758f649-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9a1ca7e5-1b66-43e8-b816-aeffc758f649" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:35:09.749115 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.749084    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9a1ca7e5-1b66-43e8-b816-aeffc758f649" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:35:09.749290 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.749265    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-kube-api-access-c46tw" (OuterVolumeSpecName: "kube-api-access-c46tw") pod "9a1ca7e5-1b66-43e8-b816-aeffc758f649" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649"). InnerVolumeSpecName "kube-api-access-c46tw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:35:09.749334 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.749287    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a1ca7e5-1b66-43e8-b816-aeffc758f649-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9a1ca7e5-1b66-43e8-b816-aeffc758f649" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 15:35:09.755675 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.755650    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a1ca7e5-1b66-43e8-b816-aeffc758f649-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9a1ca7e5-1b66-43e8-b816-aeffc758f649" (UID: "9a1ca7e5-1b66-43e8-b816-aeffc758f649"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 15:35:09.792238 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.792211    2569 generic.go:358] "Generic (PLEG): container finished" podID="9a1ca7e5-1b66-43e8-b816-aeffc758f649" containerID="4d415b2b8a743abd88659f44f0f688a34aa0ea39ef1393272e1bced04a70be8b" exitCode=0
May 21 15:35:09.792350 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.792259    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764fbcc997-s2gws" event={"ID":"9a1ca7e5-1b66-43e8-b816-aeffc758f649","Type":"ContainerDied","Data":"4d415b2b8a743abd88659f44f0f688a34aa0ea39ef1393272e1bced04a70be8b"}
May 21 15:35:09.792350 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.792273    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764fbcc997-s2gws"
May 21 15:35:09.792350 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.792283    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764fbcc997-s2gws" event={"ID":"9a1ca7e5-1b66-43e8-b816-aeffc758f649","Type":"ContainerDied","Data":"e02d12ee4c2acc5104f224d2d89fed3e032005723013001c83119a45104f6d0f"}
May 21 15:35:09.792350 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.792300    2569 scope.go:117] "RemoveContainer" containerID="4d415b2b8a743abd88659f44f0f688a34aa0ea39ef1393272e1bced04a70be8b"
May 21 15:35:09.800616 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.800593    2569 scope.go:117] "RemoveContainer" containerID="4d415b2b8a743abd88659f44f0f688a34aa0ea39ef1393272e1bced04a70be8b"
May 21 15:35:09.800852 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:35:09.800834    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d415b2b8a743abd88659f44f0f688a34aa0ea39ef1393272e1bced04a70be8b\": container with ID starting with 4d415b2b8a743abd88659f44f0f688a34aa0ea39ef1393272e1bced04a70be8b not found: ID does not exist" containerID="4d415b2b8a743abd88659f44f0f688a34aa0ea39ef1393272e1bced04a70be8b"
May 21 15:35:09.800898 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.800859    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d415b2b8a743abd88659f44f0f688a34aa0ea39ef1393272e1bced04a70be8b"} err="failed to get container status \"4d415b2b8a743abd88659f44f0f688a34aa0ea39ef1393272e1bced04a70be8b\": rpc error: code = NotFound desc = could not find container \"4d415b2b8a743abd88659f44f0f688a34aa0ea39ef1393272e1bced04a70be8b\": container with ID starting with 4d415b2b8a743abd88659f44f0f688a34aa0ea39ef1393272e1bced04a70be8b not found: ID does not exist"
May 21 15:35:09.812261 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.812236    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-764fbcc997-s2gws"]
May 21 15:35:09.815748 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.815728    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-764fbcc997-s2gws"]
May 21 15:35:09.848089 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.848062    2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-bound-sa-token\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:35:09.848089 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.848083    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c46tw\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-kube-api-access-c46tw\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:35:09.848233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.848093    2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a1ca7e5-1b66-43e8-b816-aeffc758f649-image-registry-private-configuration\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:35:09.848233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.848102    2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a1ca7e5-1b66-43e8-b816-aeffc758f649-installation-pull-secrets\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:35:09.848233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.848111    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-tls\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:35:09.848233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.848145    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a1ca7e5-1b66-43e8-b816-aeffc758f649-trusted-ca\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:35:09.848233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.848154    2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a1ca7e5-1b66-43e8-b816-aeffc758f649-ca-trust-extracted\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:35:09.848233 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:09.848162    2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a1ca7e5-1b66-43e8-b816-aeffc758f649-registry-certificates\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:35:11.024397 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:11.024354    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a1ca7e5-1b66-43e8-b816-aeffc758f649" path="/var/lib/kubelet/pods/9a1ca7e5-1b66-43e8-b816-aeffc758f649/volumes"
May 21 15:35:16.143361 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:16.143315    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw" podUID="0ffb12d9-7c11-4eb3-a341-7483f5b4da22" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 21 15:35:16.143744 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:16.143395    2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw"
May 21 15:35:16.143870 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:16.143851    2569 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"a97dc635f003aef7bf07acbd120f44324b3b14ce9c5b1e979d53e2749fbc8657"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 21 15:35:16.143911 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:16.143890    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw" podUID="0ffb12d9-7c11-4eb3-a341-7483f5b4da22" containerName="service-proxy" containerID="cri-o://a97dc635f003aef7bf07acbd120f44324b3b14ce9c5b1e979d53e2749fbc8657" gracePeriod=30
May 21 15:35:16.811830 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:16.811791    2569 generic.go:358] "Generic (PLEG): container finished" podID="0ffb12d9-7c11-4eb3-a341-7483f5b4da22" containerID="a97dc635f003aef7bf07acbd120f44324b3b14ce9c5b1e979d53e2749fbc8657" exitCode=2
May 21 15:35:16.812068 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:16.811857    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw" event={"ID":"0ffb12d9-7c11-4eb3-a341-7483f5b4da22","Type":"ContainerDied","Data":"a97dc635f003aef7bf07acbd120f44324b3b14ce9c5b1e979d53e2749fbc8657"}
May 21 15:35:16.812068 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:16.811892    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59fcc96fcb-ckxnw" event={"ID":"0ffb12d9-7c11-4eb3-a341-7483f5b4da22","Type":"ContainerStarted","Data":"a3f1486702f110d60c5983597327bb2633257e76e8517ed2dd4cb1c53f690f9b"}
May 21 15:35:41.904337 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:41.904303    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:35:41.906579 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:41.906557    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7-metrics-certs\") pod \"network-metrics-daemon-g7zsx\" (UID: \"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7\") " pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:35:42.025465 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:42.025418    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qfdh8\""
May 21 15:35:42.033345 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:42.033320    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g7zsx"
May 21 15:35:42.154842 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:42.154764    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g7zsx"]
May 21 15:35:42.157798 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:35:42.157771    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a21a83c_ea1a_4d30_99f6_0ae601b4bfd7.slice/crio-10599637ab74ffbcb8bcf7333e72240f21f09349c274632911b6065970922a93 WatchSource:0}: Error finding container 10599637ab74ffbcb8bcf7333e72240f21f09349c274632911b6065970922a93: Status 404 returned error can't find the container with id 10599637ab74ffbcb8bcf7333e72240f21f09349c274632911b6065970922a93
May 21 15:35:42.880696 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:42.880657    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g7zsx" event={"ID":"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7","Type":"ContainerStarted","Data":"10599637ab74ffbcb8bcf7333e72240f21f09349c274632911b6065970922a93"}
May 21 15:35:43.884926 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:43.884884    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g7zsx" event={"ID":"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7","Type":"ContainerStarted","Data":"af48201aa36a65dd8ae84fd96e3ad5ee95a7dad6e097e06ca6d2cabe777c431a"}
May 21 15:35:43.884926 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:43.884923    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g7zsx" event={"ID":"5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7","Type":"ContainerStarted","Data":"80845f6929e941b7ee3d93ec2dde531d30a3e8a840b3fcf93452a7ad7ef43b12"}
May 21 15:35:43.902077 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:35:43.902031    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g7zsx" podStartSLOduration=251.897794143 podStartE2EDuration="4m12.902019343s" podCreationTimestamp="2026-05-21 15:31:31 +0000 UTC" firstStartedPulling="2026-05-21 15:35:42.159581615 +0000 UTC m=+251.729946710" lastFinishedPulling="2026-05-21 15:35:43.163806798 +0000 UTC m=+252.734171910" observedRunningTime="2026-05-21 15:35:43.900791424 +0000 UTC m=+253.471156538" watchObservedRunningTime="2026-05-21 15:35:43.902019343 +0000 UTC m=+253.472384456"
May 21 15:36:12.614564 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:36:12.614515    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6" podUID="66b1e4a6-a9d4-411c-9eb6-786ddc7ba269"
May 21 15:36:12.957350 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:36:12.957320    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:36:15.753528 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:36:15.753474    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:36:15.755938 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:36:15.755914    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/66b1e4a6-a9d4-411c-9eb6-786ddc7ba269-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-t7xs6\" (UID: \"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:36:15.960533 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:36:15.960501    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-d4qrz\""
May 21 15:36:15.968834 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:36:15.968812    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"
May 21 15:36:16.088162 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:36:16.088104    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6"]
May 21 15:36:16.091141 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:36:16.091097    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b1e4a6_a9d4_411c_9eb6_786ddc7ba269.slice/crio-01da92425a4b16a82bbd02003352e325c298fb783b9b731b32d1d3f5a02c9e57 WatchSource:0}: Error finding container 01da92425a4b16a82bbd02003352e325c298fb783b9b731b32d1d3f5a02c9e57: Status 404 returned error can't find the container with id 01da92425a4b16a82bbd02003352e325c298fb783b9b731b32d1d3f5a02c9e57
May 21 15:36:16.969811 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:36:16.969770    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6" event={"ID":"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269","Type":"ContainerStarted","Data":"01da92425a4b16a82bbd02003352e325c298fb783b9b731b32d1d3f5a02c9e57"}
May 21 15:36:17.977935 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:36:17.977879    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6" event={"ID":"66b1e4a6-a9d4-411c-9eb6-786ddc7ba269","Type":"ContainerStarted","Data":"997097544d9786ee8aefd565d3372620eb3a7a1f2e05d37d0f3920e2b1a3a1b3"}
May 21 15:36:17.995684 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:36:17.995592    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-t7xs6" podStartSLOduration=279.672700908 podStartE2EDuration="4m40.995575594s" podCreationTimestamp="2026-05-21 15:31:37 +0000 UTC" firstStartedPulling="2026-05-21 15:36:16.093362767 +0000 UTC m=+285.663727871" lastFinishedPulling="2026-05-21 15:36:17.416237467 +0000 UTC m=+286.986602557" observedRunningTime="2026-05-21 15:36:17.995152673 +0000 UTC m=+287.565517776" watchObservedRunningTime="2026-05-21 15:36:17.995575594 +0000 UTC m=+287.565940708"
May 21 15:36:30.890382 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:36:30.890339    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:36:30.890919 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:36:30.890464    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:36:30.899734 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:36:30.899709    2569 kubelet.go:1628] "Image garbage collection succeeded"
May 21 15:37:26.389824 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.389740    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-r7rdk"]
May 21 15:37:26.390286 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.389972    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a1ca7e5-1b66-43e8-b816-aeffc758f649" containerName="registry"
May 21 15:37:26.390286 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.389982    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a1ca7e5-1b66-43e8-b816-aeffc758f649" containerName="registry"
May 21 15:37:26.390286 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.390025    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a1ca7e5-1b66-43e8-b816-aeffc758f649" containerName="registry"
May 21 15:37:26.392665 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.392648    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-r7rdk"
May 21 15:37:26.395046 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.395021    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 21 15:37:26.395046 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.395029    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-tdmdc\""
May 21 15:37:26.395273 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.395108    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 21 15:37:26.406218 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.406193    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-r7rdk"]
May 21 15:37:26.545820 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.545786    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-r7rdk\" (UID: \"f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77\") " pod="cert-manager/cert-manager-cainjector-68b757865b-r7rdk"
May 21 15:37:26.545820 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.545825    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdtrj\" (UniqueName: \"kubernetes.io/projected/f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77-kube-api-access-sdtrj\") pod \"cert-manager-cainjector-68b757865b-r7rdk\" (UID: \"f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77\") " pod="cert-manager/cert-manager-cainjector-68b757865b-r7rdk"
May 21 15:37:26.647308 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.647237    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-r7rdk\" (UID: \"f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77\") " pod="cert-manager/cert-manager-cainjector-68b757865b-r7rdk"
May 21 15:37:26.647308 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.647269    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sdtrj\" (UniqueName: \"kubernetes.io/projected/f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77-kube-api-access-sdtrj\") pod \"cert-manager-cainjector-68b757865b-r7rdk\" (UID: \"f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77\") " pod="cert-manager/cert-manager-cainjector-68b757865b-r7rdk"
May 21 15:37:26.655878 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.655846    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-r7rdk\" (UID: \"f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77\") " pod="cert-manager/cert-manager-cainjector-68b757865b-r7rdk"
May 21 15:37:26.656007 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.655929    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdtrj\" (UniqueName: \"kubernetes.io/projected/f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77-kube-api-access-sdtrj\") pod \"cert-manager-cainjector-68b757865b-r7rdk\" (UID: \"f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77\") " pod="cert-manager/cert-manager-cainjector-68b757865b-r7rdk"
May 21 15:37:26.701307 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.701269    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-r7rdk"
May 21 15:37:26.822632 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.822599    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-r7rdk"]
May 21 15:37:26.825454 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:37:26.825421    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf675e4d0_b6b0_42ed_b1f0_f9a3471e7a77.slice/crio-042e3bf9c6180046986c52a21668a5607602f205da0d91bd1c2509ee1fb17256 WatchSource:0}: Error finding container 042e3bf9c6180046986c52a21668a5607602f205da0d91bd1c2509ee1fb17256: Status 404 returned error can't find the container with id 042e3bf9c6180046986c52a21668a5607602f205da0d91bd1c2509ee1fb17256
May 21 15:37:26.827221 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:26.827207    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 15:37:27.148567 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:27.148531    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-r7rdk" event={"ID":"f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77","Type":"ContainerStarted","Data":"042e3bf9c6180046986c52a21668a5607602f205da0d91bd1c2509ee1fb17256"}
May 21 15:37:30.157906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:30.157868    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-r7rdk" event={"ID":"f675e4d0-b6b0-42ed-b1f0-f9a3471e7a77","Type":"ContainerStarted","Data":"3a42621cbd3c76753dd7110879aeb2d1d89e9ebb4fecf47be8ad29b60c594932"}
May 21 15:37:30.174621 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:30.174568    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-r7rdk" podStartSLOduration=1.72035491 podStartE2EDuration="4.174553621s" podCreationTimestamp="2026-05-21 15:37:26 +0000 UTC" firstStartedPulling="2026-05-21 15:37:26.827332193 +0000 UTC m=+356.397697284" lastFinishedPulling="2026-05-21 15:37:29.281530899 +0000 UTC m=+358.851895995" observedRunningTime="2026-05-21 15:37:30.173648212 +0000 UTC m=+359.744013325" watchObservedRunningTime="2026-05-21 15:37:30.174553621 +0000 UTC m=+359.744918734"
May 21 15:37:43.481332 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:43.481292    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-pwrcj"]
May 21 15:37:43.486838 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:43.486814    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-pwrcj"
May 21 15:37:43.489050 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:43.489033    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fs6nc\""
May 21 15:37:43.492019 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:43.491998    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-pwrcj"]
May 21 15:37:43.562292 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:43.562262    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdd2n\" (UniqueName: \"kubernetes.io/projected/7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7-kube-api-access-jdd2n\") pod \"cert-manager-79c8d999ff-pwrcj\" (UID: \"7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7\") " pod="cert-manager/cert-manager-79c8d999ff-pwrcj"
May 21 15:37:43.562405 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:43.562306    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7-bound-sa-token\") pod \"cert-manager-79c8d999ff-pwrcj\" (UID: \"7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7\") " pod="cert-manager/cert-manager-79c8d999ff-pwrcj"
May 21 15:37:43.663210 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:43.663178    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jdd2n\" (UniqueName: \"kubernetes.io/projected/7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7-kube-api-access-jdd2n\") pod \"cert-manager-79c8d999ff-pwrcj\" (UID: \"7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7\") " pod="cert-manager/cert-manager-79c8d999ff-pwrcj"
May 21 15:37:43.663370 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:43.663226    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7-bound-sa-token\") pod \"cert-manager-79c8d999ff-pwrcj\" (UID: \"7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7\") " pod="cert-manager/cert-manager-79c8d999ff-pwrcj"
May 21 15:37:43.670384 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:43.670357    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7-bound-sa-token\") pod \"cert-manager-79c8d999ff-pwrcj\" (UID: \"7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7\") " pod="cert-manager/cert-manager-79c8d999ff-pwrcj"
May 21 15:37:43.670505 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:43.670462    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdd2n\" (UniqueName: \"kubernetes.io/projected/7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7-kube-api-access-jdd2n\") pod \"cert-manager-79c8d999ff-pwrcj\" (UID: \"7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7\") " pod="cert-manager/cert-manager-79c8d999ff-pwrcj"
May 21 15:37:43.796442 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:43.796365    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-pwrcj"
May 21 15:37:43.920530 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:43.920487    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-pwrcj"]
May 21 15:37:43.923680 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:37:43.923654    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ef7d7bf_5bd5_42bd_930f_298ce4eda3b7.slice/crio-98944b475cabc50c48fc15cc2dc9b894cf117457c854151143f4ca01ffdaf9eb WatchSource:0}: Error finding container 98944b475cabc50c48fc15cc2dc9b894cf117457c854151143f4ca01ffdaf9eb: Status 404 returned error can't find the container with id 98944b475cabc50c48fc15cc2dc9b894cf117457c854151143f4ca01ffdaf9eb
May 21 15:37:44.193053 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:44.193013    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-pwrcj" event={"ID":"7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7","Type":"ContainerStarted","Data":"e044cdfe796eeaf54d27a1271a40a3c1daa6d75575ab288f03a3b9d23de2ee68"}
May 21 15:37:44.193053 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:44.193056    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-pwrcj" event={"ID":"7ef7d7bf-5bd5-42bd-930f-298ce4eda3b7","Type":"ContainerStarted","Data":"98944b475cabc50c48fc15cc2dc9b894cf117457c854151143f4ca01ffdaf9eb"}
May 21 15:37:44.207454 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:44.207401    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-pwrcj" podStartSLOduration=1.207383952 podStartE2EDuration="1.207383952s" podCreationTimestamp="2026-05-21 15:37:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:37:44.207107379 +0000 UTC m=+373.777472493" watchObservedRunningTime="2026-05-21 15:37:44.207383952 +0000 UTC m=+373.777749065"
May 21 15:37:54.836910 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:54.836874    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"]
May 21 15:37:54.840135 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:54.840102    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"
May 21 15:37:54.844530 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:54.844509    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 15:37:54.844636 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:54.844615    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 15:37:54.844794 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:54.844774    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fgvqz\""
May 21 15:37:54.844858 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:54.844842    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 15:37:54.845048 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:54.845034    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 15:37:54.853286 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:54.853267    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"]
May 21 15:37:54.944488 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:54.944454    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2c0b9d1-51bf-4736-836a-d98a8b6ad060-webhook-cert\") pod \"opendatahub-operator-controller-manager-5544b565-95wzd\" (UID: \"e2c0b9d1-51bf-4736-836a-d98a8b6ad060\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"
May 21 15:37:54.944488 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:54.944490    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc8wg\" (UniqueName: \"kubernetes.io/projected/e2c0b9d1-51bf-4736-836a-d98a8b6ad060-kube-api-access-gc8wg\") pod \"opendatahub-operator-controller-manager-5544b565-95wzd\" (UID: \"e2c0b9d1-51bf-4736-836a-d98a8b6ad060\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"
May 21 15:37:54.944673 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:54.944515    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e2c0b9d1-51bf-4736-836a-d98a8b6ad060-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5544b565-95wzd\" (UID: \"e2c0b9d1-51bf-4736-836a-d98a8b6ad060\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"
May 21 15:37:55.045172 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:55.045140    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2c0b9d1-51bf-4736-836a-d98a8b6ad060-webhook-cert\") pod \"opendatahub-operator-controller-manager-5544b565-95wzd\" (UID: \"e2c0b9d1-51bf-4736-836a-d98a8b6ad060\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"
May 21 15:37:55.045317 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:55.045176    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gc8wg\" (UniqueName: \"kubernetes.io/projected/e2c0b9d1-51bf-4736-836a-d98a8b6ad060-kube-api-access-gc8wg\") pod \"opendatahub-operator-controller-manager-5544b565-95wzd\" (UID: \"e2c0b9d1-51bf-4736-836a-d98a8b6ad060\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"
May 21 15:37:55.045317 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:55.045202    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e2c0b9d1-51bf-4736-836a-d98a8b6ad060-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5544b565-95wzd\" (UID: \"e2c0b9d1-51bf-4736-836a-d98a8b6ad060\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"
May 21 15:37:55.047611 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:55.047586    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e2c0b9d1-51bf-4736-836a-d98a8b6ad060-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5544b565-95wzd\" (UID: \"e2c0b9d1-51bf-4736-836a-d98a8b6ad060\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"
May 21 15:37:55.047716 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:55.047585    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e2c0b9d1-51bf-4736-836a-d98a8b6ad060-webhook-cert\") pod \"opendatahub-operator-controller-manager-5544b565-95wzd\" (UID: \"e2c0b9d1-51bf-4736-836a-d98a8b6ad060\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"
May 21 15:37:55.053151 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:55.053131    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc8wg\" (UniqueName: \"kubernetes.io/projected/e2c0b9d1-51bf-4736-836a-d98a8b6ad060-kube-api-access-gc8wg\") pod \"opendatahub-operator-controller-manager-5544b565-95wzd\" (UID: \"e2c0b9d1-51bf-4736-836a-d98a8b6ad060\") " pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"
May 21 15:37:55.149773 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:55.149749    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"
May 21 15:37:55.298569 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:55.298534    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"]
May 21 15:37:55.301649 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:37:55.301611    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2c0b9d1_51bf_4736_836a_d98a8b6ad060.slice/crio-c460c5e7fa4346305ca36e7367a7aea8bb8ae67b4bfd9a7df0e79e23f328c142 WatchSource:0}: Error finding container c460c5e7fa4346305ca36e7367a7aea8bb8ae67b4bfd9a7df0e79e23f328c142: Status 404 returned error can't find the container with id c460c5e7fa4346305ca36e7367a7aea8bb8ae67b4bfd9a7df0e79e23f328c142
May 21 15:37:56.231589 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:56.231518    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd" event={"ID":"e2c0b9d1-51bf-4736-836a-d98a8b6ad060","Type":"ContainerStarted","Data":"c460c5e7fa4346305ca36e7367a7aea8bb8ae67b4bfd9a7df0e79e23f328c142"}
May 21 15:37:58.238817 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:58.238770    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd" event={"ID":"e2c0b9d1-51bf-4736-836a-d98a8b6ad060","Type":"ContainerStarted","Data":"efd101aefc26c7263bb904aa4510f1cf6a115577599e1243be7df6ce027f2e16"}
May 21 15:37:58.239195 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:58.238901    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"
May 21 15:37:58.268360 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:37:58.268312    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd" podStartSLOduration=1.762897009 podStartE2EDuration="4.268296628s" podCreationTimestamp="2026-05-21 15:37:54 +0000 UTC" firstStartedPulling="2026-05-21 15:37:55.303463976 +0000 UTC m=+384.873829070" lastFinishedPulling="2026-05-21 15:37:57.808863595 +0000 UTC m=+387.379228689" observedRunningTime="2026-05-21 15:37:58.267267735 +0000 UTC m=+387.837632848" watchObservedRunningTime="2026-05-21 15:37:58.268296628 +0000 UTC m=+387.838661740"
May 21 15:38:09.243823 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:09.243788    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5544b565-95wzd"
May 21 15:38:12.223340 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.223301    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"]
May 21 15:38:12.227623 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.227600    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"
May 21 15:38:12.230443 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.230424    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 15:38:12.230562 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.230516    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 15:38:12.231478 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.231457    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 15:38:12.231594 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.231577    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 15:38:12.247690 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.247669    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"]
May 21 15:38:12.269511 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.269486    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d-tmp\") pod \"kube-auth-proxy-5bc586767c-jt5tp\" (UID: \"949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"
May 21 15:38:12.269646 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.269551    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxf6b\" (UniqueName: \"kubernetes.io/projected/949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d-kube-api-access-dxf6b\") pod \"kube-auth-proxy-5bc586767c-jt5tp\" (UID: \"949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"
May 21 15:38:12.269646 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.269587    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d-tls-certs\") pod \"kube-auth-proxy-5bc586767c-jt5tp\" (UID: \"949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"
May 21 15:38:12.370578 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.370541    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d-tls-certs\") pod \"kube-auth-proxy-5bc586767c-jt5tp\" (UID: \"949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"
May 21 15:38:12.370764 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.370619    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d-tmp\") pod \"kube-auth-proxy-5bc586767c-jt5tp\" (UID: \"949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"
May 21 15:38:12.370764 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.370667    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dxf6b\" (UniqueName: \"kubernetes.io/projected/949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d-kube-api-access-dxf6b\") pod \"kube-auth-proxy-5bc586767c-jt5tp\" (UID: \"949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"
May 21 15:38:12.372738 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.372710    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d-tmp\") pod \"kube-auth-proxy-5bc586767c-jt5tp\" (UID: \"949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"
May 21 15:38:12.372981 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.372962    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d-tls-certs\") pod \"kube-auth-proxy-5bc586767c-jt5tp\" (UID: \"949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"
May 21 15:38:12.394673 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.394640    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxf6b\" (UniqueName: \"kubernetes.io/projected/949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d-kube-api-access-dxf6b\") pod \"kube-auth-proxy-5bc586767c-jt5tp\" (UID: \"949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d\") " pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"
May 21 15:38:12.536506 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.536417    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"
May 21 15:38:12.670134 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:12.670093    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp"]
May 21 15:38:12.671882 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:38:12.671853    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949495c7_6d54_4b91_bdb4_9c8c3f0e2f9d.slice/crio-14bc167607b078b475f20bc96545c5f9e4ec9d465f47eec85c6b8022592d0689 WatchSource:0}: Error finding container 14bc167607b078b475f20bc96545c5f9e4ec9d465f47eec85c6b8022592d0689: Status 404 returned error can't find the container with id 14bc167607b078b475f20bc96545c5f9e4ec9d465f47eec85c6b8022592d0689
May 21 15:38:13.279209 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:13.279170    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp" event={"ID":"949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d","Type":"ContainerStarted","Data":"14bc167607b078b475f20bc96545c5f9e4ec9d465f47eec85c6b8022592d0689"}
May 21 15:38:16.289065 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:16.288966    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp" event={"ID":"949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d","Type":"ContainerStarted","Data":"c5cae950e5c51a18dc9cbeda1b04bdb49c68fef9702a9e3b39bb208157b4b68c"}
May 21 15:38:16.305397 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:16.305349    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5bc586767c-jt5tp" podStartSLOduration=1.0581418870000001 podStartE2EDuration="4.305332099s" podCreationTimestamp="2026-05-21 15:38:12 +0000 UTC" firstStartedPulling="2026-05-21 15:38:12.673583982 +0000 UTC m=+402.243949073" lastFinishedPulling="2026-05-21 15:38:15.920774186 +0000 UTC m=+405.491139285" observedRunningTime="2026-05-21 15:38:16.304289563 +0000 UTC m=+405.874654687" watchObservedRunningTime="2026-05-21 15:38:16.305332099 +0000 UTC m=+405.875697216"
May 21 15:38:16.511501 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:16.511468    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-djmk6"]
May 21 15:38:16.514615 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:16.514587    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6"
May 21 15:38:16.516749 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:16.516729    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 21 15:38:16.516888 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:16.516756    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6pqx8\""
May 21 15:38:16.520942 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:16.520918    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-djmk6"]
May 21 15:38:16.603906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:16.603806    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57390d58-a915-4066-9a6e-09981c60ac3a-cert\") pod \"odh-model-controller-858dbf95b8-djmk6\" (UID: \"57390d58-a915-4066-9a6e-09981c60ac3a\") " pod="opendatahub/odh-model-controller-858dbf95b8-djmk6"
May 21 15:38:16.603906 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:16.603864    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjhtx\" (UniqueName: \"kubernetes.io/projected/57390d58-a915-4066-9a6e-09981c60ac3a-kube-api-access-sjhtx\") pod \"odh-model-controller-858dbf95b8-djmk6\" (UID: \"57390d58-a915-4066-9a6e-09981c60ac3a\") " pod="opendatahub/odh-model-controller-858dbf95b8-djmk6"
May 21 15:38:16.704833 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:16.704800    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjhtx\" (UniqueName: \"kubernetes.io/projected/57390d58-a915-4066-9a6e-09981c60ac3a-kube-api-access-sjhtx\") pod \"odh-model-controller-858dbf95b8-djmk6\" (UID: \"57390d58-a915-4066-9a6e-09981c60ac3a\") " pod="opendatahub/odh-model-controller-858dbf95b8-djmk6"
May 21 15:38:16.704972 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:16.704954    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57390d58-a915-4066-9a6e-09981c60ac3a-cert\") pod \"odh-model-controller-858dbf95b8-djmk6\" (UID: \"57390d58-a915-4066-9a6e-09981c60ac3a\") " pod="opendatahub/odh-model-controller-858dbf95b8-djmk6"
May 21 15:38:16.705086 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:38:16.705070    2569 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 21 15:38:16.705166 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:38:16.705140    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57390d58-a915-4066-9a6e-09981c60ac3a-cert podName:57390d58-a915-4066-9a6e-09981c60ac3a nodeName:}" failed. No retries permitted until 2026-05-21 15:38:17.205111379 +0000 UTC m=+406.775476474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/57390d58-a915-4066-9a6e-09981c60ac3a-cert") pod "odh-model-controller-858dbf95b8-djmk6" (UID: "57390d58-a915-4066-9a6e-09981c60ac3a") : secret "odh-model-controller-webhook-cert" not found
May 21 15:38:16.712822 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:16.712802    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjhtx\" (UniqueName: \"kubernetes.io/projected/57390d58-a915-4066-9a6e-09981c60ac3a-kube-api-access-sjhtx\") pod \"odh-model-controller-858dbf95b8-djmk6\" (UID: \"57390d58-a915-4066-9a6e-09981c60ac3a\") " pod="opendatahub/odh-model-controller-858dbf95b8-djmk6"
May 21 15:38:17.209175 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:17.209116    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57390d58-a915-4066-9a6e-09981c60ac3a-cert\") pod \"odh-model-controller-858dbf95b8-djmk6\" (UID: \"57390d58-a915-4066-9a6e-09981c60ac3a\") " pod="opendatahub/odh-model-controller-858dbf95b8-djmk6"
May 21 15:38:17.211665 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:17.211631    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/57390d58-a915-4066-9a6e-09981c60ac3a-cert\") pod \"odh-model-controller-858dbf95b8-djmk6\" (UID: \"57390d58-a915-4066-9a6e-09981c60ac3a\") " pod="opendatahub/odh-model-controller-858dbf95b8-djmk6"
May 21 15:38:17.426158 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:17.426111    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6"
May 21 15:38:17.545502 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:17.545478    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-djmk6"]
May 21 15:38:17.547922 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:38:17.547894    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57390d58_a915_4066_9a6e_09981c60ac3a.slice/crio-97f34af203110fc9c3724f1e04a192ef306b280aa241d0477a8ea7da29405387 WatchSource:0}: Error finding container 97f34af203110fc9c3724f1e04a192ef306b280aa241d0477a8ea7da29405387: Status 404 returned error can't find the container with id 97f34af203110fc9c3724f1e04a192ef306b280aa241d0477a8ea7da29405387
May 21 15:38:18.295724 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:18.295687    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6" event={"ID":"57390d58-a915-4066-9a6e-09981c60ac3a","Type":"ContainerStarted","Data":"97f34af203110fc9c3724f1e04a192ef306b280aa241d0477a8ea7da29405387"}
May 21 15:38:21.306730 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:21.306649    2569 generic.go:358] "Generic (PLEG): container finished" podID="57390d58-a915-4066-9a6e-09981c60ac3a" containerID="294fb1de429d2689b11faa4ece22aa72d557b1bc98b8220bcd54f71469168a61" exitCode=1
May 21 15:38:21.306730 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:21.306688    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6" event={"ID":"57390d58-a915-4066-9a6e-09981c60ac3a","Type":"ContainerDied","Data":"294fb1de429d2689b11faa4ece22aa72d557b1bc98b8220bcd54f71469168a61"}
May 21 15:38:21.307092 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:21.306923    2569 scope.go:117] "RemoveContainer" containerID="294fb1de429d2689b11faa4ece22aa72d557b1bc98b8220bcd54f71469168a61"
May 21 15:38:22.310836 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.310803    2569 generic.go:358] "Generic (PLEG): container finished" podID="57390d58-a915-4066-9a6e-09981c60ac3a" containerID="41210bb5989fa120ba79ef09ede710795d3fa5833e2c33f8598a131eaeb63024" exitCode=1
May 21 15:38:22.311293 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.310848    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6" event={"ID":"57390d58-a915-4066-9a6e-09981c60ac3a","Type":"ContainerDied","Data":"41210bb5989fa120ba79ef09ede710795d3fa5833e2c33f8598a131eaeb63024"}
May 21 15:38:22.311293 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.310877    2569 scope.go:117] "RemoveContainer" containerID="294fb1de429d2689b11faa4ece22aa72d557b1bc98b8220bcd54f71469168a61"
May 21 15:38:22.311293 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.311148    2569 scope.go:117] "RemoveContainer" containerID="41210bb5989fa120ba79ef09ede710795d3fa5833e2c33f8598a131eaeb63024"
May 21 15:38:22.311422 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:38:22.311333    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-djmk6_opendatahub(57390d58-a915-4066-9a6e-09981c60ac3a)\"" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6" podUID="57390d58-a915-4066-9a6e-09981c60ac3a"
May 21 15:38:22.701140 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.701063    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-rd9mr"]
May 21 15:38:22.705362 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.705335    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr"
May 21 15:38:22.707836 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.707814    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 21 15:38:22.707966 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.707820    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5dfnn\""
May 21 15:38:22.714596 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.714574    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-rd9mr"]
May 21 15:38:22.750818 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.750783    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db9af592-f3a7-4dfc-86a5-06a71439979e-cert\") pod \"kserve-controller-manager-856948b99f-rd9mr\" (UID: \"db9af592-f3a7-4dfc-86a5-06a71439979e\") " pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr"
May 21 15:38:22.750966 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.750838    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr647\" (UniqueName: \"kubernetes.io/projected/db9af592-f3a7-4dfc-86a5-06a71439979e-kube-api-access-rr647\") pod \"kserve-controller-manager-856948b99f-rd9mr\" (UID: \"db9af592-f3a7-4dfc-86a5-06a71439979e\") " pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr"
May 21 15:38:22.851974 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.851932    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db9af592-f3a7-4dfc-86a5-06a71439979e-cert\") pod \"kserve-controller-manager-856948b99f-rd9mr\" (UID: \"db9af592-f3a7-4dfc-86a5-06a71439979e\") " pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr"
May 21 15:38:22.852198 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.852002    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rr647\" (UniqueName: \"kubernetes.io/projected/db9af592-f3a7-4dfc-86a5-06a71439979e-kube-api-access-rr647\") pod \"kserve-controller-manager-856948b99f-rd9mr\" (UID: \"db9af592-f3a7-4dfc-86a5-06a71439979e\") " pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr"
May 21 15:38:22.852198 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:38:22.852090    2569 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 21 15:38:22.852198 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:38:22.852190    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9af592-f3a7-4dfc-86a5-06a71439979e-cert podName:db9af592-f3a7-4dfc-86a5-06a71439979e nodeName:}" failed. No retries permitted until 2026-05-21 15:38:23.352173245 +0000 UTC m=+412.922538336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/db9af592-f3a7-4dfc-86a5-06a71439979e-cert") pod "kserve-controller-manager-856948b99f-rd9mr" (UID: "db9af592-f3a7-4dfc-86a5-06a71439979e") : secret "kserve-webhook-server-cert" not found
May 21 15:38:22.879395 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:22.879362    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr647\" (UniqueName: \"kubernetes.io/projected/db9af592-f3a7-4dfc-86a5-06a71439979e-kube-api-access-rr647\") pod \"kserve-controller-manager-856948b99f-rd9mr\" (UID: \"db9af592-f3a7-4dfc-86a5-06a71439979e\") " pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr"
May 21 15:38:23.315363 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:23.315338    2569 scope.go:117] "RemoveContainer" containerID="41210bb5989fa120ba79ef09ede710795d3fa5833e2c33f8598a131eaeb63024"
May 21 15:38:23.315731 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:38:23.315498    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-djmk6_opendatahub(57390d58-a915-4066-9a6e-09981c60ac3a)\"" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6" podUID="57390d58-a915-4066-9a6e-09981c60ac3a"
May 21 15:38:23.356558 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:23.356519    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db9af592-f3a7-4dfc-86a5-06a71439979e-cert\") pod \"kserve-controller-manager-856948b99f-rd9mr\" (UID: \"db9af592-f3a7-4dfc-86a5-06a71439979e\") " pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr"
May 21 15:38:23.358856 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:23.358836    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db9af592-f3a7-4dfc-86a5-06a71439979e-cert\") pod \"kserve-controller-manager-856948b99f-rd9mr\" (UID: \"db9af592-f3a7-4dfc-86a5-06a71439979e\") " pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr"
May 21 15:38:23.615825 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:23.615798    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr"
May 21 15:38:23.737389 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:23.737353    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-rd9mr"]
May 21 15:38:23.740704 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:38:23.740674    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9af592_f3a7_4dfc_86a5_06a71439979e.slice/crio-152b79c2f8c24256b22381b035802a63449679992ed18df367cc0e6c7b8e3a3a WatchSource:0}: Error finding container 152b79c2f8c24256b22381b035802a63449679992ed18df367cc0e6c7b8e3a3a: Status 404 returned error can't find the container with id 152b79c2f8c24256b22381b035802a63449679992ed18df367cc0e6c7b8e3a3a
May 21 15:38:24.318549 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:24.318514    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr" event={"ID":"db9af592-f3a7-4dfc-86a5-06a71439979e","Type":"ContainerStarted","Data":"152b79c2f8c24256b22381b035802a63449679992ed18df367cc0e6c7b8e3a3a"}
May 21 15:38:27.335919 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.335875    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx"]
May 21 15:38:27.340473 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.340446    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx"
May 21 15:38:27.342709 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.342689    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 21 15:38:27.343182 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.343099    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 21 15:38:27.343297 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.343100    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-ngcmp\""
May 21 15:38:27.351969 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.351944    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx"]
May 21 15:38:27.426280 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.426244    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6"
May 21 15:38:27.426658 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.426644    2569 scope.go:117] "RemoveContainer" containerID="41210bb5989fa120ba79ef09ede710795d3fa5833e2c33f8598a131eaeb63024"
May 21 15:38:27.426830 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:38:27.426813    2569 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-djmk6_opendatahub(57390d58-a915-4066-9a6e-09981c60ac3a)\"" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6" podUID="57390d58-a915-4066-9a6e-09981c60ac3a"
May 21 15:38:27.489133 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.489093    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjl7k\" (UniqueName: \"kubernetes.io/projected/f0e705bf-8a91-463d-9e9d-4d19553552ad-kube-api-access-kjl7k\") pod \"servicemesh-operator3-55f49c5f94-6q5mx\" (UID: \"f0e705bf-8a91-463d-9e9d-4d19553552ad\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx"
May 21 15:38:27.489269 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.489248    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f0e705bf-8a91-463d-9e9d-4d19553552ad-operator-config\") pod \"servicemesh-operator3-55f49c5f94-6q5mx\" (UID: \"f0e705bf-8a91-463d-9e9d-4d19553552ad\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx"
May 21 15:38:27.590653 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.590563    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f0e705bf-8a91-463d-9e9d-4d19553552ad-operator-config\") pod \"servicemesh-operator3-55f49c5f94-6q5mx\" (UID: \"f0e705bf-8a91-463d-9e9d-4d19553552ad\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx"
May 21 15:38:27.590653 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.590610    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjl7k\" (UniqueName: \"kubernetes.io/projected/f0e705bf-8a91-463d-9e9d-4d19553552ad-kube-api-access-kjl7k\") pod \"servicemesh-operator3-55f49c5f94-6q5mx\" (UID: \"f0e705bf-8a91-463d-9e9d-4d19553552ad\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx"
May 21 15:38:27.592982 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.592957    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/f0e705bf-8a91-463d-9e9d-4d19553552ad-operator-config\") pod \"servicemesh-operator3-55f49c5f94-6q5mx\" (UID: \"f0e705bf-8a91-463d-9e9d-4d19553552ad\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx"
May 21 15:38:27.600799 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.600763    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjl7k\" (UniqueName: \"kubernetes.io/projected/f0e705bf-8a91-463d-9e9d-4d19553552ad-kube-api-access-kjl7k\") pod \"servicemesh-operator3-55f49c5f94-6q5mx\" (UID: \"f0e705bf-8a91-463d-9e9d-4d19553552ad\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx"
May 21 15:38:27.653239 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.653206    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx"
May 21 15:38:27.785402 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:27.785373    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx"]
May 21 15:38:27.788229 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:38:27.788199    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0e705bf_8a91_463d_9e9d_4d19553552ad.slice/crio-01dc21bdb89249cf0b0849de6256ac76478cf29e6aed254d88bf8e1bf9fb27df WatchSource:0}: Error finding container 01dc21bdb89249cf0b0849de6256ac76478cf29e6aed254d88bf8e1bf9fb27df: Status 404 returned error can't find the container with id 01dc21bdb89249cf0b0849de6256ac76478cf29e6aed254d88bf8e1bf9fb27df
May 21 15:38:28.330284 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:28.330243    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr" event={"ID":"db9af592-f3a7-4dfc-86a5-06a71439979e","Type":"ContainerStarted","Data":"1b6ef77f43a05d0514598dfc65984b67039d81aee2f6971d41368572d83cfb29"}
May 21 15:38:28.330467 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:28.330322    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr"
May 21 15:38:28.331358 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:28.331332    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx" event={"ID":"f0e705bf-8a91-463d-9e9d-4d19553552ad","Type":"ContainerStarted","Data":"01dc21bdb89249cf0b0849de6256ac76478cf29e6aed254d88bf8e1bf9fb27df"}
May 21 15:38:28.354302 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:28.354260    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr" podStartSLOduration=2.630956265 podStartE2EDuration="6.354245343s" podCreationTimestamp="2026-05-21 15:38:22 +0000 UTC" firstStartedPulling="2026-05-21 15:38:23.74220072 +0000 UTC m=+413.312565825" lastFinishedPulling="2026-05-21 15:38:27.465489809 +0000 UTC m=+417.035854903" observedRunningTime="2026-05-21 15:38:28.352809211 +0000 UTC m=+417.923174325" watchObservedRunningTime="2026-05-21 15:38:28.354245343 +0000 UTC m=+417.924610456"
May 21 15:38:31.342519 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:31.342480    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx" event={"ID":"f0e705bf-8a91-463d-9e9d-4d19553552ad","Type":"ContainerStarted","Data":"373ae5b6ad16ed7b04eb595159ea4dc1897230e7d7f59343d84d5312285976a0"}
May 21 15:38:31.342904 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:31.342595    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx"
May 21 15:38:31.361927 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:31.361882    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx" podStartSLOduration=0.909402648 podStartE2EDuration="4.361864923s" podCreationTimestamp="2026-05-21 15:38:27 +0000 UTC" firstStartedPulling="2026-05-21 15:38:27.790777268 +0000 UTC m=+417.361142362" lastFinishedPulling="2026-05-21 15:38:31.243239545 +0000 UTC m=+420.813604637" observedRunningTime="2026-05-21 15:38:31.361562922 +0000 UTC m=+420.931928038" watchObservedRunningTime="2026-05-21 15:38:31.361864923 +0000 UTC m=+420.932230040"
May 21 15:38:34.046732 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.046692    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"]
May 21 15:38:34.049999 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.049982    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.052779 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.052606    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 21 15:38:34.052779 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.052631    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 21 15:38:34.052779 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.052641    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 21 15:38:34.052779 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.052645    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h7dch\""
May 21 15:38:34.052779 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.052653    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 21 15:38:34.063080 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.063053    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"]
May 21 15:38:34.147082 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.147051    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1990905a-691a-48e5-b0a0-aa929b69b77a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.147246 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.147092    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1990905a-691a-48e5-b0a0-aa929b69b77a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.147246 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.147140    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh7pr\" (UniqueName: \"kubernetes.io/projected/1990905a-691a-48e5-b0a0-aa929b69b77a-kube-api-access-zh7pr\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.147246 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.147218    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1990905a-691a-48e5-b0a0-aa929b69b77a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.147352 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.147246    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1990905a-691a-48e5-b0a0-aa929b69b77a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.147352 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.147294    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1990905a-691a-48e5-b0a0-aa929b69b77a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.147352 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.147316    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1990905a-691a-48e5-b0a0-aa929b69b77a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.247966 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.247926    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1990905a-691a-48e5-b0a0-aa929b69b77a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.247966 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.247971    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1990905a-691a-48e5-b0a0-aa929b69b77a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.248368 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.248000    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zh7pr\" (UniqueName: \"kubernetes.io/projected/1990905a-691a-48e5-b0a0-aa929b69b77a-kube-api-access-zh7pr\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.248368 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.248034    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1990905a-691a-48e5-b0a0-aa929b69b77a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.248368 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.248172    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1990905a-691a-48e5-b0a0-aa929b69b77a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.248368 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.248244    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1990905a-691a-48e5-b0a0-aa929b69b77a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.248368 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.248275    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1990905a-691a-48e5-b0a0-aa929b69b77a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.248819 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.248787    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1990905a-691a-48e5-b0a0-aa929b69b77a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.250702 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.250682    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1990905a-691a-48e5-b0a0-aa929b69b77a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.250702 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.250693    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1990905a-691a-48e5-b0a0-aa929b69b77a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.250881 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.250860    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1990905a-691a-48e5-b0a0-aa929b69b77a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.251005 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.250986    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1990905a-691a-48e5-b0a0-aa929b69b77a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.256975 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.256930    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh7pr\" (UniqueName: \"kubernetes.io/projected/1990905a-691a-48e5-b0a0-aa929b69b77a-kube-api-access-zh7pr\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.259630 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.259600    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1990905a-691a-48e5-b0a0-aa929b69b77a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-w9v89\" (UID: \"1990905a-691a-48e5-b0a0-aa929b69b77a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.359401 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.359327    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:34.490636 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:34.490610    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"]
May 21 15:38:34.498541 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:38:34.493310    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1990905a_691a_48e5_b0a0_aa929b69b77a.slice/crio-ab6c33b4a47f26a9aca68e5b435570938ee6b8f02644bdd98b75bfaa215ab8d7 WatchSource:0}: Error finding container ab6c33b4a47f26a9aca68e5b435570938ee6b8f02644bdd98b75bfaa215ab8d7: Status 404 returned error can't find the container with id ab6c33b4a47f26a9aca68e5b435570938ee6b8f02644bdd98b75bfaa215ab8d7
May 21 15:38:35.356768 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:35.356730    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89" event={"ID":"1990905a-691a-48e5-b0a0-aa929b69b77a","Type":"ContainerStarted","Data":"ab6c33b4a47f26a9aca68e5b435570938ee6b8f02644bdd98b75bfaa215ab8d7"}
May 21 15:38:37.427128 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:37.427079    2569 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6"
May 21 15:38:37.427555 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:37.427539    2569 scope.go:117] "RemoveContainer" containerID="41210bb5989fa120ba79ef09ede710795d3fa5833e2c33f8598a131eaeb63024"
May 21 15:38:38.367966 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:38.367927    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6" event={"ID":"57390d58-a915-4066-9a6e-09981c60ac3a","Type":"ContainerStarted","Data":"38a13c0a1febe95a1455581de9d797b83776d36cb010e22d6abaed491a7bd6c5"}
May 21 15:38:38.368281 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:38.368256    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6"
May 21 15:38:38.384785 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:38.384497    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6" podStartSLOduration=2.16650319 podStartE2EDuration="22.384478977s" podCreationTimestamp="2026-05-21 15:38:16 +0000 UTC" firstStartedPulling="2026-05-21 15:38:17.549215761 +0000 UTC m=+407.119580852" lastFinishedPulling="2026-05-21 15:38:37.767191547 +0000 UTC m=+427.337556639" observedRunningTime="2026-05-21 15:38:38.382872844 +0000 UTC m=+427.953237958" watchObservedRunningTime="2026-05-21 15:38:38.384478977 +0000 UTC m=+427.954844093"
May 21 15:38:39.759698 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:39.759644    2569 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 21 15:38:39.760047 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:39.759742    2569 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 21 15:38:40.375945 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:40.375908    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89" event={"ID":"1990905a-691a-48e5-b0a0-aa929b69b77a","Type":"ContainerStarted","Data":"6771b708952da42621771b8b3c59b4cf9c2af8746ccb550533b6f9cf1cc1e6a7"}
May 21 15:38:40.376146 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:40.376110    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:40.377910 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:40.377883    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-w9v89 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 21 15:38:40.378006 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:40.377935    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89" podUID="1990905a-691a-48e5-b0a0-aa929b69b77a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 15:38:40.408527 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:40.408472    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89" podStartSLOduration=1.144338183 podStartE2EDuration="6.408453543s" podCreationTimestamp="2026-05-21 15:38:34 +0000 UTC" firstStartedPulling="2026-05-21 15:38:34.495316995 +0000 UTC m=+424.065682100" lastFinishedPulling="2026-05-21 15:38:39.759432366 +0000 UTC m=+429.329797460" observedRunningTime="2026-05-21 15:38:40.407138211 +0000 UTC m=+429.977503327" watchObservedRunningTime="2026-05-21 15:38:40.408453543 +0000 UTC m=+429.978818659"
May 21 15:38:41.380546 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:41.380516    2569 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-w9v89 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 21 15:38:41.381006 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:41.380586    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89" podUID="1990905a-691a-48e5-b0a0-aa929b69b77a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 21 15:38:42.347692 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:42.347661    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-6q5mx"
May 21 15:38:44.380854 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:44.380819    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-w9v89"
May 21 15:38:49.374989 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:49.374954    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-djmk6"
May 21 15:38:59.339578 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:38:59.339507    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-rd9mr"
May 21 15:39:43.148284 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:43.148244    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-6kz26"]
May 21 15:39:43.150669 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:43.150645    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6kz26"
May 21 15:39:43.156386 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:43.156358    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 15:39:43.156535 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:43.156406    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 21 15:39:43.156535 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:43.156501    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 15:39:43.157352 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:43.157330    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zs5fk\""
May 21 15:39:43.171516 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:43.171492    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-6kz26"]
May 21 15:39:43.316227 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:43.316190    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brv57\" (UniqueName: \"kubernetes.io/projected/9bc91ec3-5f25-4408-9923-b7b7d49219bb-kube-api-access-brv57\") pod \"dns-operator-controller-manager-648d5c98bc-6kz26\" (UID: \"9bc91ec3-5f25-4408-9923-b7b7d49219bb\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6kz26"
May 21 15:39:43.416710 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:43.416611    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brv57\" (UniqueName: \"kubernetes.io/projected/9bc91ec3-5f25-4408-9923-b7b7d49219bb-kube-api-access-brv57\") pod \"dns-operator-controller-manager-648d5c98bc-6kz26\" (UID: \"9bc91ec3-5f25-4408-9923-b7b7d49219bb\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6kz26"
May 21 15:39:43.426784 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:43.426758    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brv57\" (UniqueName: \"kubernetes.io/projected/9bc91ec3-5f25-4408-9923-b7b7d49219bb-kube-api-access-brv57\") pod \"dns-operator-controller-manager-648d5c98bc-6kz26\" (UID: \"9bc91ec3-5f25-4408-9923-b7b7d49219bb\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6kz26"
May 21 15:39:43.460362 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:43.460333    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6kz26"
May 21 15:39:43.597507 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:43.597478    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-6kz26"]
May 21 15:39:43.601501 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:39:43.601474    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc91ec3_5f25_4408_9923_b7b7d49219bb.slice/crio-7d8416d458da76da22156786e8c36ef68374b2fc1924d8d8859aa23402185845 WatchSource:0}: Error finding container 7d8416d458da76da22156786e8c36ef68374b2fc1924d8d8859aa23402185845: Status 404 returned error can't find the container with id 7d8416d458da76da22156786e8c36ef68374b2fc1924d8d8859aa23402185845
May 21 15:39:44.591546 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:44.587455    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6kz26" event={"ID":"9bc91ec3-5f25-4408-9923-b7b7d49219bb","Type":"ContainerStarted","Data":"7d8416d458da76da22156786e8c36ef68374b2fc1924d8d8859aa23402185845"}
May 21 15:39:46.595952 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:46.595915    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6kz26" event={"ID":"9bc91ec3-5f25-4408-9923-b7b7d49219bb","Type":"ContainerStarted","Data":"c708a48adbb9b5d1261a9068691769f58b8e86eb6d5a3fb0728bdc6cf9d69752"}
May 21 15:39:46.596381 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:46.596042    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6kz26"
May 21 15:39:46.619745 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:46.619699    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6kz26" podStartSLOduration=1.480531556 podStartE2EDuration="3.61968732s" podCreationTimestamp="2026-05-21 15:39:43 +0000 UTC" firstStartedPulling="2026-05-21 15:39:43.603739332 +0000 UTC m=+493.174104427" lastFinishedPulling="2026-05-21 15:39:45.742895089 +0000 UTC m=+495.313260191" observedRunningTime="2026-05-21 15:39:46.618849859 +0000 UTC m=+496.189214972" watchObservedRunningTime="2026-05-21 15:39:46.61968732 +0000 UTC m=+496.190052432"
May 21 15:39:47.164210 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:47.164179    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"]
May 21 15:39:47.166330 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:47.166315    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"
May 21 15:39:47.168955 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:47.168938    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lrczq\""
May 21 15:39:47.196411 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:47.196379    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"]
May 21 15:39:47.349893 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:47.349844    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fffdde18-f23f-4904-ba6f-9ada68473cc4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-429wf\" (UID: \"fffdde18-f23f-4904-ba6f-9ada68473cc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"
May 21 15:39:47.349893 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:47.349894    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dsr2\" (UniqueName: \"kubernetes.io/projected/fffdde18-f23f-4904-ba6f-9ada68473cc4-kube-api-access-6dsr2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-429wf\" (UID: \"fffdde18-f23f-4904-ba6f-9ada68473cc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"
May 21 15:39:47.451113 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:47.451008    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6dsr2\" (UniqueName: \"kubernetes.io/projected/fffdde18-f23f-4904-ba6f-9ada68473cc4-kube-api-access-6dsr2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-429wf\" (UID: \"fffdde18-f23f-4904-ba6f-9ada68473cc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"
May 21 15:39:47.451113 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:47.451099    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fffdde18-f23f-4904-ba6f-9ada68473cc4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-429wf\" (UID: \"fffdde18-f23f-4904-ba6f-9ada68473cc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"
May 21 15:39:47.451449 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:47.451429    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fffdde18-f23f-4904-ba6f-9ada68473cc4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-429wf\" (UID: \"fffdde18-f23f-4904-ba6f-9ada68473cc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"
May 21 15:39:47.467202 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:47.467173    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dsr2\" (UniqueName: \"kubernetes.io/projected/fffdde18-f23f-4904-ba6f-9ada68473cc4-kube-api-access-6dsr2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-429wf\" (UID: \"fffdde18-f23f-4904-ba6f-9ada68473cc4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"
May 21 15:39:47.475886 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:47.475862    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"
May 21 15:39:47.628387 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:47.628355    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"]
May 21 15:39:47.632347 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:39:47.632320    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffdde18_f23f_4904_ba6f_9ada68473cc4.slice/crio-0278db25989fe4108e77da753a8d71e9281423ef0f461cf64675157735aed97a WatchSource:0}: Error finding container 0278db25989fe4108e77da753a8d71e9281423ef0f461cf64675157735aed97a: Status 404 returned error can't find the container with id 0278db25989fe4108e77da753a8d71e9281423ef0f461cf64675157735aed97a
May 21 15:39:48.604033 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:48.603998    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf" event={"ID":"fffdde18-f23f-4904-ba6f-9ada68473cc4","Type":"ContainerStarted","Data":"0278db25989fe4108e77da753a8d71e9281423ef0f461cf64675157735aed97a"}
May 21 15:39:53.622927 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:53.622892    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf" event={"ID":"fffdde18-f23f-4904-ba6f-9ada68473cc4","Type":"ContainerStarted","Data":"055b33ba1bcc106190af0145d837da7ca54cd41fe0e3442fc9071b2299e2394b"}
May 21 15:39:53.623480 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:53.623040    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"
May 21 15:39:53.657775 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:53.657723    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf" podStartSLOduration=1.124035234 podStartE2EDuration="6.657708417s" podCreationTimestamp="2026-05-21 15:39:47 +0000 UTC" firstStartedPulling="2026-05-21 15:39:47.635266145 +0000 UTC m=+497.205631240" lastFinishedPulling="2026-05-21 15:39:53.168939332 +0000 UTC m=+502.739304423" observedRunningTime="2026-05-21 15:39:53.657355811 +0000 UTC m=+503.227720935" watchObservedRunningTime="2026-05-21 15:39:53.657708417 +0000 UTC m=+503.228073528"
May 21 15:39:57.601832 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:39:57.601799    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-6kz26"
May 21 15:40:04.628730 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:04.628699    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"
May 21 15:40:06.674115 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.674076    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"]
May 21 15:40:06.674492 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.674340    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf" podUID="fffdde18-f23f-4904-ba6f-9ada68473cc4" containerName="manager" containerID="cri-o://055b33ba1bcc106190af0145d837da7ca54cd41fe0e3442fc9071b2299e2394b" gracePeriod=2
May 21 15:40:06.685813 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.685785    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"]
May 21 15:40:06.731683 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.731650    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"]
May 21 15:40:06.731989 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.731974    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fffdde18-f23f-4904-ba6f-9ada68473cc4" containerName="manager"
May 21 15:40:06.731989 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.731990    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="fffdde18-f23f-4904-ba6f-9ada68473cc4" containerName="manager"
May 21 15:40:06.732084 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.732033    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="fffdde18-f23f-4904-ba6f-9ada68473cc4" containerName="manager"
May 21 15:40:06.733960 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.733935    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"
May 21 15:40:06.772651 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.772619    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pr625"]
May 21 15:40:06.775458 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.775434    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pr625"
May 21 15:40:06.775951 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.775928    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"]
May 21 15:40:06.779437 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.779413    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-h25p5\""
May 21 15:40:06.792583 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.792564    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pr625"]
May 21 15:40:06.804721 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.804694    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c5f2dc-d167-4a65-a7b2-5c7906945d35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sv9n6\" (UID: \"81c5f2dc-d167-4a65-a7b2-5c7906945d35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"
May 21 15:40:06.804865 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.804729    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fngg\" (UniqueName: \"kubernetes.io/projected/41d4488f-9b80-4fef-9315-118582eb6fe1-kube-api-access-8fngg\") pod \"limitador-operator-controller-manager-85c4996f8c-pr625\" (UID: \"41d4488f-9b80-4fef-9315-118582eb6fe1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pr625"
May 21 15:40:06.804865 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.804762    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b47t8\" (UniqueName: \"kubernetes.io/projected/81c5f2dc-d167-4a65-a7b2-5c7906945d35-kube-api-access-b47t8\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sv9n6\" (UID: \"81c5f2dc-d167-4a65-a7b2-5c7906945d35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"
May 21 15:40:06.816421 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.816327    2569 status_manager.go:895] "Failed to get status for pod" podUID="fffdde18-f23f-4904-ba6f-9ada68473cc4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-429wf\" is forbidden: User \"system:node:ip-10-0-135-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-228.ec2.internal' and this object"
May 21 15:40:06.821335 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.821307    2569 status_manager.go:895] "Failed to get status for pod" podUID="fffdde18-f23f-4904-ba6f-9ada68473cc4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-429wf\" is forbidden: User \"system:node:ip-10-0-135-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-228.ec2.internal' and this object"
May 21 15:40:06.905586 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.905553    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b47t8\" (UniqueName: \"kubernetes.io/projected/81c5f2dc-d167-4a65-a7b2-5c7906945d35-kube-api-access-b47t8\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sv9n6\" (UID: \"81c5f2dc-d167-4a65-a7b2-5c7906945d35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"
May 21 15:40:06.905711 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.905672    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c5f2dc-d167-4a65-a7b2-5c7906945d35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sv9n6\" (UID: \"81c5f2dc-d167-4a65-a7b2-5c7906945d35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"
May 21 15:40:06.905711 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.905704    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fngg\" (UniqueName: \"kubernetes.io/projected/41d4488f-9b80-4fef-9315-118582eb6fe1-kube-api-access-8fngg\") pod \"limitador-operator-controller-manager-85c4996f8c-pr625\" (UID: \"41d4488f-9b80-4fef-9315-118582eb6fe1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pr625"
May 21 15:40:06.906025 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.905999    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c5f2dc-d167-4a65-a7b2-5c7906945d35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sv9n6\" (UID: \"81c5f2dc-d167-4a65-a7b2-5c7906945d35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"
May 21 15:40:06.911438 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.911420    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"
May 21 15:40:06.916290 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.916263    2569 status_manager.go:895] "Failed to get status for pod" podUID="fffdde18-f23f-4904-ba6f-9ada68473cc4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-429wf\" is forbidden: User \"system:node:ip-10-0-135-228.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-228.ec2.internal' and this object"
May 21 15:40:06.923831 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.923810    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b47t8\" (UniqueName: \"kubernetes.io/projected/81c5f2dc-d167-4a65-a7b2-5c7906945d35-kube-api-access-b47t8\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-sv9n6\" (UID: \"81c5f2dc-d167-4a65-a7b2-5c7906945d35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"
May 21 15:40:06.924111 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:06.924092    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fngg\" (UniqueName: \"kubernetes.io/projected/41d4488f-9b80-4fef-9315-118582eb6fe1-kube-api-access-8fngg\") pod \"limitador-operator-controller-manager-85c4996f8c-pr625\" (UID: \"41d4488f-9b80-4fef-9315-118582eb6fe1\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pr625"
May 21 15:40:07.006859 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.006780    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dsr2\" (UniqueName: \"kubernetes.io/projected/fffdde18-f23f-4904-ba6f-9ada68473cc4-kube-api-access-6dsr2\") pod \"fffdde18-f23f-4904-ba6f-9ada68473cc4\" (UID: \"fffdde18-f23f-4904-ba6f-9ada68473cc4\") "
May 21 15:40:07.007005 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.006884    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fffdde18-f23f-4904-ba6f-9ada68473cc4-extensions-socket-volume\") pod \"fffdde18-f23f-4904-ba6f-9ada68473cc4\" (UID: \"fffdde18-f23f-4904-ba6f-9ada68473cc4\") "
May 21 15:40:07.007407 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.007384    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fffdde18-f23f-4904-ba6f-9ada68473cc4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fffdde18-f23f-4904-ba6f-9ada68473cc4" (UID: "fffdde18-f23f-4904-ba6f-9ada68473cc4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 15:40:07.008913 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.008897    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fffdde18-f23f-4904-ba6f-9ada68473cc4-kube-api-access-6dsr2" (OuterVolumeSpecName: "kube-api-access-6dsr2") pod "fffdde18-f23f-4904-ba6f-9ada68473cc4" (UID: "fffdde18-f23f-4904-ba6f-9ada68473cc4"). InnerVolumeSpecName "kube-api-access-6dsr2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:40:07.025659 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.025631    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fffdde18-f23f-4904-ba6f-9ada68473cc4" path="/var/lib/kubelet/pods/fffdde18-f23f-4904-ba6f-9ada68473cc4/volumes"
May 21 15:40:07.057024 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.056999    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"
May 21 15:40:07.085813 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.085784    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pr625"
May 21 15:40:07.108068 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.108042    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dsr2\" (UniqueName: \"kubernetes.io/projected/fffdde18-f23f-4904-ba6f-9ada68473cc4-kube-api-access-6dsr2\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:40:07.108068 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.108069    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fffdde18-f23f-4904-ba6f-9ada68473cc4-extensions-socket-volume\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:40:07.222659 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.222634    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"]
May 21 15:40:07.225541 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:40:07.225507    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c5f2dc_d167_4a65_a7b2_5c7906945d35.slice/crio-a9ca2c634168cfd6a14bd3be10c61a96099e58abff4628bcbd9f849e0e2bba7f WatchSource:0}: Error finding container a9ca2c634168cfd6a14bd3be10c61a96099e58abff4628bcbd9f849e0e2bba7f: Status 404 returned error can't find the container with id a9ca2c634168cfd6a14bd3be10c61a96099e58abff4628bcbd9f849e0e2bba7f
May 21 15:40:07.235569 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.235549    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pr625"]
May 21 15:40:07.238342 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:40:07.238316    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d4488f_9b80_4fef_9315_118582eb6fe1.slice/crio-9b65c90548890235c29a2e639ee3a3b5897b22a896df4a56c91bee5217b3eec8 WatchSource:0}: Error finding container 9b65c90548890235c29a2e639ee3a3b5897b22a896df4a56c91bee5217b3eec8: Status 404 returned error can't find the container with id 9b65c90548890235c29a2e639ee3a3b5897b22a896df4a56c91bee5217b3eec8
May 21 15:40:07.667465 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.667435    2569 generic.go:358] "Generic (PLEG): container finished" podID="fffdde18-f23f-4904-ba6f-9ada68473cc4" containerID="055b33ba1bcc106190af0145d837da7ca54cd41fe0e3442fc9071b2299e2394b" exitCode=0
May 21 15:40:07.667627 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.667482    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-429wf"
May 21 15:40:07.667627 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.667514    2569 scope.go:117] "RemoveContainer" containerID="055b33ba1bcc106190af0145d837da7ca54cd41fe0e3442fc9071b2299e2394b"
May 21 15:40:07.668619 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.668594    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pr625" event={"ID":"41d4488f-9b80-4fef-9315-118582eb6fe1","Type":"ContainerStarted","Data":"9b65c90548890235c29a2e639ee3a3b5897b22a896df4a56c91bee5217b3eec8"}
May 21 15:40:07.670314 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.670284    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6" event={"ID":"81c5f2dc-d167-4a65-a7b2-5c7906945d35","Type":"ContainerStarted","Data":"e94155c1335cd777b692d8712ba213c824cdfa0e705369061c3b82f4c9efe657"}
May 21 15:40:07.670418 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.670321    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6" event={"ID":"81c5f2dc-d167-4a65-a7b2-5c7906945d35","Type":"ContainerStarted","Data":"a9ca2c634168cfd6a14bd3be10c61a96099e58abff4628bcbd9f849e0e2bba7f"}
May 21 15:40:07.670514 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.670501    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"
May 21 15:40:07.748931 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.748783    2569 scope.go:117] "RemoveContainer" containerID="055b33ba1bcc106190af0145d837da7ca54cd41fe0e3442fc9071b2299e2394b"
May 21 15:40:07.749271 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:40:07.749167    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"055b33ba1bcc106190af0145d837da7ca54cd41fe0e3442fc9071b2299e2394b\": container with ID starting with 055b33ba1bcc106190af0145d837da7ca54cd41fe0e3442fc9071b2299e2394b not found: ID does not exist" containerID="055b33ba1bcc106190af0145d837da7ca54cd41fe0e3442fc9071b2299e2394b"
May 21 15:40:07.749271 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:07.749230    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"055b33ba1bcc106190af0145d837da7ca54cd41fe0e3442fc9071b2299e2394b"} err="failed to get container status \"055b33ba1bcc106190af0145d837da7ca54cd41fe0e3442fc9071b2299e2394b\": rpc error: code = NotFound desc = could not find container \"055b33ba1bcc106190af0145d837da7ca54cd41fe0e3442fc9071b2299e2394b\": container with ID starting with 055b33ba1bcc106190af0145d837da7ca54cd41fe0e3442fc9071b2299e2394b not found: ID does not exist"
May 21 15:40:08.675916 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:08.675884    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pr625" event={"ID":"41d4488f-9b80-4fef-9315-118582eb6fe1","Type":"ContainerStarted","Data":"13ad41d7c36a862a2f27abfbc0f16f499c9d080908ab6f2195a36d108f7f2cf6"}
May 21 15:40:08.676157 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:08.676131    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pr625"
May 21 15:40:08.712053 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:08.712004    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6" podStartSLOduration=2.711986562 podStartE2EDuration="2.711986562s" podCreationTimestamp="2026-05-21 15:40:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:40:07.728312951 +0000 UTC m=+517.298678064" watchObservedRunningTime="2026-05-21 15:40:08.711986562 +0000 UTC m=+518.282351680"
May 21 15:40:08.713036 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:08.713008    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pr625" podStartSLOduration=1.406004438 podStartE2EDuration="2.712999817s" podCreationTimestamp="2026-05-21 15:40:06 +0000 UTC" firstStartedPulling="2026-05-21 15:40:07.240068652 +0000 UTC m=+516.810433744" lastFinishedPulling="2026-05-21 15:40:08.547064032 +0000 UTC m=+518.117429123" observedRunningTime="2026-05-21 15:40:08.711644135 +0000 UTC m=+518.282009271" watchObservedRunningTime="2026-05-21 15:40:08.712999817 +0000 UTC m=+518.283364929"
May 21 15:40:08.745960 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:08.745886    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"]
May 21 15:40:08.747899 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:08.747881    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"
May 21 15:40:08.783834 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:08.783804    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"]
May 21 15:40:08.821332 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:08.821287    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxwbm\" (UniqueName: \"kubernetes.io/projected/55cbe87d-d0a2-4bb1-a5c4-afc97242aa02-kube-api-access-wxwbm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bx89d\" (UID: \"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"
May 21 15:40:08.821332 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:08.821338    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55cbe87d-d0a2-4bb1-a5c4-afc97242aa02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bx89d\" (UID: \"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"
May 21 15:40:08.922471 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:08.922426    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wxwbm\" (UniqueName: \"kubernetes.io/projected/55cbe87d-d0a2-4bb1-a5c4-afc97242aa02-kube-api-access-wxwbm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bx89d\" (UID: \"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"
May 21 15:40:08.922660 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:08.922481    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55cbe87d-d0a2-4bb1-a5c4-afc97242aa02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bx89d\" (UID: \"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"
May 21 15:40:08.922873 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:08.922849    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55cbe87d-d0a2-4bb1-a5c4-afc97242aa02-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bx89d\" (UID: \"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"
May 21 15:40:08.938622 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:08.938592    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxwbm\" (UniqueName: \"kubernetes.io/projected/55cbe87d-d0a2-4bb1-a5c4-afc97242aa02-kube-api-access-wxwbm\") pod \"kuadrant-operator-controller-manager-55c7f4c975-bx89d\" (UID: \"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"
May 21 15:40:09.058075 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:09.057989    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"
May 21 15:40:09.239800 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:09.239774    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"]
May 21 15:40:09.241338 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:40:09.241312    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55cbe87d_d0a2_4bb1_a5c4_afc97242aa02.slice/crio-7f862fb45be146cfb8eb5af7ea9e55b299009975360d576c1de8adae7a83f672 WatchSource:0}: Error finding container 7f862fb45be146cfb8eb5af7ea9e55b299009975360d576c1de8adae7a83f672: Status 404 returned error can't find the container with id 7f862fb45be146cfb8eb5af7ea9e55b299009975360d576c1de8adae7a83f672
May 21 15:40:09.680675 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:09.680633    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d" event={"ID":"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02","Type":"ContainerStarted","Data":"59033fe58be5580092916c5b155a74566264f60be44240de2d7d395d8025c21f"}
May 21 15:40:09.680675 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:09.680678    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d" event={"ID":"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02","Type":"ContainerStarted","Data":"7f862fb45be146cfb8eb5af7ea9e55b299009975360d576c1de8adae7a83f672"}
May 21 15:40:09.680984 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:09.680967    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"
May 21 15:40:09.703493 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:09.703435    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d" podStartSLOduration=1.703416676 podStartE2EDuration="1.703416676s" podCreationTimestamp="2026-05-21 15:40:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:40:09.701416439 +0000 UTC m=+519.271781762" watchObservedRunningTime="2026-05-21 15:40:09.703416676 +0000 UTC m=+519.273781789"
May 21 15:40:18.678384 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:18.678355    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"
May 21 15:40:19.682987 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:19.682958    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-pr625"
May 21 15:40:20.686664 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:20.686588    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"
May 21 15:40:20.737875 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:20.737829    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"]
May 21 15:40:20.738133 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:20.738078    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6" podUID="81c5f2dc-d167-4a65-a7b2-5c7906945d35" containerName="manager" containerID="cri-o://e94155c1335cd777b692d8712ba213c824cdfa0e705369061c3b82f4c9efe657" gracePeriod=10
May 21 15:40:20.996943 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:20.996918    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"
May 21 15:40:21.127447 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.127414    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b47t8\" (UniqueName: \"kubernetes.io/projected/81c5f2dc-d167-4a65-a7b2-5c7906945d35-kube-api-access-b47t8\") pod \"81c5f2dc-d167-4a65-a7b2-5c7906945d35\" (UID: \"81c5f2dc-d167-4a65-a7b2-5c7906945d35\") "
May 21 15:40:21.127605 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.127478    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c5f2dc-d167-4a65-a7b2-5c7906945d35-extensions-socket-volume\") pod \"81c5f2dc-d167-4a65-a7b2-5c7906945d35\" (UID: \"81c5f2dc-d167-4a65-a7b2-5c7906945d35\") "
May 21 15:40:21.127852 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.127831    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81c5f2dc-d167-4a65-a7b2-5c7906945d35-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "81c5f2dc-d167-4a65-a7b2-5c7906945d35" (UID: "81c5f2dc-d167-4a65-a7b2-5c7906945d35"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 15:40:21.129537 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.129513    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81c5f2dc-d167-4a65-a7b2-5c7906945d35-kube-api-access-b47t8" (OuterVolumeSpecName: "kube-api-access-b47t8") pod "81c5f2dc-d167-4a65-a7b2-5c7906945d35" (UID: "81c5f2dc-d167-4a65-a7b2-5c7906945d35"). InnerVolumeSpecName "kube-api-access-b47t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:40:21.228717 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.228681    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/81c5f2dc-d167-4a65-a7b2-5c7906945d35-extensions-socket-volume\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:40:21.228717 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.228713    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b47t8\" (UniqueName: \"kubernetes.io/projected/81c5f2dc-d167-4a65-a7b2-5c7906945d35-kube-api-access-b47t8\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:40:21.727901 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.727865    2569 generic.go:358] "Generic (PLEG): container finished" podID="81c5f2dc-d167-4a65-a7b2-5c7906945d35" containerID="e94155c1335cd777b692d8712ba213c824cdfa0e705369061c3b82f4c9efe657" exitCode=0
May 21 15:40:21.728363 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.727954    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6" event={"ID":"81c5f2dc-d167-4a65-a7b2-5c7906945d35","Type":"ContainerDied","Data":"e94155c1335cd777b692d8712ba213c824cdfa0e705369061c3b82f4c9efe657"}
May 21 15:40:21.728363 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.727969    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"
May 21 15:40:21.728363 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.727991    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6" event={"ID":"81c5f2dc-d167-4a65-a7b2-5c7906945d35","Type":"ContainerDied","Data":"a9ca2c634168cfd6a14bd3be10c61a96099e58abff4628bcbd9f849e0e2bba7f"}
May 21 15:40:21.728363 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.728006    2569 scope.go:117] "RemoveContainer" containerID="e94155c1335cd777b692d8712ba213c824cdfa0e705369061c3b82f4c9efe657"
May 21 15:40:21.737000 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.736809    2569 scope.go:117] "RemoveContainer" containerID="e94155c1335cd777b692d8712ba213c824cdfa0e705369061c3b82f4c9efe657"
May 21 15:40:21.738105 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:40:21.737321    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e94155c1335cd777b692d8712ba213c824cdfa0e705369061c3b82f4c9efe657\": container with ID starting with e94155c1335cd777b692d8712ba213c824cdfa0e705369061c3b82f4c9efe657 not found: ID does not exist" containerID="e94155c1335cd777b692d8712ba213c824cdfa0e705369061c3b82f4c9efe657"
May 21 15:40:21.738105 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.737353    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e94155c1335cd777b692d8712ba213c824cdfa0e705369061c3b82f4c9efe657"} err="failed to get container status \"e94155c1335cd777b692d8712ba213c824cdfa0e705369061c3b82f4c9efe657\": rpc error: code = NotFound desc = could not find container \"e94155c1335cd777b692d8712ba213c824cdfa0e705369061c3b82f4c9efe657\": container with ID starting with e94155c1335cd777b692d8712ba213c824cdfa0e705369061c3b82f4c9efe657 not found: ID does not exist"
May 21 15:40:21.748819 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.748797    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"]
May 21 15:40:21.755037 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:21.755012    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-sv9n6"]
May 21 15:40:23.025445 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:40:23.025408    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81c5f2dc-d167-4a65-a7b2-5c7906945d35" path="/var/lib/kubelet/pods/81c5f2dc-d167-4a65-a7b2-5c7906945d35/volumes"
May 21 15:41:30.913979 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:41:30.913950    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:41:30.914729 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:41:30.914712    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:43:39.032576 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.032495    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"]
May 21 15:43:39.033004 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.032854    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81c5f2dc-d167-4a65-a7b2-5c7906945d35" containerName="manager"
May 21 15:43:39.033004 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.032867    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="81c5f2dc-d167-4a65-a7b2-5c7906945d35" containerName="manager"
May 21 15:43:39.033004 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.032914    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="81c5f2dc-d167-4a65-a7b2-5c7906945d35" containerName="manager"
May 21 15:43:39.035785 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.035765    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.038975 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.038951    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n6hht\""
May 21 15:43:39.039111 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.038955    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 15:43:39.039111 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.039031    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 15:43:39.039111 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.038958    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 21 15:43:39.045051 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.045030    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"]
May 21 15:43:39.136488 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.136449    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.136646 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.136501    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njwnq\" (UniqueName: \"kubernetes.io/projected/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-kube-api-access-njwnq\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.136646 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.136532    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.136646 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.136569    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.136646 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.136594    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.136646 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.136634    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.237483 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.237448    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.237656 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.237499    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.237656 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.237533    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njwnq\" (UniqueName: \"kubernetes.io/projected/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-kube-api-access-njwnq\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.237656 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.237557    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.237656 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.237602    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.237656 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.237627    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.237954 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.237926    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.238054 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.238023    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.238281 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.238065    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.240245 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.240218    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.240349 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.240306    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.246554 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.246483    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njwnq\" (UniqueName: \"kubernetes.io/projected/911c72db-5452-4b91-b1c1-3ce3c4fd6c0e-kube-api-access-njwnq\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-m7pph\" (UID: \"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.345648 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.345563    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:39.493578 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.493516    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"]
May 21 15:43:39.500502 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:43:39.500473    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911c72db_5452_4b91_b1c1_3ce3c4fd6c0e.slice/crio-de667272186e127e6f611bfe48ab5b75a4aa4f9a8140eeca7a5cdf17652d3fcd WatchSource:0}: Error finding container de667272186e127e6f611bfe48ab5b75a4aa4f9a8140eeca7a5cdf17652d3fcd: Status 404 returned error can't find the container with id de667272186e127e6f611bfe48ab5b75a4aa4f9a8140eeca7a5cdf17652d3fcd
May 21 15:43:39.502280 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:39.502260    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 15:43:40.360339 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:40.360297    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph" event={"ID":"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e","Type":"ContainerStarted","Data":"de667272186e127e6f611bfe48ab5b75a4aa4f9a8140eeca7a5cdf17652d3fcd"}
May 21 15:43:43.732530 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.732447    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"]
May 21 15:43:43.756229 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.756197    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"]
May 21 15:43:43.756398 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.756352    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.758804 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.758776    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 21 15:43:43.879167 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.879135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9427-1a0b-426b-88b6-d4eb38985efb-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.879350 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.879180    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3e9427-1a0b-426b-88b6-d4eb38985efb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.879350 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.879261    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42cbw\" (UniqueName: \"kubernetes.io/projected/bc3e9427-1a0b-426b-88b6-d4eb38985efb-kube-api-access-42cbw\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.879350 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.879292    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9427-1a0b-426b-88b6-d4eb38985efb-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.879350 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.879336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9427-1a0b-426b-88b6-d4eb38985efb-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.879508 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.879371    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9427-1a0b-426b-88b6-d4eb38985efb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.979811 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.979776    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9427-1a0b-426b-88b6-d4eb38985efb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.979969 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.979828    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9427-1a0b-426b-88b6-d4eb38985efb-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.979969 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.979849    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3e9427-1a0b-426b-88b6-d4eb38985efb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.979969 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.979887    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42cbw\" (UniqueName: \"kubernetes.io/projected/bc3e9427-1a0b-426b-88b6-d4eb38985efb-kube-api-access-42cbw\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.980096 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.980009    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9427-1a0b-426b-88b6-d4eb38985efb-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.980096 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.980065    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9427-1a0b-426b-88b6-d4eb38985efb-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.980218 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.980173    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9427-1a0b-426b-88b6-d4eb38985efb-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.980343 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.980322    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9427-1a0b-426b-88b6-d4eb38985efb-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.980427 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.980407    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9427-1a0b-426b-88b6-d4eb38985efb-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.982487 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.982408    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bc3e9427-1a0b-426b-88b6-d4eb38985efb-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.982641 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.982546    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bc3e9427-1a0b-426b-88b6-d4eb38985efb-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:43.990301 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:43.990274    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42cbw\" (UniqueName: \"kubernetes.io/projected/bc3e9427-1a0b-426b-88b6-d4eb38985efb-kube-api-access-42cbw\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv\" (UID: \"bc3e9427-1a0b-426b-88b6-d4eb38985efb\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:44.069852 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:44.069799    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:45.296795 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:45.296761    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"]
May 21 15:43:45.299843 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:43:45.299803    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc3e9427_1a0b_426b_88b6_d4eb38985efb.slice/crio-20a2cc366c074ef0383ea9e70d187f83e4dbf5a8b83421cccb6bf9ab8b800dad WatchSource:0}: Error finding container 20a2cc366c074ef0383ea9e70d187f83e4dbf5a8b83421cccb6bf9ab8b800dad: Status 404 returned error can't find the container with id 20a2cc366c074ef0383ea9e70d187f83e4dbf5a8b83421cccb6bf9ab8b800dad
May 21 15:43:45.381329 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:45.381291    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv" event={"ID":"bc3e9427-1a0b-426b-88b6-d4eb38985efb","Type":"ContainerStarted","Data":"6527ff34b6d0db8a0c1c2569422b414d6ae462571e12c4985d87d57a8ddc560c"}
May 21 15:43:45.381493 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:45.381338    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv" event={"ID":"bc3e9427-1a0b-426b-88b6-d4eb38985efb","Type":"ContainerStarted","Data":"20a2cc366c074ef0383ea9e70d187f83e4dbf5a8b83421cccb6bf9ab8b800dad"}
May 21 15:43:45.382684 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:45.382637    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph" event={"ID":"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e","Type":"ContainerStarted","Data":"3534892b4f79586c2e6e335c35b77000606a2367b93ac00dc69a6a4d82b4c8f2"}
May 21 15:43:51.405634 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:51.405599    2569 generic.go:358] "Generic (PLEG): container finished" podID="bc3e9427-1a0b-426b-88b6-d4eb38985efb" containerID="6527ff34b6d0db8a0c1c2569422b414d6ae462571e12c4985d87d57a8ddc560c" exitCode=0
May 21 15:43:51.406014 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:51.405674    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv" event={"ID":"bc3e9427-1a0b-426b-88b6-d4eb38985efb","Type":"ContainerDied","Data":"6527ff34b6d0db8a0c1c2569422b414d6ae462571e12c4985d87d57a8ddc560c"}
May 21 15:43:53.417287 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:53.417250    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv" event={"ID":"bc3e9427-1a0b-426b-88b6-d4eb38985efb","Type":"ContainerStarted","Data":"4142f45f51081305724acc95d7d6952f44a7a90d846be92ec335aceaca445c37"}
May 21 15:43:53.417678 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:53.417484    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:43:53.436609 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:53.436546    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv" podStartSLOduration=9.036986997 podStartE2EDuration="10.436526287s" podCreationTimestamp="2026-05-21 15:43:43 +0000 UTC" firstStartedPulling="2026-05-21 15:43:51.406373856 +0000 UTC m=+740.976738949" lastFinishedPulling="2026-05-21 15:43:52.805913145 +0000 UTC m=+742.376278239" observedRunningTime="2026-05-21 15:43:53.435047289 +0000 UTC m=+743.005412401" watchObservedRunningTime="2026-05-21 15:43:53.436526287 +0000 UTC m=+743.006891401"
May 21 15:43:54.422404 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:54.422372    2569 generic.go:358] "Generic (PLEG): container finished" podID="911c72db-5452-4b91-b1c1-3ce3c4fd6c0e" containerID="3534892b4f79586c2e6e335c35b77000606a2367b93ac00dc69a6a4d82b4c8f2" exitCode=0
May 21 15:43:54.422790 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:54.422443    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph" event={"ID":"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e","Type":"ContainerDied","Data":"3534892b4f79586c2e6e335c35b77000606a2367b93ac00dc69a6a4d82b4c8f2"}
May 21 15:43:55.427027 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:55.426991    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph" event={"ID":"911c72db-5452-4b91-b1c1-3ce3c4fd6c0e","Type":"ContainerStarted","Data":"32fbd170e98c6ed1a1cbe4e4afb8a2a7c74e3045ccd2fca4a07d984c0d806e11"}
May 21 15:43:55.427477 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:55.427195    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:43:55.445488 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:43:55.445446    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph" podStartSLOduration=1.306023423 podStartE2EDuration="16.445432906s" podCreationTimestamp="2026-05-21 15:43:39 +0000 UTC" firstStartedPulling="2026-05-21 15:43:39.50244681 +0000 UTC m=+729.072811926" lastFinishedPulling="2026-05-21 15:43:54.641856318 +0000 UTC m=+744.212221409" observedRunningTime="2026-05-21 15:43:55.444367443 +0000 UTC m=+745.014732594" watchObservedRunningTime="2026-05-21 15:43:55.445432906 +0000 UTC m=+745.015797997"
May 21 15:44:04.436083 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:44:04.436048    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv"
May 21 15:44:06.443491 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:44:06.443456    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-m7pph"
May 21 15:46:30.934611 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:46:30.934530    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:46:30.937011 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:46:30.936981    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:51:30.955471 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:51:30.955442    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:51:30.959569 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:51:30.959548    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:56:25.390265 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:25.390229    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"]
May 21 15:56:25.391718 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:25.390475    2569 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d" podUID="55cbe87d-d0a2-4bb1-a5c4-afc97242aa02" containerName="manager" containerID="cri-o://59033fe58be5580092916c5b155a74566264f60be44240de2d7d395d8025c21f" gracePeriod=10
May 21 15:56:26.044702 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.044680    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"
May 21 15:56:26.137016 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.136984    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55cbe87d-d0a2-4bb1-a5c4-afc97242aa02-extensions-socket-volume\") pod \"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02\" (UID: \"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02\") "
May 21 15:56:26.137194 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.137094    2569 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxwbm\" (UniqueName: \"kubernetes.io/projected/55cbe87d-d0a2-4bb1-a5c4-afc97242aa02-kube-api-access-wxwbm\") pod \"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02\" (UID: \"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02\") "
May 21 15:56:26.137403 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.137374    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55cbe87d-d0a2-4bb1-a5c4-afc97242aa02-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "55cbe87d-d0a2-4bb1-a5c4-afc97242aa02" (UID: "55cbe87d-d0a2-4bb1-a5c4-afc97242aa02"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 15:56:26.139089 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.139068    2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55cbe87d-d0a2-4bb1-a5c4-afc97242aa02-kube-api-access-wxwbm" (OuterVolumeSpecName: "kube-api-access-wxwbm") pod "55cbe87d-d0a2-4bb1-a5c4-afc97242aa02" (UID: "55cbe87d-d0a2-4bb1-a5c4-afc97242aa02"). InnerVolumeSpecName "kube-api-access-wxwbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 15:56:26.238515 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.238484    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxwbm\" (UniqueName: \"kubernetes.io/projected/55cbe87d-d0a2-4bb1-a5c4-afc97242aa02-kube-api-access-wxwbm\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:56:26.238515 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.238510    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55cbe87d-d0a2-4bb1-a5c4-afc97242aa02-extensions-socket-volume\") on node \"ip-10-0-135-228.ec2.internal\" DevicePath \"\""
May 21 15:56:26.907113 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.907070    2569 generic.go:358] "Generic (PLEG): container finished" podID="55cbe87d-d0a2-4bb1-a5c4-afc97242aa02" containerID="59033fe58be5580092916c5b155a74566264f60be44240de2d7d395d8025c21f" exitCode=0
May 21 15:56:26.907568 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.907159    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d" event={"ID":"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02","Type":"ContainerDied","Data":"59033fe58be5580092916c5b155a74566264f60be44240de2d7d395d8025c21f"}
May 21 15:56:26.907568 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.907180    2569 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"
May 21 15:56:26.907568 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.907203    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d" event={"ID":"55cbe87d-d0a2-4bb1-a5c4-afc97242aa02","Type":"ContainerDied","Data":"7f862fb45be146cfb8eb5af7ea9e55b299009975360d576c1de8adae7a83f672"}
May 21 15:56:26.907568 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.907219    2569 scope.go:117] "RemoveContainer" containerID="59033fe58be5580092916c5b155a74566264f60be44240de2d7d395d8025c21f"
May 21 15:56:26.915980 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.915961    2569 scope.go:117] "RemoveContainer" containerID="59033fe58be5580092916c5b155a74566264f60be44240de2d7d395d8025c21f"
May 21 15:56:26.916503 ip-10-0-135-228 kubenswrapper[2569]: E0521 15:56:26.916479    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59033fe58be5580092916c5b155a74566264f60be44240de2d7d395d8025c21f\": container with ID starting with 59033fe58be5580092916c5b155a74566264f60be44240de2d7d395d8025c21f not found: ID does not exist" containerID="59033fe58be5580092916c5b155a74566264f60be44240de2d7d395d8025c21f"
May 21 15:56:26.916587 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.916511    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59033fe58be5580092916c5b155a74566264f60be44240de2d7d395d8025c21f"} err="failed to get container status \"59033fe58be5580092916c5b155a74566264f60be44240de2d7d395d8025c21f\": rpc error: code = NotFound desc = could not find container \"59033fe58be5580092916c5b155a74566264f60be44240de2d7d395d8025c21f\": container with ID starting with 59033fe58be5580092916c5b155a74566264f60be44240de2d7d395d8025c21f not found: ID does not exist"
May 21 15:56:26.929892 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.929866    2569 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"]
May 21 15:56:26.933608 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:26.933586    2569 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-bx89d"]
May 21 15:56:27.025017 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:27.024983    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55cbe87d-d0a2-4bb1-a5c4-afc97242aa02" path="/var/lib/kubelet/pods/55cbe87d-d0a2-4bb1-a5c4-afc97242aa02/volumes"
May 21 15:56:30.976206 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:30.976173    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:56:30.983496 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:56:30.983471    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 15:57:31.489153 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.489101    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq"]
May 21 15:57:31.489623 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.489427    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55cbe87d-d0a2-4bb1-a5c4-afc97242aa02" containerName="manager"
May 21 15:57:31.489623 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.489438    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="55cbe87d-d0a2-4bb1-a5c4-afc97242aa02" containerName="manager"
May 21 15:57:31.489623 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.489491    2569 memory_manager.go:356] "RemoveStaleState removing state" podUID="55cbe87d-d0a2-4bb1-a5c4-afc97242aa02" containerName="manager"
May 21 15:57:31.491228 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.491208    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq"
May 21 15:57:31.494877 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.494855    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lrczq\""
May 21 15:57:31.503652 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.503626    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq"]
May 21 15:57:31.577960 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.577918    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e4a8be7-e29d-474d-bc42-ee5de4058771-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7s7qq\" (UID: \"0e4a8be7-e29d-474d-bc42-ee5de4058771\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq"
May 21 15:57:31.578156 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.578025    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcmv5\" (UniqueName: \"kubernetes.io/projected/0e4a8be7-e29d-474d-bc42-ee5de4058771-kube-api-access-fcmv5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7s7qq\" (UID: \"0e4a8be7-e29d-474d-bc42-ee5de4058771\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq"
May 21 15:57:31.678899 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.678849    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e4a8be7-e29d-474d-bc42-ee5de4058771-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7s7qq\" (UID: \"0e4a8be7-e29d-474d-bc42-ee5de4058771\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq"
May 21 15:57:31.679096 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.678928    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcmv5\" (UniqueName: \"kubernetes.io/projected/0e4a8be7-e29d-474d-bc42-ee5de4058771-kube-api-access-fcmv5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7s7qq\" (UID: \"0e4a8be7-e29d-474d-bc42-ee5de4058771\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq"
May 21 15:57:31.679308 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.679283    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e4a8be7-e29d-474d-bc42-ee5de4058771-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7s7qq\" (UID: \"0e4a8be7-e29d-474d-bc42-ee5de4058771\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq"
May 21 15:57:31.686701 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.686674    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcmv5\" (UniqueName: \"kubernetes.io/projected/0e4a8be7-e29d-474d-bc42-ee5de4058771-kube-api-access-fcmv5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-7s7qq\" (UID: \"0e4a8be7-e29d-474d-bc42-ee5de4058771\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq"
May 21 15:57:31.800818 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.800732    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq"
May 21 15:57:31.938922 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.938767    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq"]
May 21 15:57:31.941791 ip-10-0-135-228 kubenswrapper[2569]: W0521 15:57:31.941762    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4a8be7_e29d_474d_bc42_ee5de4058771.slice/crio-4a12b3a66f9310b94ab70e6f86d52a2615a2d190b54a59d3f4350f64678213cb WatchSource:0}: Error finding container 4a12b3a66f9310b94ab70e6f86d52a2615a2d190b54a59d3f4350f64678213cb: Status 404 returned error can't find the container with id 4a12b3a66f9310b94ab70e6f86d52a2615a2d190b54a59d3f4350f64678213cb
May 21 15:57:31.944041 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:31.944021    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 15:57:32.119613 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:32.119577    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq" event={"ID":"0e4a8be7-e29d-474d-bc42-ee5de4058771","Type":"ContainerStarted","Data":"54bdb0bf0791ffc4b189329f9fa24844d0b3e874c3dba3c8ea333ad1b6bd51ca"}
May 21 15:57:32.119613 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:32.119615    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq" event={"ID":"0e4a8be7-e29d-474d-bc42-ee5de4058771","Type":"ContainerStarted","Data":"4a12b3a66f9310b94ab70e6f86d52a2615a2d190b54a59d3f4350f64678213cb"}
May 21 15:57:32.119823 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:32.119712    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq"
May 21 15:57:32.140588 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:32.140545    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq" podStartSLOduration=1.140532224 podStartE2EDuration="1.140532224s" podCreationTimestamp="2026-05-21 15:57:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 15:57:32.13972524 +0000 UTC m=+1561.710090353" watchObservedRunningTime="2026-05-21 15:57:32.140532224 +0000 UTC m=+1561.710897338"
May 21 15:57:43.125361 ip-10-0-135-228 kubenswrapper[2569]: I0521 15:57:43.125323    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-7s7qq"
May 21 16:01:31.007076 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:01:31.007045    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 16:01:31.011963 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:01:31.011939    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 16:06:31.030546 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:06:31.030516    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 16:06:31.035464 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:06:31.035443    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 16:07:18.633521 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:18.633487    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-rd9mr_db9af592-f3a7-4dfc-86a5-06a71439979e/manager/0.log"
May 21 16:07:18.996864 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:18.996749    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-djmk6_57390d58-a915-4066-9a6e-09981c60ac3a/manager/2.log"
May 21 16:07:19.107869 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:19.107839    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5544b565-95wzd_e2c0b9d1-51bf-4736-836a-d98a8b6ad060/manager/0.log"
May 21 16:07:20.932434 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:20.932354    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-6kz26_9bc91ec3-5f25-4408-9923-b7b7d49219bb/manager/0.log"
May 21 16:07:21.272307 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:21.272220    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-7s7qq_0e4a8be7-e29d-474d-bc42-ee5de4058771/manager/0.log"
May 21 16:07:21.498204 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:21.498169    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-pr625_41d4488f-9b80-4fef-9315-118582eb6fe1/manager/0.log"
May 21 16:07:21.946562 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:21.946530    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-w9v89_1990905a-691a-48e5-b0a0-aa929b69b77a/discovery/0.log"
May 21 16:07:22.155600 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:22.155569    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bc586767c-jt5tp_949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d/kube-auth-proxy/0.log"
May 21 16:07:23.308239 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:23.308210    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv_bc3e9427-1a0b-426b-88b6-d4eb38985efb/storage-initializer/0.log"
May 21 16:07:23.316031 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:23.316006    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-fzcnv_bc3e9427-1a0b-426b-88b6-d4eb38985efb/main/0.log"
May 21 16:07:23.442444 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:23.442412    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-m7pph_911c72db-5452-4b91-b1c1-3ce3c4fd6c0e/storage-initializer/0.log"
May 21 16:07:23.450815 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:23.450790    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-m7pph_911c72db-5452-4b91-b1c1-3ce3c4fd6c0e/main/0.log"
May 21 16:07:30.304110 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:30.304071    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jqksv_1146ae6f-be79-4860-889b-38ed20369c04/global-pull-secret-syncer/0.log"
May 21 16:07:30.452505 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:30.452476    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jn5f7_960c4f63-b8b9-4b57-b57c-a0f90791c561/konnectivity-agent/0.log"
May 21 16:07:30.498017 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:30.497986    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-228.ec2.internal_84c8e4097af05703cff843eeadfd9be2/haproxy/0.log"
May 21 16:07:35.006342 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:35.006310    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-6kz26_9bc91ec3-5f25-4408-9923-b7b7d49219bb/manager/0.log"
May 21 16:07:35.155166 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:35.155112    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-7s7qq_0e4a8be7-e29d-474d-bc42-ee5de4058771/manager/0.log"
May 21 16:07:35.295536 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:35.295449    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-pr625_41d4488f-9b80-4fef-9315-118582eb6fe1/manager/0.log"
May 21 16:07:37.075206 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:37.075178    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cg4hz_987c4315-162b-49a3-a91f-d550a74aedbe/node-exporter/0.log"
May 21 16:07:37.097314 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:37.097290    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cg4hz_987c4315-162b-49a3-a91f-d550a74aedbe/kube-rbac-proxy/0.log"
May 21 16:07:37.117234 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:37.117213    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cg4hz_987c4315-162b-49a3-a91f-d550a74aedbe/init-textfile/0.log"
May 21 16:07:38.877850 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:38.877813    2569 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"]
May 21 16:07:38.881353 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:38.881333    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:38.883429 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:38.883406    2569 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p2kzh\"/\"default-dockercfg-8bcrl\""
May 21 16:07:38.883546 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:38.883439    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2kzh\"/\"kube-root-ca.crt\""
May 21 16:07:38.884167 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:38.884151    2569 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2kzh\"/\"openshift-service-ca.crt\""
May 21 16:07:38.887374 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:38.887344    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"]
May 21 16:07:38.933480 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:38.933443    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86q7d\" (UniqueName: \"kubernetes.io/projected/b8244a43-d43e-4eaa-9080-c339a7eb05df-kube-api-access-86q7d\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:38.933658 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:38.933493    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8244a43-d43e-4eaa-9080-c339a7eb05df-podres\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:38.933658 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:38.933524    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8244a43-d43e-4eaa-9080-c339a7eb05df-sys\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:38.933658 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:38.933549    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8244a43-d43e-4eaa-9080-c339a7eb05df-proc\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:38.933797 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:38.933677    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8244a43-d43e-4eaa-9080-c339a7eb05df-lib-modules\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:38.938432 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:38.938406    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-t7xs6_66b1e4a6-a9d4-411c-9eb6-786ddc7ba269/networking-console-plugin/0.log"
May 21 16:07:39.034358 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:39.034327    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8244a43-d43e-4eaa-9080-c339a7eb05df-lib-modules\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:39.034544 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:39.034371    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-86q7d\" (UniqueName: \"kubernetes.io/projected/b8244a43-d43e-4eaa-9080-c339a7eb05df-kube-api-access-86q7d\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:39.034544 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:39.034398    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8244a43-d43e-4eaa-9080-c339a7eb05df-podres\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:39.034544 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:39.034419    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8244a43-d43e-4eaa-9080-c339a7eb05df-sys\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:39.034544 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:39.034436    2569 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8244a43-d43e-4eaa-9080-c339a7eb05df-proc\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:39.034544 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:39.034505    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b8244a43-d43e-4eaa-9080-c339a7eb05df-proc\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:39.034544 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:39.034503    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b8244a43-d43e-4eaa-9080-c339a7eb05df-lib-modules\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:39.034544 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:39.034529    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b8244a43-d43e-4eaa-9080-c339a7eb05df-sys\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:39.034781 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:39.034544    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b8244a43-d43e-4eaa-9080-c339a7eb05df-podres\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:39.042742 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:39.042706    2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86q7d\" (UniqueName: \"kubernetes.io/projected/b8244a43-d43e-4eaa-9080-c339a7eb05df-kube-api-access-86q7d\") pod \"perf-node-gather-daemonset-rpclt\" (UID: \"b8244a43-d43e-4eaa-9080-c339a7eb05df\") " pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:39.193417 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:39.193322    2569 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:39.321669 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:39.321635    2569 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"]
May 21 16:07:39.324878 ip-10-0-135-228 kubenswrapper[2569]: W0521 16:07:39.324849    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb8244a43_d43e_4eaa_9080_c339a7eb05df.slice/crio-d8d6adee55be3ab380b738d7c0a3d2f99a9277efac3b019d47304896e7885cd8 WatchSource:0}: Error finding container d8d6adee55be3ab380b738d7c0a3d2f99a9277efac3b019d47304896e7885cd8: Status 404 returned error can't find the container with id d8d6adee55be3ab380b738d7c0a3d2f99a9277efac3b019d47304896e7885cd8
May 21 16:07:39.326465 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:39.326445    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 16:07:40.139180 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:40.139144    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt" event={"ID":"b8244a43-d43e-4eaa-9080-c339a7eb05df","Type":"ContainerStarted","Data":"6fce8e91531a92fa791689bd78b6dfdfcaeb0df9971d5bfd7b63fdeaec2caf65"}
May 21 16:07:40.139180 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:40.139186    2569 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt" event={"ID":"b8244a43-d43e-4eaa-9080-c339a7eb05df","Type":"ContainerStarted","Data":"d8d6adee55be3ab380b738d7c0a3d2f99a9277efac3b019d47304896e7885cd8"}
May 21 16:07:40.139671 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:40.139205    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:40.153832 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:40.153784    2569 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt" podStartSLOduration=2.153766506 podStartE2EDuration="2.153766506s" podCreationTimestamp="2026-05-21 16:07:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 16:07:40.152936948 +0000 UTC m=+2169.723302061" watchObservedRunningTime="2026-05-21 16:07:40.153766506 +0000 UTC m=+2169.724131620"
May 21 16:07:41.314774 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:41.314743    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4m6jg_c0d3583c-f875-4e3b-b92b-5c68a8d24226/dns/0.log"
May 21 16:07:41.333354 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:41.333330    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4m6jg_c0d3583c-f875-4e3b-b92b-5c68a8d24226/kube-rbac-proxy/0.log"
May 21 16:07:41.450027 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:41.449998    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2kc9w_aa952ca3-14e6-4a2b-8b6d-200407069d9a/dns-node-resolver/0.log"
May 21 16:07:42.017930 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:42.017901    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7rj7l_9a98a1f8-3069-4b7d-9709-95b0b4a4652d/node-ca/0.log"
May 21 16:07:43.062788 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:43.062750    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-w9v89_1990905a-691a-48e5-b0a0-aa929b69b77a/discovery/0.log"
May 21 16:07:43.104985 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:43.104954    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bc586767c-jt5tp_949495c7-6d54-4b91-bdb4-9c8c3f0e2f9d/kube-auth-proxy/0.log"
May 21 16:07:43.768237 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:43.768204    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pxm7h_43637790-37ab-4877-bf45-1c61fa8909e5/serve-healthcheck-canary/0.log"
May 21 16:07:44.228591 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:44.228561    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2xmq2_efcee921-20bb-4c9f-a677-8220cf42d49c/kube-rbac-proxy/0.log"
May 21 16:07:44.247173 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:44.247151    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2xmq2_efcee921-20bb-4c9f-a677-8220cf42d49c/exporter/0.log"
May 21 16:07:44.266794 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:44.266769    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2xmq2_efcee921-20bb-4c9f-a677-8220cf42d49c/extractor/0.log"
May 21 16:07:46.151317 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:46.151293    2569 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p2kzh/perf-node-gather-daemonset-rpclt"
May 21 16:07:46.324040 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:46.324011    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-rd9mr_db9af592-f3a7-4dfc-86a5-06a71439979e/manager/0.log"
May 21 16:07:46.465101 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:46.465021    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-djmk6_57390d58-a915-4066-9a6e-09981c60ac3a/manager/1.log"
May 21 16:07:46.486009 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:46.485977    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-djmk6_57390d58-a915-4066-9a6e-09981c60ac3a/manager/2.log"
May 21 16:07:46.506697 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:46.506668    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5544b565-95wzd_e2c0b9d1-51bf-4736-836a-d98a8b6ad060/manager/0.log"
May 21 16:07:53.822652 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:53.822618    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89lm9_844ed311-7755-4dd5-8f12-7049aaa3f8bf/kube-multus-additional-cni-plugins/0.log"
May 21 16:07:53.843053 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:53.843027    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89lm9_844ed311-7755-4dd5-8f12-7049aaa3f8bf/egress-router-binary-copy/0.log"
May 21 16:07:53.867793 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:53.867769    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89lm9_844ed311-7755-4dd5-8f12-7049aaa3f8bf/cni-plugins/0.log"
May 21 16:07:53.912854 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:53.912828    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89lm9_844ed311-7755-4dd5-8f12-7049aaa3f8bf/bond-cni-plugin/0.log"
May 21 16:07:53.935086 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:53.935056    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89lm9_844ed311-7755-4dd5-8f12-7049aaa3f8bf/routeoverride-cni/0.log"
May 21 16:07:53.956112 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:53.956093    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89lm9_844ed311-7755-4dd5-8f12-7049aaa3f8bf/whereabouts-cni-bincopy/0.log"
May 21 16:07:53.975402 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:53.975380    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-89lm9_844ed311-7755-4dd5-8f12-7049aaa3f8bf/whereabouts-cni/0.log"
May 21 16:07:54.360060 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:54.360027    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dcqgg_21a1cf79-c675-4148-bad3-7dd74906f7d0/kube-multus/0.log"
May 21 16:07:54.409574 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:54.409537    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g7zsx_5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7/network-metrics-daemon/0.log"
May 21 16:07:54.430849 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:54.430815    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g7zsx_5a21a83c-ea1a-4d30-99f6-0ae601b4bfd7/kube-rbac-proxy/0.log"
May 21 16:07:55.662494 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:55.662467    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-controller/0.log"
May 21 16:07:55.678470 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:55.678443    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/0.log"
May 21 16:07:55.698050 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:55.698024    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovn-acl-logging/1.log"
May 21 16:07:55.720608 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:55.720582    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/kube-rbac-proxy-node/0.log"
May 21 16:07:55.742569 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:55.742546    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/kube-rbac-proxy-ovn-metrics/0.log"
May 21 16:07:55.758430 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:55.758406    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/northd/0.log"
May 21 16:07:55.777089 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:55.777068    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/nbdb/0.log"
May 21 16:07:55.797154 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:55.797115    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/sbdb/0.log"
May 21 16:07:55.957849 ip-10-0-135-228 kubenswrapper[2569]: I0521 16:07:55.957775    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5nwgj_11df5362-95e9-46d0-a74e-475d26d60112/ovnkube-controller/0.log"