Jul 20 22:20:51.377486 ip-10-0-128-108 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 20 22:20:51.377500 ip-10-0-128-108 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 20 22:20:51.377510 ip-10-0-128-108 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 20 22:20:51.377988 ip-10-0-128-108 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 20 22:21:01.799957 ip-10-0-128-108 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 20 22:21:01.799970 ip-10-0-128-108 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 52f8b22bd2ec489b8c701af60ce5185f --
Jul 20 22:22:49.775619 ip-10-0-128-108 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 22:22:50.147105 ip-10-0-128-108 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 22:22:50.147105 ip-10-0-128-108 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 22:22:50.147105 ip-10-0-128-108 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 22:22:50.147105 ip-10-0-128-108 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 22:22:50.147105 ip-10-0-128-108 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 22:22:50.148054 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.147964    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 22:22:50.152256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152239    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:22:50.152256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152256    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152260    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152263    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152267    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152272    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152276    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152279    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152283    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152286    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152288    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152292    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152295    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152315    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152319    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152323    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152326    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152329    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152332    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152340    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:22:50.152337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152343    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152346    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152349    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152352    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152355    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152357    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152360    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152362    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152365    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152368    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152370    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152373    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152375    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152378    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152380    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152383    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152386    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152388    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152392    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152395    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:22:50.152797 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152397    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152399    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152402    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152405    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152407    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152409    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152412    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152414    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152417    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152419    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152422    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152425    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152427    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152430    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152433    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152436    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152438    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152441    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152443    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152446    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:22:50.153273 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152448    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152451    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152453    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152456    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152458    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152461    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152469    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152473    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152476    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152479    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152481    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152485    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152489    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152491    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152494    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152497    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152500    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152502    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152505    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:22:50.153761 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152509    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152513    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152516    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152519    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152521    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152526    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152529    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152533    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152536    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152539    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152542    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152544    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152547    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152550    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152552    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152555    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152557    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152560    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152563    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.152565    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:22:50.154212 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154143    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154151    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154154    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154157    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154160    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154163    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154166    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154170    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154173    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154176    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154179    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154182    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154185    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154187    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154190    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154193    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154195    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154198    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154201    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154205    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:22:50.154705 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154207    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154210    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154213    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154215    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154218    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154220    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154223    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154226    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154228    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154231    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154233    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154236    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154238    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154241    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154243    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154246    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154249    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154251    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154254    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154258    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:22:50.155194 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154260    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154263    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154265    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154268    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154270    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154273    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154276    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154278    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154281    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154284    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154286    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154294    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154311    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154315    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154317    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154320    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154324    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154326    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154329    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:22:50.155694 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154332    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154334    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154337    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154339    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154342    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154357    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154362    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154365    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154368    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154370    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154373    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154376    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154379    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154381    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154384    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154386    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154389    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154391    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154394    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:22:50.156156 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154396    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154399    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154401    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154404    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154407    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154411    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154415    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154418    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154421    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154424    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154427    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154430    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154433    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154435    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154438    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154441    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154444    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154446    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154449    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:22:50.156650 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154452    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154454    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154816    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154821    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154823    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154826    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154829    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154832    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154834    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154838    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154840    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154843    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154845    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154848    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154850    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154853    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154855    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154859    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154863    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:22:50.157107 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154867    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154871    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154875    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154878    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154880    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154883    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154886    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154888    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154891    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154893    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154896    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154898    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154901    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154903    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154905    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154908    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154910    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154913    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154915    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154918    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:22:50.157581 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154920    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154922    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154925    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154928    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154930    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154933    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154935    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154937    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154940    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154943    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154945    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154948    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154951    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154954    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154956    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154959    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154962    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154966    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154969    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:22:50.158085 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154971    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154974    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154977    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154980    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154983    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154985    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154988    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154991    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154993    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154996    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.154999    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155001    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155004    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155006    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155008    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155011    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155013    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155016    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155018    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155021    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:22:50.158549 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155023    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155026    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155028    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155032    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155038    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155040    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155043    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155046    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155048    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155051    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155053    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155056    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155059    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155061    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155063    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155066    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155069    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155071    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155074    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155076    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:22:50.159029 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155079    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155081    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155084    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155153    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155160    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155166    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155178    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155182    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155186    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155190    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155194    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155198    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155201    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155204    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155208    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155211    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155216    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155219    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155222    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155225    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155229    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155234    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155237    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 22:22:50.159548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155240    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155243    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155246    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155250    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155253    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155256    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155260    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155263    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155266    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155269    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155272    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155275    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155279    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155282    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155285    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155287    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155291    2579 flags.go:64] FLAG: --enable-server="true"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155294    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155311    2579 flags.go:64] FLAG: --event-burst="100"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155314    2579 flags.go:64] FLAG: --event-qps="50"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155317    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155320    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155323    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155327    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 22:22:50.160107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155330    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155335    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155338    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155341    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155343    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155347    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155351    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155354    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155356    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155359    2579 flags.go:64] FLAG: --feature-gates=""
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155363    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155366    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155370    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155373    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155376    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155379    2579 flags.go:64] FLAG: --help="false"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155382    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155385    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155388    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155391    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155395    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155398    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155401    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 22:22:50.160737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155404    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155408    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155411    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155414    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155417    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155420    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155423    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155426    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155429    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155431    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155435    2579 flags.go:64] FLAG: --lock-file=""
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155438    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155442    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155445    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155450    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155453    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155456    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155459    2579 flags.go:64] FLAG: --logging-format="text"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155462    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155465    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155468    2579 flags.go:64] FLAG: --manifest-url=""
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155471    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155475    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155478    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155482    2579 flags.go:64] FLAG: --max-pods="110"
Jul 20 22:22:50.161343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155485    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155488    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155491    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155494    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155497    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155500    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155503    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155512    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155516    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155519    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155523    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155525    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155530    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155533    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155536    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155539    2579 flags.go:64] FLAG: --port="10250"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155542    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155545    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fa97fb043c0ff327"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155549    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155552    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155555    2579 flags.go:64] FLAG: --register-node="true"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155559    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155562    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155565    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 20 22:22:50.162036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155568    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155571    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155575    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155578    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155581    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155584    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155587    2579 flags.go:64] FLAG: --runonce="false"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155590    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155593    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155596    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155599    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155602    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155605    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155608    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155611    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155614    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155618    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155621    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155624    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155627    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155630    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155633    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155638    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155640    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155643    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 22:22:50.162718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155647    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155651    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155654    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155656    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155659    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155662    2579 flags.go:64] FLAG: --v="2"
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155666    2579 flags.go:64] FLAG: --version="false"
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155670    2579 flags.go:64] FLAG: --vmodule=""
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155675    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.155678    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155811    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155816    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155818    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155821    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155824    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155827    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155829    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155832    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155835    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155838    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155840    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155843    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:22:50.163678 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155845    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155850    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155853    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155856    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155858    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155861    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155863    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155866    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155868    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155870    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155873    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155876    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155879    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155881    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155883    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155886    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155888    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155891    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155893    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155896    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:22:50.164256 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155898    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155901    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155903    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155906    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155908    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155910    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155913    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155915    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155918    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155920    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155922    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155925    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155927    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155933    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155935    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155937    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155940    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155942    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155945    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155948    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155950    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:22:50.164817 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155953    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155955    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155958    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155960    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155963    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155965    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155968    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155970    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155973    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155975    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155978    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155981    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155983    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155985    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155988    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155990    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155993    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.155997    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156001    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:22:50.165455 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156005    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156011    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156039    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156059    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156063    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156067    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156072    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156075    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156078    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156081    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156084    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156087    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156091    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156095    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156098    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156101    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156104    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156107    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156111    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:22:50.165910 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156114    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156117    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156120    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156122    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156125    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156128    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156132    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.156136    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.156146    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.163932    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.163951    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.163970    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.163976    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164032    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:22:50.166381 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164037    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164040    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164044    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164048    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164051    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164054    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164057    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164059    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164062    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164065    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164068    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164070    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164073    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164075    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164078    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164081    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164085    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164087    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164090    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164092    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:22:50.166729 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164095    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164097    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164100    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164103    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164105    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164108    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164110    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164113    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164115    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164118    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164121    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164123    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164126    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164129    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164132    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164135    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164138    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164141    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164143    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164146    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:22:50.167252 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164148    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164151    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164153    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164156    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164159    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164161    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164164    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164167    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164169    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164172    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164176    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164179    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164182    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164185    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164188    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164191    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164194    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164197    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164199    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:22:50.167759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164202    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164205    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164207    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164210    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164213    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164215    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164218    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164220    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164224    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164227    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164230    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164232    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164235    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164238    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164241    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164243    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164246    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164248    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164251    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164260    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:22:50.168337 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164263    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164266    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164269    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164272    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164275    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164277    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164280    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164282    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164285    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164287    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164290    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164292    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164295    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164317    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164320    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164324    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164328    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164332    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:22:50.169160 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164336    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.164342    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164450    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164455    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164458    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164461    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164472    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164476    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164479    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164482    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164485    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164488    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164490    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164493    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164503    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 22:22:50.169706 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164506    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164509    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164511    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164514    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164516    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164519    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164521    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164523    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164526    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164529    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164531    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164534    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164536    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164539    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164541    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164544    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164546    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164549    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164552    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164555    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 22:22:50.170173 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164557    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164559    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164562    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164564    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164567    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164569    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164572    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164574    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164576    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164579    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164582    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164584    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164593    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164595    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164598    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164602    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164605    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164608    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164611    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164613    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 22:22:50.170735 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164616    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164619    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164622    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164624    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164627    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164630    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164632    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164635    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164637    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164640    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164642    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164645    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164648    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164650    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164652    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164655    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164658    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164660    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164663    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164665    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 22:22:50.171467 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164668    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164670    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164674    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164678    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164680    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164689    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164693    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164696    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164698    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164701    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164704    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164706    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164709    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164711    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164714    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164716    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164719    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164722    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164724    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164727    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 22:22:50.171992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164729    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 22:22:50.172517 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164732    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 22:22:50.172517 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164735    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 22:22:50.172517 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164737    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 22:22:50.172517 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164740    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 22:22:50.172517 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:50.164743    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 22:22:50.172517 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.164748    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 22:22:50.172517 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.164861    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 22:22:50.172517 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.166811    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 22:22:50.172517 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.168084    2579 server.go:1019] "Starting client certificate rotation"
Jul 20 22:22:50.172517 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.168204    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 22:22:50.172517 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.168318    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 22:22:50.172517 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.170366    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 22:22:50.175008 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.174993    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 22:22:50.187001 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.186978    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 20 22:22:50.188988 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.188971    2579 log.go:25] "Validated CRI v1 image API"
Jul 20 22:22:50.189677 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.189663    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 22:22:50.191942 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.191920    2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ced4145f-aca8-408a-87f9-b6e0a5d44454:/dev/nvme0n1p3 fb67038d-62fc-487a-b096-503c745ce754:/dev/nvme0n1p4]
Jul 20 22:22:50.192019 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.191941    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 22:22:50.197064 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.196942    2579 manager.go:216] Machine: {Timestamp:2026-07-20 22:22:50.19571569 +0000 UTC m=+0.311100307 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3131201 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c6e07a43a8bd15c59d759a5dc1d78 SystemUUID:ec2c6e07-a43a-8bd1-5c59-d759a5dc1d78 BootID:52f8b22b-d2ec-489b-8c70-1af60ce5185f Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f5:7c:86:14:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f5:7c:86:14:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:c8:21:a4:55:42 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 22:22:50.197064 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.197054    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 22:22:50.197208 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.197167    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 22:22:50.199495 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.199469    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 22:22:50.199634 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.199497    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-108.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 22:22:50.200227 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.200217    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 22:22:50.200258 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.200229    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 22:22:50.200258 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.200236    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 22:22:50.200962 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.200947    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 22:22:50.202184 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.202173    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 22:22:50.204704 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.204690    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 22:22:50.204847 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.204835    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 22:22:50.204902 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.204869    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 22:22:50.204902 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.204888    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 22:22:50.204902 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.204902    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 22:22:50.205021 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.204911    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 20 22:22:50.205021 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.204921    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 22:22:50.205021 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.204928    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 22:22:50.205448 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.205434    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 22:22:50.205498 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.205465    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 22:22:50.210030 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.210010    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 22:22:50.211308 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.211283    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 22:22:50.211359 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.211330    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 22:22:50.211919 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.211906    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 22:22:50.211975 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.211923    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 22:22:50.211975 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.211929    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 22:22:50.211975 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.211935    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 22:22:50.211975 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.211943    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 22:22:50.211975 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.211948    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 22:22:50.212114 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.212080    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 22:22:50.212114 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.212086    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 22:22:50.212114 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.212094    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 22:22:50.212114 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.212099    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 22:22:50.212114 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.212107    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 22:22:50.212114 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.212115    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 22:22:50.212572 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.212562    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 22:22:50.212572 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.212571    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 22:22:50.215823 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.215805    2579 server.go:1268] "Started kubelet"
Jul 20 22:22:50.215932 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.215902    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 22:22:50.215987 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.215899    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 22:22:50.216047 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.216010    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 22:22:50.216851 ip-10-0-128-108 systemd[1]: Started Kubernetes Kubelet.
Jul 20 22:22:50.217034 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.217014    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 22:22:50.218116 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.218100    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 22:22:50.219573 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.219555    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-108.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 22:22:50.220146 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.220117    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 22:22:50.220231 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.220148    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 22:22:50.220435 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.220408    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 22:22:50.223286 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.223268    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 22:22:50.223286 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.223277    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 22:22:50.223500 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.223364    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-108.ec2.internal\" not found"
Jul 20 22:22:50.223657 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.222658    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-108.ec2.internal.18c41faaaac94aa6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-108.ec2.internal,UID:ip-10-0-128-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-108.ec2.internal,},FirstTimestamp:2026-07-20 22:22:50.215778982 +0000 UTC m=+0.331163599,LastTimestamp:2026-07-20 22:22:50.215778982 +0000 UTC m=+0.331163599,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-108.ec2.internal,}"
Jul 20 22:22:50.223872 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.223851    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 22:22:50.223941 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.223876    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 22:22:50.223941 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.223849    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 22:22:50.224064 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.224024    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 22:22:50.224064 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.224032    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 22:22:50.224213 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.224195    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 22:22:50.224213 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.224210    2579 factory.go:55] Registering systemd factory
Jul 20 22:22:50.224361 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.224220    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 20 22:22:50.224449 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.224434    2579 factory.go:153] Registering CRI-O factory
Jul 20 22:22:50.224449 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.224450    2579 factory.go:223] Registration of the crio container factory successfully
Jul 20 22:22:50.224575 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.224481    2579 factory.go:103] Registering Raw factory
Jul 20 22:22:50.224575 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.224494    2579 manager.go:1196] Started watching for new ooms in manager
Jul 20 22:22:50.224850 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.224837    2579 manager.go:349] Starting recovery of all containers
Jul 20 22:22:50.233506 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.232247    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 20 22:22:50.233506 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.232364    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 20 22:22:50.237115 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.236990    2579 manager.go:354] Recovery completed
Jul 20 22:22:50.237882 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.237858    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h5p5m"
Jul 20 22:22:50.241538 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.241523    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:50.243354 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.243334    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:50.243431 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.243371    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:50.243431 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.243386    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:50.243684 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.243664    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h5p5m"
Jul 20 22:22:50.243955 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.243939    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 22:22:50.243955 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.243953    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 22:22:50.243955 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.243959    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:50.244104 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.243970    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 22:22:50.244657 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.244642    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:50.244708 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.244672    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:50.244708 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.244689    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:50.245466 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.245388    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-108.ec2.internal.18c41faaac6e1124  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-108.ec2.internal,UID:ip-10-0-128-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-108.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-108.ec2.internal,},FirstTimestamp:2026-07-20 22:22:50.243354916 +0000 UTC m=+0.358739538,LastTimestamp:2026-07-20 22:22:50.243354916 +0000 UTC m=+0.358739538,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-108.ec2.internal,}"
Jul 20 22:22:50.245931 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.245918    2579 policy_none.go:49] "None policy: Start"
Jul 20 22:22:50.246006 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.245938    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 22:22:50.246006 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.245952    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 22:22:50.246967 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.246952    2579 policy_none.go:47] "Start"
Jul 20 22:22:50.284922 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.284904    2579 manager.go:337] "Starting Device Plugin manager"
Jul 20 22:22:50.285002 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.284938    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 22:22:50.285002 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.284947    2579 server.go:87] "Starting device plugin registration server"
Jul 20 22:22:50.285245 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.285229    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 22:22:50.285348 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.285249    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 22:22:50.285396 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.285366    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 22:22:50.285457 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.285440    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 22:22:50.285457 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.285450    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 22:22:50.286009 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.285979    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 22:22:50.286100 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.286028    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-108.ec2.internal\" not found"
Jul 20 22:22:50.360933 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.360895    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 22:22:50.362114 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.362097    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 22:22:50.362170 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.362137    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 22:22:50.362170 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.362159    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 22:22:50.362247 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.362196    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 22:22:50.364412 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.364392    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:22:50.385393 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.385356    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:50.389292 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.389273    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:50.389418 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.389324    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:50.389418 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.389340    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:50.389418 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.389373    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.395442 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.395424    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.395522 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.395447    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-108.ec2.internal\": node \"ip-10-0-128-108.ec2.internal\" not found"
Jul 20 22:22:50.410629 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.410564    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-108.ec2.internal\" not found"
Jul 20 22:22:50.463148 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.463120    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-108.ec2.internal"]
Jul 20 22:22:50.463282 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.463197    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:50.464207 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.464191    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:50.464295 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.464223    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:50.464295 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.464237    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:50.465708 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.465693    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:50.465815 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.465800    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.465864 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.465832    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:50.466481 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.466467    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:50.466566 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.466491    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:50.466566 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.466504    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:50.466663 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.466562    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:50.466663 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.466588    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:50.466663 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.466605    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:50.467684 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.467668    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.467761 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.467700    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 22:22:50.469786 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.469769    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 22:22:50.469860 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.469800    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 22:22:50.469860 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.469815    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeHasSufficientPID"
Jul 20 22:22:50.496994 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.496968    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-108.ec2.internal\" not found" node="ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.501864 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.501847    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-108.ec2.internal\" not found" node="ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.510709 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.510689    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-108.ec2.internal\" not found"
Jul 20 22:22:50.525516 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.525499    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c7aa12efeeb70eb8d34c7816077c221-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal\" (UID: \"7c7aa12efeeb70eb8d34c7816077c221\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.525607 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.525525    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7aa12efeeb70eb8d34c7816077c221-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal\" (UID: \"7c7aa12efeeb70eb8d34c7816077c221\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.525607 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.525542    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4ee785b208346b7bd74e56028abfd5a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-108.ec2.internal\" (UID: \"d4ee785b208346b7bd74e56028abfd5a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.611214 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.611184    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-108.ec2.internal\" not found"
Jul 20 22:22:50.625938 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.625912    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c7aa12efeeb70eb8d34c7816077c221-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal\" (UID: \"7c7aa12efeeb70eb8d34c7816077c221\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.626089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.625942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7aa12efeeb70eb8d34c7816077c221-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal\" (UID: \"7c7aa12efeeb70eb8d34c7816077c221\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.626089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.625960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4ee785b208346b7bd74e56028abfd5a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-108.ec2.internal\" (UID: \"d4ee785b208346b7bd74e56028abfd5a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.626089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.625985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d4ee785b208346b7bd74e56028abfd5a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-108.ec2.internal\" (UID: \"d4ee785b208346b7bd74e56028abfd5a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.626089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.626035    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c7aa12efeeb70eb8d34c7816077c221-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal\" (UID: \"7c7aa12efeeb70eb8d34c7816077c221\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.626089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.626023    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7c7aa12efeeb70eb8d34c7816077c221-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal\" (UID: \"7c7aa12efeeb70eb8d34c7816077c221\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.711881 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.711789    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-108.ec2.internal\" not found"
Jul 20 22:22:50.799265 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.799241    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.805015 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:50.804993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:50.812185 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.812165    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-108.ec2.internal\" not found"
Jul 20 22:22:50.912639 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:50.912600    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-108.ec2.internal\" not found"
Jul 20 22:22:51.013251 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.013161    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-108.ec2.internal\" not found"
Jul 20 22:22:51.113711 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.113680    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-108.ec2.internal\" not found"
Jul 20 22:22:51.119346 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.119329    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:22:51.124209 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.124190    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:51.137183 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.137155    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 22:22:51.138916 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.138897    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-108.ec2.internal"
Jul 20 22:22:51.147053 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.147034    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 22:22:51.167213 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.167182    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 22:22:51.167870 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.167369    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 22:22:51.167870 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.167415    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 22:22:51.205449 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.205414    2579 apiserver.go:52] "Watching apiserver"
Jul 20 22:22:51.224096 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.224063    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 22:22:51.224255 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.224076    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 22:22:51.224874 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.224847    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-stlkx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk","openshift-dns/node-resolver-6v4z2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal","openshift-multus/network-metrics-daemon-xph8z","openshift-network-operator/iptables-alerter-ppb7k","openshift-ovn-kubernetes/ovnkube-node-7sldj","kube-system/global-pull-secret-syncer-bzj9t","kube-system/kube-apiserver-proxy-ip-10-0-128-108.ec2.internal","openshift-cluster-node-tuning-operator/tuned-gtjsg","openshift-image-registry/node-ca-gltrx","openshift-multus/multus-additional-cni-plugins-qdr7h","openshift-multus/multus-kgkph","openshift-network-diagnostics/network-check-target-lj2px"]
Jul 20 22:22:51.226878 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.226799    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.230204 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.230181    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 22:22:51.230349 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.230279    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.230471 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.230450    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 22:22:51.230541 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.230468    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xffm5\""
Jul 20 22:22:51.230541 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.230452    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 22:22:51.230541 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.230499    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 22:22:51.230702 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.230450    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 22:22:51.231540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.231525    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6v4z2"
Jul 20 22:22:51.232958 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.232944    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.234044 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.234023    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 22:22:51.234244 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.234180    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 22:22:51.234244 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.234222    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 22:22:51.234493 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.234476    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wxv2b\""
Jul 20 22:22:51.234563 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.234528    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 22:22:51.234699 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.234677    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p9jct\""
Jul 20 22:22:51.234809 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.234779    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 22:22:51.234922 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.234892    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xd5v6\""
Jul 20 22:22:51.234982 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.234928    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:51.235035 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.235008    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:22:51.236617 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.236597    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ppb7k"
Jul 20 22:22:51.238528 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.238505    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-stlkx"
Jul 20 22:22:51.238656 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.238639    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 22:22:51.238906 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.238890    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 22:22:51.239070 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.239054    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 22:22:51.239119 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.239083    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8k6pw\""
Jul 20 22:22:51.240628 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.240609    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.240773 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.240749    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 22:22:51.241076 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.241060    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t7h28\""
Jul 20 22:22:51.243131 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.243116    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.244764 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.244746    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 22:22:51.244876 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.244795    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 22:22:51.244876 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.244861    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 22:22:51.245036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.244932    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 22:22:51.245036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.244954    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 22:22:51.245036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.244966    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 22:22:51.245259 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.245105    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 22:22:51.245259 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.245116    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 22:22:51.245259 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.245161    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sm9tx\""
Jul 20 22:22:51.245475 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.245317    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gltrx"
Jul 20 22:22:51.245475 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.245321    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 22:22:51.245475 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.245462    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 22:22:51.245609 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.245452    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9nlt5\""
Jul 20 22:22:51.245680 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.245654    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 22:22:51.247653 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.247613    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 22:17:50 +0000 UTC" deadline="2028-03-29 00:17:32.376661092 +0000 UTC"
Jul 20 22:22:51.247721 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.247654    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14809h54m41.129010601s"
Jul 20 22:22:51.247721 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.247655    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:51.247790 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.247727    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:22:51.248501 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.248483    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 22:22:51.248746 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.248732    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 22:22:51.249152 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.249140    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 22:22:51.249247 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.249230    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pjmsb\""
Jul 20 22:22:51.249851 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.249836    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:22:51.249911 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.249882    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:22:51.274056 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.273998    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2gml5"
Jul 20 22:22:51.286666 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.286635    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2gml5"
Jul 20 22:22:51.309916 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:51.309877    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ee785b208346b7bd74e56028abfd5a.slice/crio-3c9e2058943308eafb16f48d6fa2a7f680cce9acd12d69f2fcd75da2ad918564 WatchSource:0}: Error finding container 3c9e2058943308eafb16f48d6fa2a7f680cce9acd12d69f2fcd75da2ad918564: Status 404 returned error can't find the container with id 3c9e2058943308eafb16f48d6fa2a7f680cce9acd12d69f2fcd75da2ad918564
Jul 20 22:22:51.310147 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:51.310124    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7aa12efeeb70eb8d34c7816077c221.slice/crio-c06411fde64dcb0b81838fdfe5026de252d90bd32769fabc633ef02f2b7187d4 WatchSource:0}: Error finding container c06411fde64dcb0b81838fdfe5026de252d90bd32769fabc633ef02f2b7187d4: Status 404 returned error can't find the container with id c06411fde64dcb0b81838fdfe5026de252d90bd32769fabc633ef02f2b7187d4
Jul 20 22:22:51.314070 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.314051    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:22:51.325058 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.325036    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 22:22:51.328770 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.328745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwcfq\" (UniqueName: \"kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq\") pod \"network-check-target-lj2px\" (UID: \"44df20fa-9e1f-4ba3-af38-a8c785d394c1\") " pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:22:51.328872 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.328783    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzl7t\" (UniqueName: \"kubernetes.io/projected/e6638ee0-589b-4efa-a8f7-23574ca64eb2-kube-api-access-jzl7t\") pod \"network-metrics-daemon-xph8z\" (UID: \"e6638ee0-589b-4efa-a8f7-23574ca64eb2\") " pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:51.328872 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.328811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a48f5e91-5229-4b8c-bca2-cf6a0a146f1d-serviceca\") pod \"node-ca-gltrx\" (UID: \"a48f5e91-5229-4b8c-bca2-cf6a0a146f1d\") " pod="openshift-image-registry/node-ca-gltrx"
Jul 20 22:22:51.328872 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.328836    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f35575d5-3cb4-4d9c-9299-028678fdf2f9-iptables-alerter-script\") pod \"iptables-alerter-ppb7k\" (UID: \"f35575d5-3cb4-4d9c-9299-028678fdf2f9\") " pod="openshift-network-operator/iptables-alerter-ppb7k"
Jul 20 22:22:51.328872 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.328855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-sysconfig\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.329025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.328874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfxqv\" (UniqueName: \"kubernetes.io/projected/01bb517c-e6d7-4f16-868f-0e88115b70a0-kube-api-access-hfxqv\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.329025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.328894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-system-cni-dir\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.329025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.328909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca5f562e-8121-4b81-b5f5-58c5ebda891e-cnibin\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.329025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.328940    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca5f562e-8121-4b81-b5f5-58c5ebda891e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.329025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.328967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-run-openvswitch\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.329025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.328989    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-run-ovn-kubernetes\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.329025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329003    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a48f5e91-5229-4b8c-bca2-cf6a0a146f1d-host\") pod \"node-ca-gltrx\" (UID: \"a48f5e91-5229-4b8c-bca2-cf6a0a146f1d\") " pod="openshift-image-registry/node-ca-gltrx"
Jul 20 22:22:51.329025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329017    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sdgx\" (UniqueName: \"kubernetes.io/projected/a48f5e91-5229-4b8c-bca2-cf6a0a146f1d-kube-api-access-2sdgx\") pod \"node-ca-gltrx\" (UID: \"a48f5e91-5229-4b8c-bca2-cf6a0a146f1d\") " pod="openshift-image-registry/node-ca-gltrx"
Jul 20 22:22:51.329373 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.329373 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329077    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-slash\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.329373 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-cni-bin\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.329373 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-multus-socket-dir-parent\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.329373 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-var-lib-cni-bin\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.329373 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-hostroot\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.329373 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329226    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-run-multus-certs\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.329373 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329339    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f35575d5-3cb4-4d9c-9299-028678fdf2f9-host-slash\") pod \"iptables-alerter-ppb7k\" (UID: \"f35575d5-3cb4-4d9c-9299-028678fdf2f9\") " pod="openshift-network-operator/iptables-alerter-ppb7k"
Jul 20 22:22:51.329373 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329364    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-var-lib-kubelet\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.329712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca5f562e-8121-4b81-b5f5-58c5ebda891e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.329712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca5f562e-8121-4b81-b5f5-58c5ebda891e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.329712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-kubelet\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.329712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a013ab7a-6a08-4fa3-9d00-78c44854ed02-env-overrides\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.329712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329499    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce976b70-1114-40c2-bb36-70023b6bd7ae-cni-binary-copy\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.329712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-socket-dir\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.329712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-etc-selinux\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.329712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca5f562e-8121-4b81-b5f5-58c5ebda891e-cni-binary-copy\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.329712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329618    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xslj\" (UniqueName: \"kubernetes.io/projected/c8ba7ac0-dac8-4650-874f-71fbae35f562-kube-api-access-7xslj\") pod \"node-resolver-6v4z2\" (UID: \"c8ba7ac0-dac8-4650-874f-71fbae35f562\") " pod="openshift-dns/node-resolver-6v4z2"
Jul 20 22:22:51.329712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5-agent-certs\") pod \"konnectivity-agent-stlkx\" (UID: \"34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5\") " pod="kube-system/konnectivity-agent-stlkx"
Jul 20 22:22:51.329712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329666    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbl7x\" (UniqueName: \"kubernetes.io/projected/a013ab7a-6a08-4fa3-9d00-78c44854ed02-kube-api-access-zbl7x\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.329712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329688    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-sys-fs\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.329712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329704    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-run-netns\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ce976b70-1114-40c2-bb36-70023b6bd7ae-multus-daemon-config\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5-konnectivity-ca\") pod \"konnectivity-agent-stlkx\" (UID: \"34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5\") " pod="kube-system/konnectivity-agent-stlkx"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-var-lib-cni-multus\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329790    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01bb517c-e6d7-4f16-868f-0e88115b70a0-tmp\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-node-log\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329840    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-modprobe-d\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-sysctl-conf\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-systemd\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-lib-modules\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8ba7ac0-dac8-4650-874f-71fbae35f562-hosts-file\") pod \"node-resolver-6v4z2\" (UID: \"c8ba7ac0-dac8-4650-874f-71fbae35f562\") " pod="openshift-dns/node-resolver-6v4z2"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.329976    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-tuned\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330024    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jx9n\" (UniqueName: \"kubernetes.io/projected/b997bfdd-bd61-4467-b051-ff1d0399231f-kube-api-access-7jx9n\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330049    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-multus-cni-dir\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.330149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330127    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-os-release\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330157    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-systemd-units\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-var-lib-openvswitch\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330241    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-cni-netd\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330267    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a013ab7a-6a08-4fa3-9d00-78c44854ed02-ovn-node-metrics-cert\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330292    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-registration-dir\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-cnibin\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-etc-openvswitch\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330378    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330403    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-var-lib-kubelet\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330426    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-host\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv6s2\" (UniqueName: \"kubernetes.io/projected/ca5f562e-8121-4b81-b5f5-58c5ebda891e-kube-api-access-sv6s2\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8ba7ac0-dac8-4650-874f-71fbae35f562-tmp-dir\") pod \"node-resolver-6v4z2\" (UID: \"c8ba7ac0-dac8-4650-874f-71fbae35f562\") " pod="openshift-dns/node-resolver-6v4z2"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330533    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-run-netns\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-run-ovn\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330581    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-device-dir\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.330762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330604    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndgwn\" (UniqueName: \"kubernetes.io/projected/ce976b70-1114-40c2-bb36-70023b6bd7ae-kube-api-access-ndgwn\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-kubernetes\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca5f562e-8121-4b81-b5f5-58c5ebda891e-os-release\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330677    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs\") pod \"network-metrics-daemon-xph8z\" (UID: \"e6638ee0-589b-4efa-a8f7-23574ca64eb2\") " pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a013ab7a-6a08-4fa3-9d00-78c44854ed02-ovnkube-script-lib\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-run-k8s-cni-cncf-io\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330782    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-run\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a013ab7a-6a08-4fa3-9d00-78c44854ed02-ovnkube-config\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-etc-kubernetes\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330838    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-sysctl-d\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-run-systemd\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-log-socket\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330898    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-kubelet-config\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-multus-conf-dir\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330952    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbvgh\" (UniqueName: \"kubernetes.io/projected/f35575d5-3cb4-4d9c-9299-028678fdf2f9-kube-api-access-qbvgh\") pod \"iptables-alerter-ppb7k\" (UID: \"f35575d5-3cb4-4d9c-9299-028678fdf2f9\") " pod="openshift-network-operator/iptables-alerter-ppb7k"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330969    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca5f562e-8121-4b81-b5f5-58c5ebda891e-system-cni-dir\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.331340 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.330982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-dbus\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:51.331785 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.331000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-sys\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.366669 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.366622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-108.ec2.internal" event={"ID":"d4ee785b208346b7bd74e56028abfd5a","Type":"ContainerStarted","Data":"3c9e2058943308eafb16f48d6fa2a7f680cce9acd12d69f2fcd75da2ad918564"}
Jul 20 22:22:51.367625 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.367603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal" event={"ID":"7c7aa12efeeb70eb8d34c7816077c221","Type":"ContainerStarted","Data":"c06411fde64dcb0b81838fdfe5026de252d90bd32769fabc633ef02f2b7187d4"}
Jul 20 22:22:51.431376 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-run-systemd\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.431376 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-log-socket\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.431568 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-kubelet-config\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:51.431568 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-multus-conf-dir\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.431568 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbvgh\" (UniqueName: \"kubernetes.io/projected/f35575d5-3cb4-4d9c-9299-028678fdf2f9-kube-api-access-qbvgh\") pod \"iptables-alerter-ppb7k\" (UID: \"f35575d5-3cb4-4d9c-9299-028678fdf2f9\") " pod="openshift-network-operator/iptables-alerter-ppb7k"
Jul 20 22:22:51.431568 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca5f562e-8121-4b81-b5f5-58c5ebda891e-system-cni-dir\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.431568 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-run-systemd\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.431568 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431480    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-log-socket\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.431568 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431496    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-kubelet-config\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:51.431568 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431503    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca5f562e-8121-4b81-b5f5-58c5ebda891e-system-cni-dir\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.431568 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431553    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-multus-conf-dir\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431583    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-dbus\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431619    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-sys\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcfq\" (UniqueName: \"kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq\") pod \"network-check-target-lj2px\" (UID: \"44df20fa-9e1f-4ba3-af38-a8c785d394c1\") " pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431661    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzl7t\" (UniqueName: \"kubernetes.io/projected/e6638ee0-589b-4efa-a8f7-23574ca64eb2-kube-api-access-jzl7t\") pod \"network-metrics-daemon-xph8z\" (UID: \"e6638ee0-589b-4efa-a8f7-23574ca64eb2\") " pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a48f5e91-5229-4b8c-bca2-cf6a0a146f1d-serviceca\") pod \"node-ca-gltrx\" (UID: \"a48f5e91-5229-4b8c-bca2-cf6a0a146f1d\") " pod="openshift-image-registry/node-ca-gltrx"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431697    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-dbus\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-sys\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431781    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f35575d5-3cb4-4d9c-9299-028678fdf2f9-iptables-alerter-script\") pod \"iptables-alerter-ppb7k\" (UID: \"f35575d5-3cb4-4d9c-9299-028678fdf2f9\") " pod="openshift-network-operator/iptables-alerter-ppb7k"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-sysconfig\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431832    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfxqv\" (UniqueName: \"kubernetes.io/projected/01bb517c-e6d7-4f16-868f-0e88115b70a0-kube-api-access-hfxqv\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-system-cni-dir\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431880    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca5f562e-8121-4b81-b5f5-58c5ebda891e-cnibin\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-sysconfig\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca5f562e-8121-4b81-b5f5-58c5ebda891e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431933    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-run-openvswitch\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431940    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca5f562e-8121-4b81-b5f5-58c5ebda891e-cnibin\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.431986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-run-ovn-kubernetes\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432005    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-run-openvswitch\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432014    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-run-ovn-kubernetes\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a48f5e91-5229-4b8c-bca2-cf6a0a146f1d-host\") pod \"node-ca-gltrx\" (UID: \"a48f5e91-5229-4b8c-bca2-cf6a0a146f1d\") " pod="openshift-image-registry/node-ca-gltrx"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sdgx\" (UniqueName: \"kubernetes.io/projected/a48f5e91-5229-4b8c-bca2-cf6a0a146f1d-kube-api-access-2sdgx\") pod \"node-ca-gltrx\" (UID: \"a48f5e91-5229-4b8c-bca2-cf6a0a146f1d\") " pod="openshift-image-registry/node-ca-gltrx"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.431938    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-system-cni-dir\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432143    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a48f5e91-5229-4b8c-bca2-cf6a0a146f1d-host\") pod \"node-ca-gltrx\" (UID: \"a48f5e91-5229-4b8c-bca2-cf6a0a146f1d\") " pod="openshift-image-registry/node-ca-gltrx"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432221    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-slash\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432235    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-cni-bin\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-multus-socket-dir-parent\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-var-lib-cni-bin\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432288    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432314    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-slash\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432291    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-hostroot\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-cni-bin\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-hostroot\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-run-multus-certs\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.432642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432384    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-multus-socket-dir-parent\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-run-multus-certs\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f35575d5-3cb4-4d9c-9299-028678fdf2f9-host-slash\") pod \"iptables-alerter-ppb7k\" (UID: \"f35575d5-3cb4-4d9c-9299-028678fdf2f9\") " pod="openshift-network-operator/iptables-alerter-ppb7k"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432417    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-var-lib-cni-bin\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-var-lib-kubelet\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432456    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f35575d5-3cb4-4d9c-9299-028678fdf2f9-host-slash\") pod \"iptables-alerter-ppb7k\" (UID: \"f35575d5-3cb4-4d9c-9299-028678fdf2f9\") " pod="openshift-network-operator/iptables-alerter-ppb7k"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca5f562e-8121-4b81-b5f5-58c5ebda891e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca5f562e-8121-4b81-b5f5-58c5ebda891e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432511    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-var-lib-kubelet\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432525    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-kubelet\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.432557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-kubelet\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.433004    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a48f5e91-5229-4b8c-bca2-cf6a0a146f1d-serviceca\") pod \"node-ca-gltrx\" (UID: \"a48f5e91-5229-4b8c-bca2-cf6a0a146f1d\") " pod="openshift-image-registry/node-ca-gltrx"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.433095    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca5f562e-8121-4b81-b5f5-58c5ebda891e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.433095    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f35575d5-3cb4-4d9c-9299-028678fdf2f9-iptables-alerter-script\") pod \"iptables-alerter-ppb7k\" (UID: \"f35575d5-3cb4-4d9c-9299-028678fdf2f9\") " pod="openshift-network-operator/iptables-alerter-ppb7k"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.433202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca5f562e-8121-4b81-b5f5-58c5ebda891e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.433425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.433216    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a013ab7a-6a08-4fa3-9d00-78c44854ed02-env-overrides\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.434101 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.433601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a013ab7a-6a08-4fa3-9d00-78c44854ed02-env-overrides\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.434101 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.433778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce976b70-1114-40c2-bb36-70023b6bd7ae-cni-binary-copy\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.434101 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.433838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-socket-dir\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.434101 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.433932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-etc-selinux\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.434101 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.433993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca5f562e-8121-4b81-b5f5-58c5ebda891e-cni-binary-copy\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.434101 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xslj\" (UniqueName: \"kubernetes.io/projected/c8ba7ac0-dac8-4650-874f-71fbae35f562-kube-api-access-7xslj\") pod \"node-resolver-6v4z2\" (UID: \"c8ba7ac0-dac8-4650-874f-71fbae35f562\") " pod="openshift-dns/node-resolver-6v4z2"
Jul 20 22:22:51.434101 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5-agent-certs\") pod \"konnectivity-agent-stlkx\" (UID: \"34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5\") " pod="kube-system/konnectivity-agent-stlkx"
Jul 20 22:22:51.434101 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbl7x\" (UniqueName: \"kubernetes.io/projected/a013ab7a-6a08-4fa3-9d00-78c44854ed02-kube-api-access-zbl7x\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.434478 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-sys-fs\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.434478 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-run-netns\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.434478 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ce976b70-1114-40c2-bb36-70023b6bd7ae-multus-daemon-config\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.434478 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434207    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5-konnectivity-ca\") pod \"konnectivity-agent-stlkx\" (UID: \"34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5\") " pod="kube-system/konnectivity-agent-stlkx"
Jul 20 22:22:51.434478 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-var-lib-cni-multus\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.434478 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01bb517c-e6d7-4f16-868f-0e88115b70a0-tmp\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.434478 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-node-log\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.434478 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-modprobe-d\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.434824 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-sysctl-conf\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.434824 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-systemd\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.434824 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-lib-modules\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.434824 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8ba7ac0-dac8-4650-874f-71fbae35f562-hosts-file\") pod \"node-resolver-6v4z2\" (UID: \"c8ba7ac0-dac8-4650-874f-71fbae35f562\") " pod="openshift-dns/node-resolver-6v4z2"
Jul 20 22:22:51.434824 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-tuned\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.434824 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-run-netns\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.434824 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.434824 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jx9n\" (UniqueName: \"kubernetes.io/projected/b997bfdd-bd61-4467-b051-ff1d0399231f-kube-api-access-7jx9n\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.434824 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-multus-cni-dir\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.435214 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-os-release\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.435214 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-systemd-units\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.435214 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-var-lib-openvswitch\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.435214 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434964    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-cni-netd\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.435214 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.434990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a013ab7a-6a08-4fa3-9d00-78c44854ed02-ovn-node-metrics-cert\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.435214 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-registration-dir\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.435214 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435202    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-cnibin\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.435540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435251    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ce976b70-1114-40c2-bb36-70023b6bd7ae-cni-binary-copy\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.435540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-etc-openvswitch\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.435540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:51.435540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435403    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-socket-dir\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.435540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-var-lib-kubelet\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.435540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-host\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.435540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv6s2\" (UniqueName: \"kubernetes.io/projected/ca5f562e-8121-4b81-b5f5-58c5ebda891e-kube-api-access-sv6s2\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.435831 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435585    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8ba7ac0-dac8-4650-874f-71fbae35f562-tmp-dir\") pod \"node-resolver-6v4z2\" (UID: \"c8ba7ac0-dac8-4650-874f-71fbae35f562\") " pod="openshift-dns/node-resolver-6v4z2"
Jul 20 22:22:51.435831 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-run-netns\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.435831 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435635    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-run-ovn\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.435831 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435709    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-run-ovn\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.436009 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.435945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca5f562e-8121-4b81-b5f5-58c5ebda891e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.436063 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-device-dir\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.436111 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436062    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-sys-fs\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.436111 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436062    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-var-lib-openvswitch\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.436220 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436114    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-os-release\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.436220 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-device-dir\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.436445 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436418    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 22:22:51.436739 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436670    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5-konnectivity-ca\") pod \"konnectivity-agent-stlkx\" (UID: \"34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5\") " pod="kube-system/konnectivity-agent-stlkx"
Jul 20 22:22:51.436739 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436673    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-var-lib-cni-multus\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.436861 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436719    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-registration-dir\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.436861 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436755    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-run-netns\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.436861 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.436847    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:22:51.436861 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ce976b70-1114-40c2-bb36-70023b6bd7ae-multus-daemon-config\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.437041 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436878    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b997bfdd-bd61-4467-b051-ff1d0399231f-etc-selinux\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.437041 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca5f562e-8121-4b81-b5f5-58c5ebda891e-cni-binary-copy\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.437041 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436961    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-host\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.437041 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.436981    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndgwn\" (UniqueName: \"kubernetes.io/projected/ce976b70-1114-40c2-bb36-70023b6bd7ae-kube-api-access-ndgwn\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.437041 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-lib-modules\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437371    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-modprobe-d\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-kubernetes\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437420    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-systemd-units\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-multus-cni-dir\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437456    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-cni-netd\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437492    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-etc-openvswitch\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437525    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-kubernetes\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437528    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-node-log\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437528    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-cnibin\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-systemd\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8ba7ac0-dac8-4650-874f-71fbae35f562-tmp-dir\") pod \"node-resolver-6v4z2\" (UID: \"c8ba7ac0-dac8-4650-874f-71fbae35f562\") " pod="openshift-dns/node-resolver-6v4z2"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a013ab7a-6a08-4fa3-9d00-78c44854ed02-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437637    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca5f562e-8121-4b81-b5f5-58c5ebda891e-os-release\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437646    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c8ba7ac0-dac8-4650-874f-71fbae35f562-hosts-file\") pod \"node-resolver-6v4z2\" (UID: \"c8ba7ac0-dac8-4650-874f-71fbae35f562\") " pod="openshift-dns/node-resolver-6v4z2"
Jul 20 22:22:51.437722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437683    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-var-lib-kubelet\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437776    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs\") pod \"network-metrics-daemon-xph8z\" (UID: \"e6638ee0-589b-4efa-a8f7-23574ca64eb2\") " pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437800    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca5f562e-8121-4b81-b5f5-58c5ebda891e-os-release\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a013ab7a-6a08-4fa3-9d00-78c44854ed02-ovnkube-script-lib\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.437862    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret podName:7f7845cf-8b8f-4a86-8818-0a22d53cfd9a nodeName:}" failed. No retries permitted until 2026-07-20 22:22:51.937819394 +0000 UTC m=+2.053204021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret") pod "global-pull-secret-syncer-bzj9t" (UID: "7f7845cf-8b8f-4a86-8818-0a22d53cfd9a") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.437926    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-run-k8s-cni-cncf-io\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-sysctl-conf\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437957    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-host-run-k8s-cni-cncf-io\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.437988    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-run\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.438064    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs podName:e6638ee0-589b-4efa-a8f7-23574ca64eb2 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:51.938044951 +0000 UTC m=+2.053429568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs") pod "network-metrics-daemon-xph8z" (UID: "e6638ee0-589b-4efa-a8f7-23574ca64eb2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.438090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a013ab7a-6a08-4fa3-9d00-78c44854ed02-ovnkube-config\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.438100    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-run\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.438189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-etc-kubernetes\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.438212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce976b70-1114-40c2-bb36-70023b6bd7ae-etc-kubernetes\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.438253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-sysctl-d\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.438460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.438400    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-sysctl-d\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.439272 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.438428    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a013ab7a-6a08-4fa3-9d00-78c44854ed02-ovnkube-script-lib\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.439272 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.438666    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:22:51.439272 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.438685    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:22:51.439272 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.438699    2579 projected.go:196] Error preparing data for projected volume kube-api-access-pwcfq for pod openshift-network-diagnostics/network-check-target-lj2px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:22:51.439272 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.438755    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq podName:44df20fa-9e1f-4ba3-af38-a8c785d394c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:51.9387416 +0000 UTC m=+2.054126217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pwcfq" (UniqueName: "kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq") pod "network-check-target-lj2px" (UID: "44df20fa-9e1f-4ba3-af38-a8c785d394c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:22:51.439272 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.438800    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a013ab7a-6a08-4fa3-9d00-78c44854ed02-ovnkube-config\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.440099 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.440078    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/01bb517c-e6d7-4f16-868f-0e88115b70a0-etc-tuned\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.440198 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.440179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01bb517c-e6d7-4f16-868f-0e88115b70a0-tmp\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.440266 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.440242    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5-agent-certs\") pod \"konnectivity-agent-stlkx\" (UID: \"34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5\") " pod="kube-system/konnectivity-agent-stlkx"
Jul 20 22:22:51.440459 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.440442    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a013ab7a-6a08-4fa3-9d00-78c44854ed02-ovn-node-metrics-cert\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.441109 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.441092    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbvgh\" (UniqueName: \"kubernetes.io/projected/f35575d5-3cb4-4d9c-9299-028678fdf2f9-kube-api-access-qbvgh\") pod \"iptables-alerter-ppb7k\" (UID: \"f35575d5-3cb4-4d9c-9299-028678fdf2f9\") " pod="openshift-network-operator/iptables-alerter-ppb7k"
Jul 20 22:22:51.441172 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.441142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzl7t\" (UniqueName: \"kubernetes.io/projected/e6638ee0-589b-4efa-a8f7-23574ca64eb2-kube-api-access-jzl7t\") pod \"network-metrics-daemon-xph8z\" (UID: \"e6638ee0-589b-4efa-a8f7-23574ca64eb2\") " pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:51.442377 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.442360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfxqv\" (UniqueName: \"kubernetes.io/projected/01bb517c-e6d7-4f16-868f-0e88115b70a0-kube-api-access-hfxqv\") pod \"tuned-gtjsg\" (UID: \"01bb517c-e6d7-4f16-868f-0e88115b70a0\") " pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.443518 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.443502    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sdgx\" (UniqueName: \"kubernetes.io/projected/a48f5e91-5229-4b8c-bca2-cf6a0a146f1d-kube-api-access-2sdgx\") pod \"node-ca-gltrx\" (UID: \"a48f5e91-5229-4b8c-bca2-cf6a0a146f1d\") " pod="openshift-image-registry/node-ca-gltrx"
Jul 20 22:22:51.449059 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.449040    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xslj\" (UniqueName: \"kubernetes.io/projected/c8ba7ac0-dac8-4650-874f-71fbae35f562-kube-api-access-7xslj\") pod \"node-resolver-6v4z2\" (UID: \"c8ba7ac0-dac8-4650-874f-71fbae35f562\") " pod="openshift-dns/node-resolver-6v4z2"
Jul 20 22:22:51.454420 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.454388    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv6s2\" (UniqueName: \"kubernetes.io/projected/ca5f562e-8121-4b81-b5f5-58c5ebda891e-kube-api-access-sv6s2\") pod \"multus-additional-cni-plugins-qdr7h\" (UID: \"ca5f562e-8121-4b81-b5f5-58c5ebda891e\") " pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.456858 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.456838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndgwn\" (UniqueName: \"kubernetes.io/projected/ce976b70-1114-40c2-bb36-70023b6bd7ae-kube-api-access-ndgwn\") pod \"multus-kgkph\" (UID: \"ce976b70-1114-40c2-bb36-70023b6bd7ae\") " pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.457322 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.457283    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jx9n\" (UniqueName: \"kubernetes.io/projected/b997bfdd-bd61-4467-b051-ff1d0399231f-kube-api-access-7jx9n\") pod \"aws-ebs-csi-driver-node-8hpqk\" (UID: \"b997bfdd-bd61-4467-b051-ff1d0399231f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.457671 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.457655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbl7x\" (UniqueName: \"kubernetes.io/projected/a013ab7a-6a08-4fa3-9d00-78c44854ed02-kube-api-access-zbl7x\") pod \"ovnkube-node-7sldj\" (UID: \"a013ab7a-6a08-4fa3-9d00-78c44854ed02\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.552371 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.552263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qdr7h"
Jul 20 22:22:51.557934 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.557916    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk"
Jul 20 22:22:51.563802 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:51.563773    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca5f562e_8121_4b81_b5f5_58c5ebda891e.slice/crio-a24a29b56616953250071b332b50d4cb69cf662be6ce5e78a6bf90a9ddf2c51e WatchSource:0}: Error finding container a24a29b56616953250071b332b50d4cb69cf662be6ce5e78a6bf90a9ddf2c51e: Status 404 returned error can't find the container with id a24a29b56616953250071b332b50d4cb69cf662be6ce5e78a6bf90a9ddf2c51e
Jul 20 22:22:51.567939 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:51.567912    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb997bfdd_bd61_4467_b051_ff1d0399231f.slice/crio-001b8ee2fd036fb017bac84c52ae8c9a1ab37191e9cc764019bc92a5bfe67f99 WatchSource:0}: Error finding container 001b8ee2fd036fb017bac84c52ae8c9a1ab37191e9cc764019bc92a5bfe67f99: Status 404 returned error can't find the container with id 001b8ee2fd036fb017bac84c52ae8c9a1ab37191e9cc764019bc92a5bfe67f99
Jul 20 22:22:51.577511 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.577489    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6v4z2"
Jul 20 22:22:51.582437 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.582418    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kgkph"
Jul 20 22:22:51.588685 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:51.588648    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ba7ac0_dac8_4650_874f_71fbae35f562.slice/crio-c9af6687741efd0846b70bc3d4d798c6640561395c390b7ac5f8039cc32256a4 WatchSource:0}: Error finding container c9af6687741efd0846b70bc3d4d798c6640561395c390b7ac5f8039cc32256a4: Status 404 returned error can't find the container with id c9af6687741efd0846b70bc3d4d798c6640561395c390b7ac5f8039cc32256a4
Jul 20 22:22:51.591498 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:51.591475    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce976b70_1114_40c2_bb36_70023b6bd7ae.slice/crio-15bca65dae488cc31110e74be01af031579d82d5b43cc927fe3f1b8b92aa9737 WatchSource:0}: Error finding container 15bca65dae488cc31110e74be01af031579d82d5b43cc927fe3f1b8b92aa9737: Status 404 returned error can't find the container with id 15bca65dae488cc31110e74be01af031579d82d5b43cc927fe3f1b8b92aa9737
Jul 20 22:22:51.617525 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.617495    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:22:51.619345 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.619328    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ppb7k"
Jul 20 22:22:51.624959 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.624129    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-stlkx"
Jul 20 22:22:51.630080 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.630058    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:22:51.631546 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:51.631523    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35575d5_3cb4_4d9c_9299_028678fdf2f9.slice/crio-5ee89c433601c29af3444a4ce2ed33bad2501b9fe08653e65bc5f5112792dbeb WatchSource:0}: Error finding container 5ee89c433601c29af3444a4ce2ed33bad2501b9fe08653e65bc5f5112792dbeb: Status 404 returned error can't find the container with id 5ee89c433601c29af3444a4ce2ed33bad2501b9fe08653e65bc5f5112792dbeb
Jul 20 22:22:51.632091 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:51.632033    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34bb54ec_e7a3_4b44_aca9_dd95fb23fbd5.slice/crio-fa207a3971e2611b399c42d7717159c487a33db93c2722e98e822980938c72ab WatchSource:0}: Error finding container fa207a3971e2611b399c42d7717159c487a33db93c2722e98e822980938c72ab: Status 404 returned error can't find the container with id fa207a3971e2611b399c42d7717159c487a33db93c2722e98e822980938c72ab
Jul 20 22:22:51.636084 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.636068    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gtjsg"
Jul 20 22:22:51.639509 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:51.639488    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda013ab7a_6a08_4fa3_9d00_78c44854ed02.slice/crio-511ff006b8b18ecac20801b097deb4e71374ae7f58699f99808b4de7d1b3f652 WatchSource:0}: Error finding container 511ff006b8b18ecac20801b097deb4e71374ae7f58699f99808b4de7d1b3f652: Status 404 returned error can't find the container with id 511ff006b8b18ecac20801b097deb4e71374ae7f58699f99808b4de7d1b3f652
Jul 20 22:22:51.639605 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.639546    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gltrx"
Jul 20 22:22:51.645992 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:51.645969    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01bb517c_e6d7_4f16_868f_0e88115b70a0.slice/crio-7519d814663de1fb7ed1762a9b770a0107b24146234fcf85075d074e37f4c905 WatchSource:0}: Error finding container 7519d814663de1fb7ed1762a9b770a0107b24146234fcf85075d074e37f4c905: Status 404 returned error can't find the container with id 7519d814663de1fb7ed1762a9b770a0107b24146234fcf85075d074e37f4c905
Jul 20 22:22:51.649675 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:22:51.649654    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48f5e91_5229_4b8c_bca2_cf6a0a146f1d.slice/crio-6e0c2669deac68930268808d99220ab867c92fe2ecc17768d90dafa9946c1bd6 WatchSource:0}: Error finding container 6e0c2669deac68930268808d99220ab867c92fe2ecc17768d90dafa9946c1bd6: Status 404 returned error can't find the container with id 6e0c2669deac68930268808d99220ab867c92fe2ecc17768d90dafa9946c1bd6
Jul 20 22:22:51.697579 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.697549    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:22:51.942506 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.942471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs\") pod \"network-metrics-daemon-xph8z\" (UID: \"e6638ee0-589b-4efa-a8f7-23574ca64eb2\") " pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:51.942683 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.942529    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcfq\" (UniqueName: \"kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq\") pod \"network-check-target-lj2px\" (UID: \"44df20fa-9e1f-4ba3-af38-a8c785d394c1\") " pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:22:51.942683 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:51.942648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:51.942829 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.942778    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:22:51.942886 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.942842    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret podName:7f7845cf-8b8f-4a86-8818-0a22d53cfd9a nodeName:}" failed. No retries permitted until 2026-07-20 22:22:52.942822581 +0000 UTC m=+3.058207190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret") pod "global-pull-secret-syncer-bzj9t" (UID: "7f7845cf-8b8f-4a86-8818-0a22d53cfd9a") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:22:51.943269 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.943251    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:22:51.943336 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.943304    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs podName:e6638ee0-589b-4efa-a8f7-23574ca64eb2 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:52.943288369 +0000 UTC m=+3.058672983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs") pod "network-metrics-daemon-xph8z" (UID: "e6638ee0-589b-4efa-a8f7-23574ca64eb2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:22:51.943424 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.943414    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:22:51.943480 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.943431    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:22:51.943480 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.943445    2579 projected.go:196] Error preparing data for projected volume kube-api-access-pwcfq for pod openshift-network-diagnostics/network-check-target-lj2px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:22:51.943663 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:51.943516    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq podName:44df20fa-9e1f-4ba3-af38-a8c785d394c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:52.943503247 +0000 UTC m=+3.058887858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwcfq" (UniqueName: "kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq") pod "network-check-target-lj2px" (UID: "44df20fa-9e1f-4ba3-af38-a8c785d394c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:22:52.060120 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.060087    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:22:52.289860 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.289761    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 22:17:51 +0000 UTC" deadline="2028-01-25 08:04:19.986465404 +0000 UTC"
Jul 20 22:22:52.289860 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.289805    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13281h41m27.696665273s"
Jul 20 22:22:52.363041 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.363010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:52.363213 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:52.363158    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:22:52.363627 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.363602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:22:52.363745 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:52.363707    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:22:52.363807 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.363778    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:52.363898 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:52.363875    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:22:52.388516 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.388309    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gltrx" event={"ID":"a48f5e91-5229-4b8c-bca2-cf6a0a146f1d","Type":"ContainerStarted","Data":"6e0c2669deac68930268808d99220ab867c92fe2ecc17768d90dafa9946c1bd6"}
Jul 20 22:22:52.410076 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.409954    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gtjsg" event={"ID":"01bb517c-e6d7-4f16-868f-0e88115b70a0","Type":"ContainerStarted","Data":"7519d814663de1fb7ed1762a9b770a0107b24146234fcf85075d074e37f4c905"}
Jul 20 22:22:52.424961 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.424918    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj" event={"ID":"a013ab7a-6a08-4fa3-9d00-78c44854ed02","Type":"ContainerStarted","Data":"511ff006b8b18ecac20801b097deb4e71374ae7f58699f99808b4de7d1b3f652"}
Jul 20 22:22:52.450913 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.445475    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-stlkx" event={"ID":"34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5","Type":"ContainerStarted","Data":"fa207a3971e2611b399c42d7717159c487a33db93c2722e98e822980938c72ab"}
Jul 20 22:22:52.453351 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.453154    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ppb7k" event={"ID":"f35575d5-3cb4-4d9c-9299-028678fdf2f9","Type":"ContainerStarted","Data":"5ee89c433601c29af3444a4ce2ed33bad2501b9fe08653e65bc5f5112792dbeb"}
Jul 20 22:22:52.462172 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.462134    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk" event={"ID":"b997bfdd-bd61-4467-b051-ff1d0399231f","Type":"ContainerStarted","Data":"001b8ee2fd036fb017bac84c52ae8c9a1ab37191e9cc764019bc92a5bfe67f99"}
Jul 20 22:22:52.482916 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.482840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kgkph" event={"ID":"ce976b70-1114-40c2-bb36-70023b6bd7ae","Type":"ContainerStarted","Data":"15bca65dae488cc31110e74be01af031579d82d5b43cc927fe3f1b8b92aa9737"}
Jul 20 22:22:52.515601 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.515526    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6v4z2" event={"ID":"c8ba7ac0-dac8-4650-874f-71fbae35f562","Type":"ContainerStarted","Data":"c9af6687741efd0846b70bc3d4d798c6640561395c390b7ac5f8039cc32256a4"}
Jul 20 22:22:52.534700 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.534532    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdr7h" event={"ID":"ca5f562e-8121-4b81-b5f5-58c5ebda891e","Type":"ContainerStarted","Data":"a24a29b56616953250071b332b50d4cb69cf662be6ce5e78a6bf90a9ddf2c51e"}
Jul 20 22:22:52.952316 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.952258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcfq\" (UniqueName: \"kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq\") pod \"network-check-target-lj2px\" (UID: \"44df20fa-9e1f-4ba3-af38-a8c785d394c1\") " pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:22:52.952521 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.952359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:52.952521 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:52.952391    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs\") pod \"network-metrics-daemon-xph8z\" (UID: \"e6638ee0-589b-4efa-a8f7-23574ca64eb2\") " pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:52.952521 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:52.952513    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:22:52.952692 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:52.952584    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs podName:e6638ee0-589b-4efa-a8f7-23574ca64eb2 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:54.952564183 +0000 UTC m=+5.067948806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs") pod "network-metrics-daemon-xph8z" (UID: "e6638ee0-589b-4efa-a8f7-23574ca64eb2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:22:52.953105 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:52.953040    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:22:52.953105 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:52.953066    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:22:52.953105 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:52.953079    2579 projected.go:196] Error preparing data for projected volume kube-api-access-pwcfq for pod openshift-network-diagnostics/network-check-target-lj2px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:22:52.953358 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:52.953127    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq podName:44df20fa-9e1f-4ba3-af38-a8c785d394c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:54.953111526 +0000 UTC m=+5.068496151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwcfq" (UniqueName: "kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq") pod "network-check-target-lj2px" (UID: "44df20fa-9e1f-4ba3-af38-a8c785d394c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:22:52.953358 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:52.953191    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:22:52.953358 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:52.953226    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret podName:7f7845cf-8b8f-4a86-8818-0a22d53cfd9a nodeName:}" failed. No retries permitted until 2026-07-20 22:22:54.953214631 +0000 UTC m=+5.068599252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret") pod "global-pull-secret-syncer-bzj9t" (UID: "7f7845cf-8b8f-4a86-8818-0a22d53cfd9a") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:22:53.290831 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:53.290695    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 22:17:51 +0000 UTC" deadline="2028-03-13 22:14:04.313893534 +0000 UTC"
Jul 20 22:22:53.290831 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:53.290767    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14447h51m11.023131407s"
Jul 20 22:22:54.263836 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:54.263759    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 22:22:54.363655 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:54.363377    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:22:54.364158 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:54.363774    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:22:54.364229 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:54.364214    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:54.364359 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:54.364330    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:22:54.367515 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:54.364700    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:54.367515 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:54.364796    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:22:54.971866 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:54.971826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs\") pod \"network-metrics-daemon-xph8z\" (UID: \"e6638ee0-589b-4efa-a8f7-23574ca64eb2\") " pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:54.972073 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:54.971888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcfq\" (UniqueName: \"kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq\") pod \"network-check-target-lj2px\" (UID: \"44df20fa-9e1f-4ba3-af38-a8c785d394c1\") " pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:22:54.972073 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:54.971961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:54.972200 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:54.972099    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:22:54.972200 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:54.972171    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret podName:7f7845cf-8b8f-4a86-8818-0a22d53cfd9a nodeName:}" failed. No retries permitted until 2026-07-20 22:22:58.97215143 +0000 UTC m=+9.087536057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret") pod "global-pull-secret-syncer-bzj9t" (UID: "7f7845cf-8b8f-4a86-8818-0a22d53cfd9a") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:22:54.972641 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:54.972499    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:22:54.972641 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:54.972526    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:22:54.972641 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:54.972541    2579 projected.go:196] Error preparing data for projected volume kube-api-access-pwcfq for pod openshift-network-diagnostics/network-check-target-lj2px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:22:54.972641 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:54.972550    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:22:54.972641 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:54.972600    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq podName:44df20fa-9e1f-4ba3-af38-a8c785d394c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:58.972582521 +0000 UTC m=+9.087967141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwcfq" (UniqueName: "kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq") pod "network-check-target-lj2px" (UID: "44df20fa-9e1f-4ba3-af38-a8c785d394c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:22:54.972641 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:54.972623    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs podName:e6638ee0-589b-4efa-a8f7-23574ca64eb2 nodeName:}" failed. No retries permitted until 2026-07-20 22:22:58.972611915 +0000 UTC m=+9.087996527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs") pod "network-metrics-daemon-xph8z" (UID: "e6638ee0-589b-4efa-a8f7-23574ca64eb2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:22:56.364026 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:56.363495    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:22:56.364026 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:56.363643    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:56.364026 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:56.363649    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:22:56.364026 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:56.363753    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:22:56.364026 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:56.363798    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:56.364026 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:56.363886    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:22:58.363325 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:58.362520    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:58.363325 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:58.362676    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:22:58.363325 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:58.362801    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:22:58.363325 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:58.363125    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:22:58.363325 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:58.363200    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:58.363325 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:58.363281    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:22:59.006673 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:59.006626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:22:59.006673 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:59.006680    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs\") pod \"network-metrics-daemon-xph8z\" (UID: \"e6638ee0-589b-4efa-a8f7-23574ca64eb2\") " pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:22:59.006927 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:22:59.006716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcfq\" (UniqueName: \"kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq\") pod \"network-check-target-lj2px\" (UID: \"44df20fa-9e1f-4ba3-af38-a8c785d394c1\") " pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:22:59.006927 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:59.006771    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:22:59.006927 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:59.006839    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:22:59.006927 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:59.006860    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:22:59.006927 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:59.006841    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret podName:7f7845cf-8b8f-4a86-8818-0a22d53cfd9a nodeName:}" failed. No retries permitted until 2026-07-20 22:23:07.006821934 +0000 UTC m=+17.122206557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret") pod "global-pull-secret-syncer-bzj9t" (UID: "7f7845cf-8b8f-4a86-8818-0a22d53cfd9a") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:22:59.006927 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:59.006882    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:22:59.006927 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:59.006887    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs podName:e6638ee0-589b-4efa-a8f7-23574ca64eb2 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:07.006876357 +0000 UTC m=+17.122260962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs") pod "network-metrics-daemon-xph8z" (UID: "e6638ee0-589b-4efa-a8f7-23574ca64eb2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:22:59.006927 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:59.006896    2579 projected.go:196] Error preparing data for projected volume kube-api-access-pwcfq for pod openshift-network-diagnostics/network-check-target-lj2px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:22:59.007374 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:22:59.006954    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq podName:44df20fa-9e1f-4ba3-af38-a8c785d394c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:07.006938664 +0000 UTC m=+17.122323285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwcfq" (UniqueName: "kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq") pod "network-check-target-lj2px" (UID: "44df20fa-9e1f-4ba3-af38-a8c785d394c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:00.363533 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:00.363485    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:00.363980 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:00.363605    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:00.364065 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:00.364004    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:00.364121 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:00.364107    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:00.364177 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:00.364149    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:00.364227 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:00.364217    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:02.362490 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:02.362459    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:02.362490 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:02.362492    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:02.363020 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:02.362581    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:02.363020 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:02.362624    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:02.363020 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:02.362717    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:02.363020 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:02.362830    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:04.363132 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:04.363091    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:04.363132 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:04.363132    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:04.363658 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:04.363091    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:04.363658 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:04.363237    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:04.363658 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:04.363327    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:04.363658 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:04.363417    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:06.363228 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:06.363194    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:06.363686 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:06.363197    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:06.363686 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:06.363335    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:06.363686 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:06.363331    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:06.363686 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:06.363427    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:06.363686 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:06.363497    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:07.067482 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:07.067447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:07.067482 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:07.067486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs\") pod \"network-metrics-daemon-xph8z\" (UID: \"e6638ee0-589b-4efa-a8f7-23574ca64eb2\") " pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:07.067738 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:07.067508    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcfq\" (UniqueName: \"kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq\") pod \"network-check-target-lj2px\" (UID: \"44df20fa-9e1f-4ba3-af38-a8c785d394c1\") " pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:07.067738 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:07.067619    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:07.067738 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:07.067636    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:07.067738 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:07.067648    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:07.067738 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:07.067657    2579 projected.go:196] Error preparing data for projected volume kube-api-access-pwcfq for pod openshift-network-diagnostics/network-check-target-lj2px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:07.067738 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:07.067620    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:07.067738 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:07.067686    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs podName:e6638ee0-589b-4efa-a8f7-23574ca64eb2 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:23.067669872 +0000 UTC m=+33.183054477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs") pod "network-metrics-daemon-xph8z" (UID: "e6638ee0-589b-4efa-a8f7-23574ca64eb2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:07.067738 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:07.067719    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq podName:44df20fa-9e1f-4ba3-af38-a8c785d394c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:23.067706798 +0000 UTC m=+33.183091402 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwcfq" (UniqueName: "kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq") pod "network-check-target-lj2px" (UID: "44df20fa-9e1f-4ba3-af38-a8c785d394c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:07.067738 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:07.067730    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret podName:7f7845cf-8b8f-4a86-8818-0a22d53cfd9a nodeName:}" failed. No retries permitted until 2026-07-20 22:23:23.067724141 +0000 UTC m=+33.183108744 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret") pod "global-pull-secret-syncer-bzj9t" (UID: "7f7845cf-8b8f-4a86-8818-0a22d53cfd9a") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:08.363183 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:08.363144    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:08.363806 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:08.363153    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:08.363806 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:08.363259    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:08.363806 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:08.363269    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:08.363806 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:08.363351    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:08.363806 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:08.363445    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:10.364648 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:10.364391    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:10.364648 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:10.364555    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:10.364648 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:10.364614    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:10.365188 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:10.364739    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:10.365188 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:10.365017    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:10.365287 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:10.365220    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:12.363416 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.363203    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:12.364200 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.363213    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:12.364200 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:12.363526    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:12.364200 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.363220    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:12.364200 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:12.363609    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:12.364200 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:12.363666    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:12.601487 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.601166    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-108.ec2.internal" event={"ID":"d4ee785b208346b7bd74e56028abfd5a","Type":"ContainerStarted","Data":"5f49636d5d986f6febefc1d191f23ce10ae784cd8704fc33b4aa09561c297159"}
Jul 20 22:23:12.602683 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.602653    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gltrx" event={"ID":"a48f5e91-5229-4b8c-bca2-cf6a0a146f1d","Type":"ContainerStarted","Data":"0f50ee46e0ce7c4c460cea586daaeb987f3d3b7475858e261af465508aab43c1"}
Jul 20 22:23:12.603926 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.603903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gtjsg" event={"ID":"01bb517c-e6d7-4f16-868f-0e88115b70a0","Type":"ContainerStarted","Data":"2ff143019dc438980bd6204e71cc608d5cf5c540a2446226c67296a46a47e801"}
Jul 20 22:23:12.606405 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.606383    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj" event={"ID":"a013ab7a-6a08-4fa3-9d00-78c44854ed02","Type":"ContainerStarted","Data":"6ab0924e4ab0271670abf13b13049e2224addcb57b34a3fb1a0bf73cf7809162"}
Jul 20 22:23:12.606487 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.606442    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj" event={"ID":"a013ab7a-6a08-4fa3-9d00-78c44854ed02","Type":"ContainerStarted","Data":"76e9654e44af34b3e0f56706fc16089a59eb6f53cee55f614934880ed1764221"}
Jul 20 22:23:12.606487 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.606472    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj" event={"ID":"a013ab7a-6a08-4fa3-9d00-78c44854ed02","Type":"ContainerStarted","Data":"748ed1c08a9441017388a3761e9611a60a94bcb436b85f7bae379e15c8fe0921"}
Jul 20 22:23:12.606572 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.606510    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj" event={"ID":"a013ab7a-6a08-4fa3-9d00-78c44854ed02","Type":"ContainerStarted","Data":"224a0d10b535e02c1c21cc2178f8f8668611f24c636b5c18298a04df39419ee7"}
Jul 20 22:23:12.606572 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.606538    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj" event={"ID":"a013ab7a-6a08-4fa3-9d00-78c44854ed02","Type":"ContainerStarted","Data":"dd416f6b13316ee04a486f4db2871b7fae2447a03c922dac91c22d5dfb94eed6"}
Jul 20 22:23:12.607665 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.607645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-stlkx" event={"ID":"34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5","Type":"ContainerStarted","Data":"68be330ab2f0b58d7eb98443f8f0b827f9efd91004004820a85b070ea9bb2ab3"}
Jul 20 22:23:12.608927 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.608910    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk" event={"ID":"b997bfdd-bd61-4467-b051-ff1d0399231f","Type":"ContainerStarted","Data":"0482ca443dbc8c7ce64c1501da968f8e5aae017a2a3cbdb7f23437efd9b36eeb"}
Jul 20 22:23:12.610232 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.610213    2579 generic.go:356] "Generic (PLEG): container finished" podID="7c7aa12efeeb70eb8d34c7816077c221" containerID="40513a52fc9abc8772b26249412fdc9e7b72c7b550868e3d760b58bf48f7ca85" exitCode=0
Jul 20 22:23:12.610320 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.610285    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal" event={"ID":"7c7aa12efeeb70eb8d34c7816077c221","Type":"ContainerDied","Data":"40513a52fc9abc8772b26249412fdc9e7b72c7b550868e3d760b58bf48f7ca85"}
Jul 20 22:23:12.611609 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.611589    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kgkph" event={"ID":"ce976b70-1114-40c2-bb36-70023b6bd7ae","Type":"ContainerStarted","Data":"0117ec65564ebabdb285ca917e9106daa099760e51602b19a21578b62b639cfb"}
Jul 20 22:23:12.612871 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.612856    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6v4z2" event={"ID":"c8ba7ac0-dac8-4650-874f-71fbae35f562","Type":"ContainerStarted","Data":"2b344e1402c2c3e99f06d9689ff1028e953df2ee78b6df34bd250bf0208e95cf"}
Jul 20 22:23:12.614150 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.614130    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca5f562e-8121-4b81-b5f5-58c5ebda891e" containerID="75eae72118c2bd7c42aaa61abd443be8ac9b0bf47ed148d21e3ae5d5dcd61d0a" exitCode=0
Jul 20 22:23:12.614230 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.614159    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdr7h" event={"ID":"ca5f562e-8121-4b81-b5f5-58c5ebda891e","Type":"ContainerDied","Data":"75eae72118c2bd7c42aaa61abd443be8ac9b0bf47ed148d21e3ae5d5dcd61d0a"}
Jul 20 22:23:12.621851 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.621814    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-108.ec2.internal" podStartSLOduration=21.621802398 podStartE2EDuration="21.621802398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:12.621353339 +0000 UTC m=+22.736737985" watchObservedRunningTime="2026-07-20 22:23:12.621802398 +0000 UTC m=+22.737187023"
Jul 20 22:23:12.686174 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.686124    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6v4z2" podStartSLOduration=2.5446820949999998 podStartE2EDuration="22.686108156s" totalImagesPullingTime="20.141426061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:12.685006084 +0000 UTC m=+22.800390710" watchObservedRunningTime="2026-07-20 22:23:12.686108156 +0000 UTC m=+22.801492781"
Jul 20 22:23:12.713110 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.713062    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gtjsg" podStartSLOduration=1.628488827 podStartE2EDuration="21.713046044s" totalImagesPullingTime="20.084557217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:12.712584822 +0000 UTC m=+22.827969448" watchObservedRunningTime="2026-07-20 22:23:12.713046044 +0000 UTC m=+22.828430670"
Jul 20 22:23:12.746795 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.746747    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gltrx" podStartSLOduration=1.688393566 podStartE2EDuration="21.746730946s" totalImagesPullingTime="20.05833738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:12.74657527 +0000 UTC m=+22.861959915" watchObservedRunningTime="2026-07-20 22:23:12.746730946 +0000 UTC m=+22.862115571"
Jul 20 22:23:12.772877 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.771953    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kgkph" podStartSLOduration=2.405492639 podStartE2EDuration="22.771932146s" totalImagesPullingTime="20.366439507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:12.770755729 +0000 UTC m=+22.886140356" watchObservedRunningTime="2026-07-20 22:23:12.771932146 +0000 UTC m=+22.887316773"
Jul 20 22:23:12.787103 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:12.787054    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-stlkx" podStartSLOduration=2.711274327 podStartE2EDuration="22.787038775s" totalImagesPullingTime="20.075764448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:12.786644931 +0000 UTC m=+22.902029567" watchObservedRunningTime="2026-07-20 22:23:12.787038775 +0000 UTC m=+22.902423400"
Jul 20 22:23:13.618757 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:13.618680    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj" event={"ID":"a013ab7a-6a08-4fa3-9d00-78c44854ed02","Type":"ContainerStarted","Data":"632add6a04ceda0d325fd38e5e8d9d537f4821db524e409dc5c7087ff93a4470"}
Jul 20 22:23:13.620217 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:13.620154    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ppb7k" event={"ID":"f35575d5-3cb4-4d9c-9299-028678fdf2f9","Type":"ContainerStarted","Data":"168e1df40358a7de0f673ced999d87c13ac933cd771cdc8c7147ab39d342615e"}
Jul 20 22:23:13.652775 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:13.652732    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ppb7k" podStartSLOduration=3.5767082500000003 podStartE2EDuration="23.652716118s" totalImagesPullingTime="20.076007868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:13.65266697 +0000 UTC m=+23.768051588" watchObservedRunningTime="2026-07-20 22:23:13.652716118 +0000 UTC m=+23.768100743"
Jul 20 22:23:13.764167 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:13.764132    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 22:23:13.938673 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:13.938591    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-stlkx"
Jul 20 22:23:13.939224 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:13.939204    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-stlkx"
Jul 20 22:23:14.302492 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:14.302334    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T22:23:13.764153662Z","UUID":"0ea75962-87fb-4083-9ffc-bf8316b1aac4","Handler":null,"Name":"","Endpoint":""}
Jul 20 22:23:14.304325 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:14.304291    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 22:23:14.304451 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:14.304361    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 22:23:14.362793 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:14.362764    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:14.363066 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:14.362773    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:14.363066 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:14.362895    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:14.363066 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:14.362905    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:14.363066 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:14.362984    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:14.363284 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:14.363077    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:14.625559 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:14.625470    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk" event={"ID":"b997bfdd-bd61-4467-b051-ff1d0399231f","Type":"ContainerStarted","Data":"cb917f97fa8134a22397f11b8071c2fe737d9c89d3de0114ddcbb56662cda394"}
Jul 20 22:23:14.627556 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:14.627523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal" event={"ID":"7c7aa12efeeb70eb8d34c7816077c221","Type":"ContainerStarted","Data":"1d8cd13ef59c6470ed0ed4d374c2d98e050b34c036e0ed258cfc8cb2d2518a4f"}
Jul 20 22:23:14.643086 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:14.643032    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-108.ec2.internal" podStartSLOduration=23.643015734 podStartE2EDuration="23.643015734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:14.642461411 +0000 UTC m=+24.757846055" watchObservedRunningTime="2026-07-20 22:23:14.643015734 +0000 UTC m=+24.758400350"
Jul 20 22:23:15.634138 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:15.634103    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj" event={"ID":"a013ab7a-6a08-4fa3-9d00-78c44854ed02","Type":"ContainerStarted","Data":"0d4bd6b757b4e5fd6480824f0c39d04b0dee7add5d60b48c53ec8baefd65381c"}
Jul 20 22:23:15.636344 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:15.636316    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk" event={"ID":"b997bfdd-bd61-4467-b051-ff1d0399231f","Type":"ContainerStarted","Data":"844c7c136103fea433bef74db6a1a74ad161f6b870b916235a65bf661d9e91b5"}
Jul 20 22:23:15.636462 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:15.636354    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 22:23:15.654492 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:15.654438    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpqk" podStartSLOduration=3.411499451 podStartE2EDuration="25.65441915s" totalImagesPullingTime="22.242919699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:15.654399412 +0000 UTC m=+25.769784038" watchObservedRunningTime="2026-07-20 22:23:15.65441915 +0000 UTC m=+25.769803758"
Jul 20 22:23:16.165164 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:16.165129    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-stlkx"
Jul 20 22:23:16.165909 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:16.165879    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-stlkx"
Jul 20 22:23:16.362529 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:16.362493    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:16.362713 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:16.362493    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:16.362713 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:16.362624    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:16.362830 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:16.362709    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:16.362830 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:16.362507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:16.362830 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:16.362796    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:17.646813 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:17.646603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj" event={"ID":"a013ab7a-6a08-4fa3-9d00-78c44854ed02","Type":"ContainerStarted","Data":"0c97dff6d05b3e9c72ffb004280f87fe93422a74faec9bdcd9f1da756d2ff52b"}
Jul 20 22:23:17.647753 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:17.646883    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:23:17.648573 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:17.648546    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca5f562e-8121-4b81-b5f5-58c5ebda891e" containerID="0fddef396c5f498f275bc4ff2874af29c6dce14cf0c4de56f96929f660382421" exitCode=0
Jul 20 22:23:17.648685 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:17.648623    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdr7h" event={"ID":"ca5f562e-8121-4b81-b5f5-58c5ebda891e","Type":"ContainerDied","Data":"0fddef396c5f498f275bc4ff2874af29c6dce14cf0c4de56f96929f660382421"}
Jul 20 22:23:17.664369 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:17.664339    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:23:17.681529 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:17.681478    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj" podStartSLOduration=6.542921473 podStartE2EDuration="26.681463356s" totalImagesPullingTime="20.138541883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:17.680961701 +0000 UTC m=+27.796346340" watchObservedRunningTime="2026-07-20 22:23:17.681463356 +0000 UTC m=+27.796847982"
Jul 20 22:23:18.365429 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:18.365139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:18.365633 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:18.365531    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:18.365633 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:18.365213    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:18.365633 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:18.365628    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:18.365801 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:18.365178    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:18.365801 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:18.365713    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:18.651273 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:18.651203    2579 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 20 22:23:18.651747 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:18.651716    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:23:18.666980 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:18.666949    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:23:19.007926 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:19.007893    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:23:19.121516 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:19.121482    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lj2px"]
Jul 20 22:23:19.121671 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:19.121607    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:19.121721 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:19.121690    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:19.124477 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:19.124451    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xph8z"]
Jul 20 22:23:19.124609 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:19.124568    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:19.124678 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:19.124661    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:19.133181 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:19.133148    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bzj9t"]
Jul 20 22:23:19.133336 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:19.133240    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:19.133407 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:19.133334    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:19.654782 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:19.654749    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca5f562e-8121-4b81-b5f5-58c5ebda891e" containerID="9db42aa1c07a04b05ad23f8b767276fb5ecdc5b7a41cf5253893d710f998d600" exitCode=0
Jul 20 22:23:19.655473 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:19.654832    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdr7h" event={"ID":"ca5f562e-8121-4b81-b5f5-58c5ebda891e","Type":"ContainerDied","Data":"9db42aa1c07a04b05ad23f8b767276fb5ecdc5b7a41cf5253893d710f998d600"}
Jul 20 22:23:20.363586 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:20.363552    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:20.363782 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:20.363662    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:20.363782 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:20.363744    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:20.363896 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:20.363870    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:21.363230 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:21.363144    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:21.363640 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:21.363251    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:21.661417 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:21.661281    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca5f562e-8121-4b81-b5f5-58c5ebda891e" containerID="cf03246c8492289e6fd781c5807309132f3a73d970959a13a1d73317d3adc37b" exitCode=0
Jul 20 22:23:21.661417 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:21.661333    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdr7h" event={"ID":"ca5f562e-8121-4b81-b5f5-58c5ebda891e","Type":"ContainerDied","Data":"cf03246c8492289e6fd781c5807309132f3a73d970959a13a1d73317d3adc37b"}
Jul 20 22:23:22.363597 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:22.363374    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:22.363997 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:22.363373    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:22.363997 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:22.363717    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:22.363997 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:22.363790    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:23.083841 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:23.083799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:23.084136 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:23.083854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs\") pod \"network-metrics-daemon-xph8z\" (UID: \"e6638ee0-589b-4efa-a8f7-23574ca64eb2\") " pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:23.084136 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:23.083894    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcfq\" (UniqueName: \"kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq\") pod \"network-check-target-lj2px\" (UID: \"44df20fa-9e1f-4ba3-af38-a8c785d394c1\") " pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:23.084136 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:23.083962    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:23.084136 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:23.084004    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:23.084136 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:23.084040    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 22:23:23.084136 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:23.084055    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 22:23:23.084136 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:23.084064    2579 projected.go:196] Error preparing data for projected volume kube-api-access-pwcfq for pod openshift-network-diagnostics/network-check-target-lj2px: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:23.084136 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:23.084043    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret podName:7f7845cf-8b8f-4a86-8818-0a22d53cfd9a nodeName:}" failed. No retries permitted until 2026-07-20 22:23:55.084023274 +0000 UTC m=+65.199407892 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret") pod "global-pull-secret-syncer-bzj9t" (UID: "7f7845cf-8b8f-4a86-8818-0a22d53cfd9a") : object "kube-system"/"original-pull-secret" not registered
Jul 20 22:23:23.084136 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:23.084128    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs podName:e6638ee0-589b-4efa-a8f7-23574ca64eb2 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:55.084112128 +0000 UTC m=+65.199496733 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs") pod "network-metrics-daemon-xph8z" (UID: "e6638ee0-589b-4efa-a8f7-23574ca64eb2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 22:23:23.084136 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:23.084143    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq podName:44df20fa-9e1f-4ba3-af38-a8c785d394c1 nodeName:}" failed. No retries permitted until 2026-07-20 22:23:55.084134522 +0000 UTC m=+65.199519129 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pwcfq" (UniqueName: "kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq") pod "network-check-target-lj2px" (UID: "44df20fa-9e1f-4ba3-af38-a8c785d394c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 22:23:23.362889 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:23.362809    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:23.363022 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:23.362974    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:24.362914 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:24.362870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:24.363398 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:24.362991    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:24.363398 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:24.363080    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lj2px" podUID="44df20fa-9e1f-4ba3-af38-a8c785d394c1"
Jul 20 22:23:24.363398 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:24.363115    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bzj9t" podUID="7f7845cf-8b8f-4a86-8818-0a22d53cfd9a"
Jul 20 22:23:25.363226 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.363189    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:25.363689 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:25.363326    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xph8z" podUID="e6638ee0-589b-4efa-a8f7-23574ca64eb2"
Jul 20 22:23:25.751208 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.751142    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-108.ec2.internal" event="NodeReady"
Jul 20 22:23:25.751396 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.751256    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 22:23:25.783761 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.783721    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b76b655b7-x7m2p"]
Jul 20 22:23:25.796001 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.795972    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2xhxc"]
Jul 20 22:23:25.796160 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.796100    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:25.799034 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.799013    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 22:23:25.799279 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.799263    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 22:23:25.799371 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.799357    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 22:23:25.799420 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.799392    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xc7zn\""
Jul 20 22:23:25.805872 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.805849    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 22:23:25.810151 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.810127    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-q6hnr"]
Jul 20 22:23:25.810276 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.810259    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:25.812710 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.812670    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4x2c5\""
Jul 20 22:23:25.812710 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.812686    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 22:23:25.812710 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.812706    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 22:23:25.832342 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.832314    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b76b655b7-x7m2p"]
Jul 20 22:23:25.832342 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.832348    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2xhxc"]
Jul 20 22:23:25.832528 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.832379    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q6hnr"]
Jul 20 22:23:25.832528 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.832459    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q6hnr"
Jul 20 22:23:25.834705 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.834676    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-679fm\""
Jul 20 22:23:25.834820 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.834706    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 22:23:25.834820 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.834749    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 22:23:25.834932 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.834828    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 22:23:25.903557 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.903525    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:25.903557 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.903560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-certificates\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:25.903760 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.903580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-image-registry-private-configuration\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:25.903760 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.903694    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-ca-trust-extracted\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:25.903760 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.903718    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-installation-pull-secrets\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:25.903760 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.903742    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:25.903885 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.903769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-trusted-ca\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:25.903885 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.903792    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gmqw\" (UniqueName: \"kubernetes.io/projected/d0eb750c-4154-4579-a580-b9f045a13f2d-kube-api-access-6gmqw\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:25.903885 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.903810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-bound-sa-token\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:25.903885 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.903825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0eb750c-4154-4579-a580-b9f045a13f2d-tmp-dir\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:25.904047 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.903885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd4qz\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-kube-api-access-kd4qz\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:25.904047 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:25.903914    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0eb750c-4154-4579-a580-b9f045a13f2d-config-volume\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:26.004735 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.004652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-image-registry-private-configuration\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.004735 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.004693    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br22d\" (UniqueName: \"kubernetes.io/projected/7495b474-3e57-4d01-8b10-5498d4384943-kube-api-access-br22d\") pod \"ingress-canary-q6hnr\" (UID: \"7495b474-3e57-4d01-8b10-5498d4384943\") " pod="openshift-ingress-canary/ingress-canary-q6hnr"
Jul 20 22:23:26.004942 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.004738    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-ca-trust-extracted\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.004942 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.004755    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-installation-pull-secrets\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.004942 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.004770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:26.004942 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.004786    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7495b474-3e57-4d01-8b10-5498d4384943-cert\") pod \"ingress-canary-q6hnr\" (UID: \"7495b474-3e57-4d01-8b10-5498d4384943\") " pod="openshift-ingress-canary/ingress-canary-q6hnr"
Jul 20 22:23:26.004942 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.004812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-trusted-ca\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.004942 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.004834    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gmqw\" (UniqueName: \"kubernetes.io/projected/d0eb750c-4154-4579-a580-b9f045a13f2d-kube-api-access-6gmqw\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:26.004942 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.004900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-bound-sa-token\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.005263 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.004945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0eb750c-4154-4579-a580-b9f045a13f2d-tmp-dir\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:26.005263 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.005003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd4qz\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-kube-api-access-kd4qz\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.005263 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:26.005027    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 22:23:26.005263 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:26.005090    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls podName:d0eb750c-4154-4579-a580-b9f045a13f2d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:26.505068404 +0000 UTC m=+36.620453015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls") pod "dns-default-2xhxc" (UID: "d0eb750c-4154-4579-a580-b9f045a13f2d") : secret "dns-default-metrics-tls" not found
Jul 20 22:23:26.005263 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.005031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0eb750c-4154-4579-a580-b9f045a13f2d-config-volume\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:26.005263 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.005212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.005263 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.005245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-certificates\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.005644 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:26.005374    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 22:23:26.005644 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:26.005391    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b76b655b7-x7m2p: secret "image-registry-tls" not found
Jul 20 22:23:26.005644 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:26.005453    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls podName:699c6c7a-0b4d-45d1-8671-b3e78a9fe9be nodeName:}" failed. No retries permitted until 2026-07-20 22:23:26.505435268 +0000 UTC m=+36.620819890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls") pod "image-registry-7b76b655b7-x7m2p" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be") : secret "image-registry-tls" not found
Jul 20 22:23:26.005644 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.005485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0eb750c-4154-4579-a580-b9f045a13f2d-tmp-dir\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:26.005838 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.005685    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d0eb750c-4154-4579-a580-b9f045a13f2d-config-volume\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:26.005838 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.005723    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-ca-trust-extracted\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.005838 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.005775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-certificates\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.005938 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.005889    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-trusted-ca\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.008856 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.008837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-image-registry-private-configuration\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.008917 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.008844    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-installation-pull-secrets\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.014756 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.014737    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-bound-sa-token\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.015014 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.014994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gmqw\" (UniqueName: \"kubernetes.io/projected/d0eb750c-4154-4579-a580-b9f045a13f2d-kube-api-access-6gmqw\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:26.015069 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.014994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd4qz\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-kube-api-access-kd4qz\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.105790 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.105758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7495b474-3e57-4d01-8b10-5498d4384943-cert\") pod \"ingress-canary-q6hnr\" (UID: \"7495b474-3e57-4d01-8b10-5498d4384943\") " pod="openshift-ingress-canary/ingress-canary-q6hnr"
Jul 20 22:23:26.105938 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.105854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br22d\" (UniqueName: \"kubernetes.io/projected/7495b474-3e57-4d01-8b10-5498d4384943-kube-api-access-br22d\") pod \"ingress-canary-q6hnr\" (UID: \"7495b474-3e57-4d01-8b10-5498d4384943\") " pod="openshift-ingress-canary/ingress-canary-q6hnr"
Jul 20 22:23:26.108716 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.108690    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7495b474-3e57-4d01-8b10-5498d4384943-cert\") pod \"ingress-canary-q6hnr\" (UID: \"7495b474-3e57-4d01-8b10-5498d4384943\") " pod="openshift-ingress-canary/ingress-canary-q6hnr"
Jul 20 22:23:26.115430 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.115408    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br22d\" (UniqueName: \"kubernetes.io/projected/7495b474-3e57-4d01-8b10-5498d4384943-kube-api-access-br22d\") pod \"ingress-canary-q6hnr\" (UID: \"7495b474-3e57-4d01-8b10-5498d4384943\") " pod="openshift-ingress-canary/ingress-canary-q6hnr"
Jul 20 22:23:26.140366 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.140342    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q6hnr"
Jul 20 22:23:26.277051 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.276793    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q6hnr"]
Jul 20 22:23:26.289583 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:23:26.289555    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7495b474_3e57_4d01_8b10_5498d4384943.slice/crio-83607c136d3e378c10bbb345f2c51847964e9ca686cc722f549fb8d776e67e37 WatchSource:0}: Error finding container 83607c136d3e378c10bbb345f2c51847964e9ca686cc722f549fb8d776e67e37: Status 404 returned error can't find the container with id 83607c136d3e378c10bbb345f2c51847964e9ca686cc722f549fb8d776e67e37
Jul 20 22:23:26.362522 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.362486    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:26.362522 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.362524    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:26.365115 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.365086    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 22:23:26.365791 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.365136    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 22:23:26.365791 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.365150    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sk5f6\""
Jul 20 22:23:26.365791 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.365149    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 22:23:26.510057 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.510025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:26.510214 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.510081    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:26.510214 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:26.510175    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 22:23:26.510214 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:26.510180    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 22:23:26.510328 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:26.510241    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls podName:d0eb750c-4154-4579-a580-b9f045a13f2d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:27.510226415 +0000 UTC m=+37.625611022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls") pod "dns-default-2xhxc" (UID: "d0eb750c-4154-4579-a580-b9f045a13f2d") : secret "dns-default-metrics-tls" not found
Jul 20 22:23:26.510328 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:26.510186    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b76b655b7-x7m2p: secret "image-registry-tls" not found
Jul 20 22:23:26.510397 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:26.510345    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls podName:699c6c7a-0b4d-45d1-8671-b3e78a9fe9be nodeName:}" failed. No retries permitted until 2026-07-20 22:23:27.510333125 +0000 UTC m=+37.625717732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls") pod "image-registry-7b76b655b7-x7m2p" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be") : secret "image-registry-tls" not found
Jul 20 22:23:26.675003 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.674919    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q6hnr" event={"ID":"7495b474-3e57-4d01-8b10-5498d4384943","Type":"ContainerStarted","Data":"83607c136d3e378c10bbb345f2c51847964e9ca686cc722f549fb8d776e67e37"}
Jul 20 22:23:26.678112 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.678078    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca5f562e-8121-4b81-b5f5-58c5ebda891e" containerID="5ea3ed7f61a9c9f591de57c64344fe8387346720a03913efaa7dcd511299540e" exitCode=0
Jul 20 22:23:26.678238 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:26.678125    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdr7h" event={"ID":"ca5f562e-8121-4b81-b5f5-58c5ebda891e","Type":"ContainerDied","Data":"5ea3ed7f61a9c9f591de57c64344fe8387346720a03913efaa7dcd511299540e"}
Jul 20 22:23:27.362564 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:27.362490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:27.364915 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:27.364889    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 22:23:27.365048 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:27.364897    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-br7rv\""
Jul 20 22:23:27.517656 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:27.517614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:27.518016 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:27.517688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:27.518016 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:27.517751    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 22:23:27.518016 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:27.517766    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b76b655b7-x7m2p: secret "image-registry-tls" not found
Jul 20 22:23:27.518016 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:27.517794    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 22:23:27.518016 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:27.517819    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls podName:699c6c7a-0b4d-45d1-8671-b3e78a9fe9be nodeName:}" failed. No retries permitted until 2026-07-20 22:23:29.517802785 +0000 UTC m=+39.633187389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls") pod "image-registry-7b76b655b7-x7m2p" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be") : secret "image-registry-tls" not found
Jul 20 22:23:27.518016 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:27.517836    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls podName:d0eb750c-4154-4579-a580-b9f045a13f2d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:29.517825709 +0000 UTC m=+39.633210314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls") pod "dns-default-2xhxc" (UID: "d0eb750c-4154-4579-a580-b9f045a13f2d") : secret "dns-default-metrics-tls" not found
Jul 20 22:23:27.683763 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:27.683689    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca5f562e-8121-4b81-b5f5-58c5ebda891e" containerID="a9144923704d81861e33b766b3a1dfe946a20c40b9d3293ef1061a5392f82c5c" exitCode=0
Jul 20 22:23:27.683763 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:27.683734    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdr7h" event={"ID":"ca5f562e-8121-4b81-b5f5-58c5ebda891e","Type":"ContainerDied","Data":"a9144923704d81861e33b766b3a1dfe946a20c40b9d3293ef1061a5392f82c5c"}
Jul 20 22:23:28.689822 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:28.689774    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qdr7h" event={"ID":"ca5f562e-8121-4b81-b5f5-58c5ebda891e","Type":"ContainerStarted","Data":"46ff3e9f217f07df62452fff898847da845a1e1879a0dd70cbb34db40b4e3fb6"}
Jul 20 22:23:28.691210 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:28.691184    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q6hnr" event={"ID":"7495b474-3e57-4d01-8b10-5498d4384943","Type":"ContainerStarted","Data":"06cca5b3c689f8ba87b3c2dc1c97bcd68a816ca31c51dab55014602bd057da82"}
Jul 20 22:23:28.719455 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:28.719397    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qdr7h" podStartSLOduration=7.690945254 podStartE2EDuration="38.719373766s" totalImagesPullingTime="31.028428512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:28.719152079 +0000 UTC m=+38.834536724" watchObservedRunningTime="2026-07-20 22:23:28.719373766 +0000 UTC m=+38.834758392"
Jul 20 22:23:28.738392 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:28.738336    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-q6hnr" podStartSLOduration=1.609143746 podStartE2EDuration="3.738318448s" totalImagesPullingTime="2.129174702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:28.737204656 +0000 UTC m=+38.852589282" watchObservedRunningTime="2026-07-20 22:23:28.738318448 +0000 UTC m=+38.853703052"
Jul 20 22:23:29.537385 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:29.537176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:29.537582 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:29.537414    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:29.537582 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:29.537351    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 22:23:29.537582 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:29.537519    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls podName:d0eb750c-4154-4579-a580-b9f045a13f2d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:33.537496897 +0000 UTC m=+43.652881508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls") pod "dns-default-2xhxc" (UID: "d0eb750c-4154-4579-a580-b9f045a13f2d") : secret "dns-default-metrics-tls" not found
Jul 20 22:23:29.537582 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:29.537519    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 22:23:29.537582 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:29.537539    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b76b655b7-x7m2p: secret "image-registry-tls" not found
Jul 20 22:23:29.537582 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:29.537568    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls podName:699c6c7a-0b4d-45d1-8671-b3e78a9fe9be nodeName:}" failed. No retries permitted until 2026-07-20 22:23:33.537559528 +0000 UTC m=+43.652944141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls") pod "image-registry-7b76b655b7-x7m2p" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be") : secret "image-registry-tls" not found
Jul 20 22:23:33.570249 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:33.570200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:33.570656 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:33.570272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:33.570656 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:33.570378    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 22:23:33.570656 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:33.570391    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 22:23:33.570656 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:33.570412    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b76b655b7-x7m2p: secret "image-registry-tls" not found
Jul 20 22:23:33.570656 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:33.570430    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls podName:d0eb750c-4154-4579-a580-b9f045a13f2d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:41.570416469 +0000 UTC m=+51.685801074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls") pod "dns-default-2xhxc" (UID: "d0eb750c-4154-4579-a580-b9f045a13f2d") : secret "dns-default-metrics-tls" not found
Jul 20 22:23:33.570656 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:33.570458    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls podName:699c6c7a-0b4d-45d1-8671-b3e78a9fe9be nodeName:}" failed. No retries permitted until 2026-07-20 22:23:41.57044321 +0000 UTC m=+51.685827814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls") pod "image-registry-7b76b655b7-x7m2p" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be") : secret "image-registry-tls" not found
Jul 20 22:23:34.896563 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:34.896528    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nsjv5"]
Jul 20 22:23:34.915250 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:34.915223    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nsjv5"]
Jul 20 22:23:34.915432 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:34.915349    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:34.917669 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:34.917646    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 22:23:34.917783 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:34.917689    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 22:23:34.918288 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:34.918265    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 22:23:34.918536 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:34.918522    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 22:23:34.918706 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:34.918692    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k67gj\""
Jul 20 22:23:35.082763 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.082737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01045907-aeb2-4610-b86b-d212c0e3782d-data-volume\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.082916 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.082769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.082916 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.082790    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrd74\" (UniqueName: \"kubernetes.io/projected/01045907-aeb2-4610-b86b-d212c0e3782d-kube-api-access-hrd74\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.082916 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.082831    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01045907-aeb2-4610-b86b-d212c0e3782d-crio-socket\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.082916 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.082865    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01045907-aeb2-4610-b86b-d212c0e3782d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.183758 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.183667    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01045907-aeb2-4610-b86b-d212c0e3782d-crio-socket\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.183758 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.183724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01045907-aeb2-4610-b86b-d212c0e3782d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.184044 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.183775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01045907-aeb2-4610-b86b-d212c0e3782d-data-volume\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.184044 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.183795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.184044 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.183813    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrd74\" (UniqueName: \"kubernetes.io/projected/01045907-aeb2-4610-b86b-d212c0e3782d-kube-api-access-hrd74\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.184044 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:35.183883    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 22:23:35.184044 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.183912    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01045907-aeb2-4610-b86b-d212c0e3782d-crio-socket\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.184044 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:35.183923    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:35.184044 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:35.183965    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01045907-aeb2-4610-b86b-d212c0e3782d-kube-rbac-proxy-cm podName:01045907-aeb2-4610-b86b-d212c0e3782d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:35.683944164 +0000 UTC m=+45.799328788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01045907-aeb2-4610-b86b-d212c0e3782d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsjv5" (UID: "01045907-aeb2-4610-b86b-d212c0e3782d") : configmap "kube-rbac-proxy" not found
Jul 20 22:23:35.184044 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:35.183998    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls podName:01045907-aeb2-4610-b86b-d212c0e3782d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:35.683979719 +0000 UTC m=+45.799364323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsjv5" (UID: "01045907-aeb2-4610-b86b-d212c0e3782d") : secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:35.184475 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.184193    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01045907-aeb2-4610-b86b-d212c0e3782d-data-volume\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.193336 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.193295    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrd74\" (UniqueName: \"kubernetes.io/projected/01045907-aeb2-4610-b86b-d212c0e3782d-kube-api-access-hrd74\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.688530 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.688493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.688819 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:35.688564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01045907-aeb2-4610-b86b-d212c0e3782d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:35.688819 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:35.688637    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 22:23:35.688819 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:35.688664    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:35.688819 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:35.688688    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01045907-aeb2-4610-b86b-d212c0e3782d-kube-rbac-proxy-cm podName:01045907-aeb2-4610-b86b-d212c0e3782d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:36.688675397 +0000 UTC m=+46.804060002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01045907-aeb2-4610-b86b-d212c0e3782d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsjv5" (UID: "01045907-aeb2-4610-b86b-d212c0e3782d") : configmap "kube-rbac-proxy" not found
Jul 20 22:23:35.688819 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:35.688728    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls podName:01045907-aeb2-4610-b86b-d212c0e3782d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:36.688710347 +0000 UTC m=+46.804094953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsjv5" (UID: "01045907-aeb2-4610-b86b-d212c0e3782d") : secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:36.695397 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:36.695359    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:36.695797 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:36.695430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01045907-aeb2-4610-b86b-d212c0e3782d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:36.695797 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:36.695516    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 22:23:36.695797 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:36.695519    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:36.695797 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:36.695573    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01045907-aeb2-4610-b86b-d212c0e3782d-kube-rbac-proxy-cm podName:01045907-aeb2-4610-b86b-d212c0e3782d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:38.695559274 +0000 UTC m=+48.810943878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01045907-aeb2-4610-b86b-d212c0e3782d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsjv5" (UID: "01045907-aeb2-4610-b86b-d212c0e3782d") : configmap "kube-rbac-proxy" not found
Jul 20 22:23:36.695797 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:36.695585    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls podName:01045907-aeb2-4610-b86b-d212c0e3782d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:38.695579954 +0000 UTC m=+48.810964558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsjv5" (UID: "01045907-aeb2-4610-b86b-d212c0e3782d") : secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:36.890805 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:36.890774    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6v4z2_c8ba7ac0-dac8-4650-874f-71fbae35f562/dns-node-resolver/0.log"
Jul 20 22:23:37.268324 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.268277    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-6jcfj"]
Jul 20 22:23:37.301321 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.301280    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-6jcfj"]
Jul 20 22:23:37.301479 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.301380    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-6jcfj"
Jul 20 22:23:37.304605 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.304585    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 20 22:23:37.305428 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.305398    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-k7gsh\""
Jul 20 22:23:37.305428 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.305405    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 20 22:23:37.305595 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.305503    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 20 22:23:37.305595 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.305407    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 20 22:23:37.401611 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.401574    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ee5da737-242c-485a-844d-4a5c96b0abcc-signing-key\") pod \"service-ca-58598695f7-6jcfj\" (UID: \"ee5da737-242c-485a-844d-4a5c96b0abcc\") " pod="openshift-service-ca/service-ca-58598695f7-6jcfj"
Jul 20 22:23:37.401791 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.401637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v62px\" (UniqueName: \"kubernetes.io/projected/ee5da737-242c-485a-844d-4a5c96b0abcc-kube-api-access-v62px\") pod \"service-ca-58598695f7-6jcfj\" (UID: \"ee5da737-242c-485a-844d-4a5c96b0abcc\") " pod="openshift-service-ca/service-ca-58598695f7-6jcfj"
Jul 20 22:23:37.401791 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.401755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ee5da737-242c-485a-844d-4a5c96b0abcc-signing-cabundle\") pod \"service-ca-58598695f7-6jcfj\" (UID: \"ee5da737-242c-485a-844d-4a5c96b0abcc\") " pod="openshift-service-ca/service-ca-58598695f7-6jcfj"
Jul 20 22:23:37.503279 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.503247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ee5da737-242c-485a-844d-4a5c96b0abcc-signing-key\") pod \"service-ca-58598695f7-6jcfj\" (UID: \"ee5da737-242c-485a-844d-4a5c96b0abcc\") " pod="openshift-service-ca/service-ca-58598695f7-6jcfj"
Jul 20 22:23:37.503495 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.503317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v62px\" (UniqueName: \"kubernetes.io/projected/ee5da737-242c-485a-844d-4a5c96b0abcc-kube-api-access-v62px\") pod \"service-ca-58598695f7-6jcfj\" (UID: \"ee5da737-242c-485a-844d-4a5c96b0abcc\") " pod="openshift-service-ca/service-ca-58598695f7-6jcfj"
Jul 20 22:23:37.503495 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.503373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ee5da737-242c-485a-844d-4a5c96b0abcc-signing-cabundle\") pod \"service-ca-58598695f7-6jcfj\" (UID: \"ee5da737-242c-485a-844d-4a5c96b0abcc\") " pod="openshift-service-ca/service-ca-58598695f7-6jcfj"
Jul 20 22:23:37.504047 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.504024    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ee5da737-242c-485a-844d-4a5c96b0abcc-signing-cabundle\") pod \"service-ca-58598695f7-6jcfj\" (UID: \"ee5da737-242c-485a-844d-4a5c96b0abcc\") " pod="openshift-service-ca/service-ca-58598695f7-6jcfj"
Jul 20 22:23:37.505713 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.505690    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ee5da737-242c-485a-844d-4a5c96b0abcc-signing-key\") pod \"service-ca-58598695f7-6jcfj\" (UID: \"ee5da737-242c-485a-844d-4a5c96b0abcc\") " pod="openshift-service-ca/service-ca-58598695f7-6jcfj"
Jul 20 22:23:37.517808 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.517778    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v62px\" (UniqueName: \"kubernetes.io/projected/ee5da737-242c-485a-844d-4a5c96b0abcc-kube-api-access-v62px\") pod \"service-ca-58598695f7-6jcfj\" (UID: \"ee5da737-242c-485a-844d-4a5c96b0abcc\") " pod="openshift-service-ca/service-ca-58598695f7-6jcfj"
Jul 20 22:23:37.610044 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.610016    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-6jcfj"
Jul 20 22:23:37.749516 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.749456    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-6jcfj"]
Jul 20 22:23:37.753421 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:23:37.753392    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5da737_242c_485a_844d_4a5c96b0abcc.slice/crio-e04b0eb33f158413acb1b5a4ad6855bcffca7ceab75fb58e70880da27b6dc2cb WatchSource:0}: Error finding container e04b0eb33f158413acb1b5a4ad6855bcffca7ceab75fb58e70880da27b6dc2cb: Status 404 returned error can't find the container with id e04b0eb33f158413acb1b5a4ad6855bcffca7ceab75fb58e70880da27b6dc2cb
Jul 20 22:23:37.887033 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:37.886962    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gltrx_a48f5e91-5229-4b8c-bca2-cf6a0a146f1d/node-ca/0.log"
Jul 20 22:23:38.712687 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:38.712638    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:38.712868 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:38.712748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01045907-aeb2-4610-b86b-d212c0e3782d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:38.712868 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:38.712787    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:38.712868 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:38.712863    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls podName:01045907-aeb2-4610-b86b-d212c0e3782d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:42.712846662 +0000 UTC m=+52.828231266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsjv5" (UID: "01045907-aeb2-4610-b86b-d212c0e3782d") : secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:38.713377 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:38.713354    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01045907-aeb2-4610-b86b-d212c0e3782d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:38.716498 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:38.716470    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-6jcfj" event={"ID":"ee5da737-242c-485a-844d-4a5c96b0abcc","Type":"ContainerStarted","Data":"e04b0eb33f158413acb1b5a4ad6855bcffca7ceab75fb58e70880da27b6dc2cb"}
Jul 20 22:23:38.889287 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:38.889260    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q6hnr_7495b474-3e57-4d01-8b10-5498d4384943/serve-healthcheck-canary/0.log"
Jul 20 22:23:40.724408 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:40.724370    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-6jcfj" event={"ID":"ee5da737-242c-485a-844d-4a5c96b0abcc","Type":"ContainerStarted","Data":"26dec05d69ae59ad8dfea6ee71ef2a6a8fa59094e40d9a26fa44174e6665f5a5"}
Jul 20 22:23:40.745344 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:40.745258    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-6jcfj" podStartSLOduration=1.703149113 podStartE2EDuration="3.745234383s" totalImagesPullingTime="2.04208527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:40.744251554 +0000 UTC m=+50.859636208" watchObservedRunningTime="2026-07-20 22:23:40.745234383 +0000 UTC m=+50.860619010"
Jul 20 22:23:41.635778 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:41.635738    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:41.635953 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:41.635839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:41.635996 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:41.635945    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 22:23:41.636037 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:41.635993    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 22:23:41.636037 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:41.636006    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b76b655b7-x7m2p: secret "image-registry-tls" not found
Jul 20 22:23:41.636037 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:41.636024    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls podName:d0eb750c-4154-4579-a580-b9f045a13f2d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:57.635995728 +0000 UTC m=+67.751380332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls") pod "dns-default-2xhxc" (UID: "d0eb750c-4154-4579-a580-b9f045a13f2d") : secret "dns-default-metrics-tls" not found
Jul 20 22:23:41.636144 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:41.636062    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls podName:699c6c7a-0b4d-45d1-8671-b3e78a9fe9be nodeName:}" failed. No retries permitted until 2026-07-20 22:23:57.636045742 +0000 UTC m=+67.751430353 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls") pod "image-registry-7b76b655b7-x7m2p" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be") : secret "image-registry-tls" not found
Jul 20 22:23:42.745842 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:42.745801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:42.746342 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:42.745945    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:42.746342 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:23:42.746003    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls podName:01045907-aeb2-4610-b86b-d212c0e3782d nodeName:}" failed. No retries permitted until 2026-07-20 22:23:50.745989149 +0000 UTC m=+60.861373755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsjv5" (UID: "01045907-aeb2-4610-b86b-d212c0e3782d") : secret "insights-runtime-extractor-tls" not found
Jul 20 22:23:50.667816 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:50.667787    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sldj"
Jul 20 22:23:50.806777 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:50.806733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:50.809015 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:50.808994    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01045907-aeb2-4610-b86b-d212c0e3782d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsjv5\" (UID: \"01045907-aeb2-4610-b86b-d212c0e3782d\") " pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:50.828473 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:50.828441    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k67gj\""
Jul 20 22:23:50.836273 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:50.836238    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nsjv5"
Jul 20 22:23:50.957806 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:50.957713    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nsjv5"]
Jul 20 22:23:50.961748 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:23:50.961715    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01045907_aeb2_4610_b86b_d212c0e3782d.slice/crio-f6135446090bc43bf2d9ea805009fc3bf1c06aa6212ffd03f5086f71b0210e94 WatchSource:0}: Error finding container f6135446090bc43bf2d9ea805009fc3bf1c06aa6212ffd03f5086f71b0210e94: Status 404 returned error can't find the container with id f6135446090bc43bf2d9ea805009fc3bf1c06aa6212ffd03f5086f71b0210e94
Jul 20 22:23:51.757215 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:51.757153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsjv5" event={"ID":"01045907-aeb2-4610-b86b-d212c0e3782d","Type":"ContainerStarted","Data":"f6135446090bc43bf2d9ea805009fc3bf1c06aa6212ffd03f5086f71b0210e94"}
Jul 20 22:23:55.145488 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.145449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:55.145903 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.145499    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs\") pod \"network-metrics-daemon-xph8z\" (UID: \"e6638ee0-589b-4efa-a8f7-23574ca64eb2\") " pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:55.145903 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.145536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcfq\" (UniqueName: \"kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq\") pod \"network-check-target-lj2px\" (UID: \"44df20fa-9e1f-4ba3-af38-a8c785d394c1\") " pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:55.147963 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.147936    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 22:23:55.147963 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.147952    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 22:23:55.148151 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.148078    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 22:23:55.157968 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.157778    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 22:23:55.158168 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.158130    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f7845cf-8b8f-4a86-8818-0a22d53cfd9a-original-pull-secret\") pod \"global-pull-secret-syncer-bzj9t\" (UID: \"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a\") " pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:55.158244 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.158233    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6638ee0-589b-4efa-a8f7-23574ca64eb2-metrics-certs\") pod \"network-metrics-daemon-xph8z\" (UID: \"e6638ee0-589b-4efa-a8f7-23574ca64eb2\") " pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:55.168940 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.168911    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwcfq\" (UniqueName: \"kubernetes.io/projected/44df20fa-9e1f-4ba3-af38-a8c785d394c1-kube-api-access-pwcfq\") pod \"network-check-target-lj2px\" (UID: \"44df20fa-9e1f-4ba3-af38-a8c785d394c1\") " pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:55.172703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.172651    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bzj9t"
Jul 20 22:23:55.180249 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.180227    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sk5f6\""
Jul 20 22:23:55.188378 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.188331    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:23:55.274682 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.274649    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-br7rv\""
Jul 20 22:23:55.282860 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.282826    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xph8z"
Jul 20 22:23:55.877924 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:55.877897    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bzj9t"]
Jul 20 22:23:55.881435 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:23:55.881406    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7845cf_8b8f_4a86_8818_0a22d53cfd9a.slice/crio-c5b9cc5309404ec12988e44b164e163d370ad85612b73d364ccd19d04b9ad991 WatchSource:0}: Error finding container c5b9cc5309404ec12988e44b164e163d370ad85612b73d364ccd19d04b9ad991: Status 404 returned error can't find the container with id c5b9cc5309404ec12988e44b164e163d370ad85612b73d364ccd19d04b9ad991
Jul 20 22:23:56.103552 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:56.103480    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lj2px"]
Jul 20 22:23:56.106400 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:56.106373    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xph8z"]
Jul 20 22:23:56.106790 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:23:56.106767    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44df20fa_9e1f_4ba3_af38_a8c785d394c1.slice/crio-bd6f936ac379b9fd37c4574a1816c2ec39a481c3bb377fc6be031a8fa6c7ac4f WatchSource:0}: Error finding container bd6f936ac379b9fd37c4574a1816c2ec39a481c3bb377fc6be031a8fa6c7ac4f: Status 404 returned error can't find the container with id bd6f936ac379b9fd37c4574a1816c2ec39a481c3bb377fc6be031a8fa6c7ac4f
Jul 20 22:23:56.109526 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:23:56.109502    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6638ee0_589b_4efa_a8f7_23574ca64eb2.slice/crio-8359d728dafef99a8b6133a0653aa954399353ab3123bc6eaa406f08e4a5c838 WatchSource:0}: Error finding container 8359d728dafef99a8b6133a0653aa954399353ab3123bc6eaa406f08e4a5c838: Status 404 returned error can't find the container with id 8359d728dafef99a8b6133a0653aa954399353ab3123bc6eaa406f08e4a5c838
Jul 20 22:23:56.778701 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:56.778661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsjv5" event={"ID":"01045907-aeb2-4610-b86b-d212c0e3782d","Type":"ContainerStarted","Data":"b0b90017fd77652cd65b9786b3c287fe48c8b7e8f17b683d50d009dcf4d0f858"}
Jul 20 22:23:56.781376 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:56.781293    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lj2px" event={"ID":"44df20fa-9e1f-4ba3-af38-a8c785d394c1","Type":"ContainerStarted","Data":"bd6f936ac379b9fd37c4574a1816c2ec39a481c3bb377fc6be031a8fa6c7ac4f"}
Jul 20 22:23:56.783263 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:56.783236    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xph8z" event={"ID":"e6638ee0-589b-4efa-a8f7-23574ca64eb2","Type":"ContainerStarted","Data":"8359d728dafef99a8b6133a0653aa954399353ab3123bc6eaa406f08e4a5c838"}
Jul 20 22:23:56.784818 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:56.784769    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bzj9t" event={"ID":"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a","Type":"ContainerStarted","Data":"c5b9cc5309404ec12988e44b164e163d370ad85612b73d364ccd19d04b9ad991"}
Jul 20 22:23:57.667344 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.666413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:57.667344 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.666504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:57.671510 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.671448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls\") pod \"image-registry-7b76b655b7-x7m2p\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") " pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:57.676287 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.676257    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d0eb750c-4154-4579-a580-b9f045a13f2d-metrics-tls\") pod \"dns-default-2xhxc\" (UID: \"d0eb750c-4154-4579-a580-b9f045a13f2d\") " pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:57.791029 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.790845    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xph8z" event={"ID":"e6638ee0-589b-4efa-a8f7-23574ca64eb2","Type":"ContainerStarted","Data":"503e24b018c0d8606867fa679f1c934b6d779922c9cbb2f3667f66e0ec7307d4"}
Jul 20 22:23:57.791029 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.790948    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xph8z" event={"ID":"e6638ee0-589b-4efa-a8f7-23574ca64eb2","Type":"ContainerStarted","Data":"883778f3cc1b3718802bf3836f75d015d92ef2ea56f159de90c8058077da8719"}
Jul 20 22:23:57.813580 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.813511    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xph8z" podStartSLOduration=66.436382847 podStartE2EDuration="1m7.813489759s" totalImagesPullingTime="1.377106912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:23:57.812491026 +0000 UTC m=+67.927875678" watchObservedRunningTime="2026-07-20 22:23:57.813489759 +0000 UTC m=+67.928874386"
Jul 20 22:23:57.909937 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.909908    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xc7zn\""
Jul 20 22:23:57.917290 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.917234    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:23:57.921779 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.921754    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4x2c5\""
Jul 20 22:23:57.929262 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.928962    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:23:57.943916 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.942828    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6"]
Jul 20 22:23:57.946020 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.945835    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6"
Jul 20 22:23:57.950036 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.950001    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 22:23:57.950472 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.950451    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 22:23:57.950948 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.950928    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 20 22:23:57.951256 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.951238    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bb7cz\""
Jul 20 22:23:57.951494 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.951476    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 22:23:57.964589 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.964558    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6"]
Jul 20 22:23:57.988872 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:57.988831    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b76b655b7-x7m2p"]
Jul 20 22:23:58.069572 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.069477    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg7wt\" (UniqueName: \"kubernetes.io/projected/2663b601-ccd3-4314-8ce5-6a93c643eb51-kube-api-access-rg7wt\") pod \"managed-serviceaccount-addon-agent-6fb47d8778-6fxt6\" (UID: \"2663b601-ccd3-4314-8ce5-6a93c643eb51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6"
Jul 20 22:23:58.069572 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.069550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2663b601-ccd3-4314-8ce5-6a93c643eb51-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6fb47d8778-6fxt6\" (UID: \"2663b601-ccd3-4314-8ce5-6a93c643eb51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6"
Jul 20 22:23:58.114800 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.114766    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-z8fbc"]
Jul 20 22:23:58.119890 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.119861    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55d5d8fd47-lrx9f"]
Jul 20 22:23:58.120060 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.120007    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-z8fbc"
Jul 20 22:23:58.121980 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.121957    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp"]
Jul 20 22:23:58.122797 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.122774    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.125089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.124468    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp"
Jul 20 22:23:58.125089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.124905    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 22:23:58.125089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.125061    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 22:23:58.128592 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.128575    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 20 22:23:58.129892 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.129871    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 20 22:23:58.131216 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.131195    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-swm5t\""
Jul 20 22:23:58.136569 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.136539    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-z8fbc"]
Jul 20 22:23:58.146217 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.146154    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp"]
Jul 20 22:23:58.149688 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.149471    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wswl6\""
Jul 20 22:23:58.162025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.161995    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55d5d8fd47-lrx9f"]
Jul 20 22:23:58.170495 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.170456    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-image-registry-private-configuration\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.170645 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.170514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-trusted-ca\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.170645 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.170554    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-registry-certificates\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.170645 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.170580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-registry-tls\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.170645 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.170623    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg7wt\" (UniqueName: \"kubernetes.io/projected/2663b601-ccd3-4314-8ce5-6a93c643eb51-kube-api-access-rg7wt\") pod \"managed-serviceaccount-addon-agent-6fb47d8778-6fxt6\" (UID: \"2663b601-ccd3-4314-8ce5-6a93c643eb51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6"
Jul 20 22:23:58.170889 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.170651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43b7b7fb-df23-498e-b7c4-3bef917dcbc0-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zjgkp\" (UID: \"43b7b7fb-df23-498e-b7c4-3bef917dcbc0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp"
Jul 20 22:23:58.170889 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.170828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-bound-sa-token\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.170889 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.170862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2663b601-ccd3-4314-8ce5-6a93c643eb51-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6fb47d8778-6fxt6\" (UID: \"2663b601-ccd3-4314-8ce5-6a93c643eb51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6"
Jul 20 22:23:58.171041 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.170901    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc8ds\" (UniqueName: \"kubernetes.io/projected/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-kube-api-access-wc8ds\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.171041 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.170930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-ca-trust-extracted\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.171041 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.170965    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/43b7b7fb-df23-498e-b7c4-3bef917dcbc0-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-zjgkp\" (UID: \"43b7b7fb-df23-498e-b7c4-3bef917dcbc0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp"
Jul 20 22:23:58.171041 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.170999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k76r9\" (UniqueName: \"kubernetes.io/projected/2fb0f170-2c9e-4b05-8eb4-a93a4cc598f6-kube-api-access-k76r9\") pod \"downloads-5bc67dcd46-z8fbc\" (UID: \"2fb0f170-2c9e-4b05-8eb4-a93a4cc598f6\") " pod="openshift-console/downloads-5bc67dcd46-z8fbc"
Jul 20 22:23:58.171239 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.171040    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-installation-pull-secrets\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.173968 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.173928    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2663b601-ccd3-4314-8ce5-6a93c643eb51-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6fb47d8778-6fxt6\" (UID: \"2663b601-ccd3-4314-8ce5-6a93c643eb51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6"
Jul 20 22:23:58.204506 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.204474    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg7wt\" (UniqueName: \"kubernetes.io/projected/2663b601-ccd3-4314-8ce5-6a93c643eb51-kube-api-access-rg7wt\") pod \"managed-serviceaccount-addon-agent-6fb47d8778-6fxt6\" (UID: \"2663b601-ccd3-4314-8ce5-6a93c643eb51\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6"
Jul 20 22:23:58.268097 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.268040    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6"
Jul 20 22:23:58.271389 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.271358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc8ds\" (UniqueName: \"kubernetes.io/projected/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-kube-api-access-wc8ds\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.271540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.271404    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-ca-trust-extracted\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.271540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.271439    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/43b7b7fb-df23-498e-b7c4-3bef917dcbc0-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-zjgkp\" (UID: \"43b7b7fb-df23-498e-b7c4-3bef917dcbc0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp"
Jul 20 22:23:58.271540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.271472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k76r9\" (UniqueName: \"kubernetes.io/projected/2fb0f170-2c9e-4b05-8eb4-a93a4cc598f6-kube-api-access-k76r9\") pod \"downloads-5bc67dcd46-z8fbc\" (UID: \"2fb0f170-2c9e-4b05-8eb4-a93a4cc598f6\") " pod="openshift-console/downloads-5bc67dcd46-z8fbc"
Jul 20 22:23:58.271540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.271503    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-installation-pull-secrets\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.271540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.271531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-image-registry-private-configuration\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.271821 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.271561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-trusted-ca\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.271821 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.271595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-registry-certificates\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.271821 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.271636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-registry-tls\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.271821 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.271673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43b7b7fb-df23-498e-b7c4-3bef917dcbc0-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zjgkp\" (UID: \"43b7b7fb-df23-498e-b7c4-3bef917dcbc0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp"
Jul 20 22:23:58.271821 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.271711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-bound-sa-token\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.272450 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.272207    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-ca-trust-extracted\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.272712 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.272557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/43b7b7fb-df23-498e-b7c4-3bef917dcbc0-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-zjgkp\" (UID: \"43b7b7fb-df23-498e-b7c4-3bef917dcbc0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp"
Jul 20 22:23:58.273313 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.273257    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-registry-certificates\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.273618 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.273504    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-trusted-ca\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.275960 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.275911    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/43b7b7fb-df23-498e-b7c4-3bef917dcbc0-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-zjgkp\" (UID: \"43b7b7fb-df23-498e-b7c4-3bef917dcbc0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp"
Jul 20 22:23:58.276502 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.276460    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-installation-pull-secrets\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.276604 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.276541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-image-registry-private-configuration\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.276774 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.276752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-registry-tls\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.293087 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.293015    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-bound-sa-token\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.295501 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.295448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k76r9\" (UniqueName: \"kubernetes.io/projected/2fb0f170-2c9e-4b05-8eb4-a93a4cc598f6-kube-api-access-k76r9\") pod \"downloads-5bc67dcd46-z8fbc\" (UID: \"2fb0f170-2c9e-4b05-8eb4-a93a4cc598f6\") " pod="openshift-console/downloads-5bc67dcd46-z8fbc"
Jul 20 22:23:58.295633 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.295569    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc8ds\" (UniqueName: \"kubernetes.io/projected/a9869e93-8ba5-4240-a1ca-3bf6582f56a3-kube-api-access-wc8ds\") pod \"image-registry-55d5d8fd47-lrx9f\" (UID: \"a9869e93-8ba5-4240-a1ca-3bf6582f56a3\") " pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.437553 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.437523    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-z8fbc"
Jul 20 22:23:58.447603 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.447569    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:23:58.453018 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:23:58.452993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp"
Jul 20 22:24:03.150058 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.150020    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-z8fbc"]
Jul 20 22:24:03.152625 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:24:03.152594    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb0f170_2c9e_4b05_8eb4_a93a4cc598f6.slice/crio-57f34bdd26449a9070437dd6b39403dc86f09832b1a00c8f3c5dbe9b260015ad WatchSource:0}: Error finding container 57f34bdd26449a9070437dd6b39403dc86f09832b1a00c8f3c5dbe9b260015ad: Status 404 returned error can't find the container with id 57f34bdd26449a9070437dd6b39403dc86f09832b1a00c8f3c5dbe9b260015ad
Jul 20 22:24:03.282911 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.282829    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6"]
Jul 20 22:24:03.285547 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:24:03.285512    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2663b601_ccd3_4314_8ce5_6a93c643eb51.slice/crio-fabb22538ab5336309218d810bc9bba6ab6d3afd08b4778193ad3d6589d62d78 WatchSource:0}: Error finding container fabb22538ab5336309218d810bc9bba6ab6d3afd08b4778193ad3d6589d62d78: Status 404 returned error can't find the container with id fabb22538ab5336309218d810bc9bba6ab6d3afd08b4778193ad3d6589d62d78
Jul 20 22:24:03.290854 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.290229    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp"]
Jul 20 22:24:03.294726 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.294651    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b76b655b7-x7m2p"]
Jul 20 22:24:03.296208 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.296185    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2xhxc"]
Jul 20 22:24:03.297257 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.297227    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55d5d8fd47-lrx9f"]
Jul 20 22:24:03.298616 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:24:03.298169    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9869e93_8ba5_4240_a1ca_3bf6582f56a3.slice/crio-ae4c67f3f0beead454d615138021ca3fb4780458f62cf78e7ba9062b6b8d2926 WatchSource:0}: Error finding container ae4c67f3f0beead454d615138021ca3fb4780458f62cf78e7ba9062b6b8d2926: Status 404 returned error can't find the container with id ae4c67f3f0beead454d615138021ca3fb4780458f62cf78e7ba9062b6b8d2926
Jul 20 22:24:03.816052 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.816004    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bzj9t" event={"ID":"7f7845cf-8b8f-4a86-8818-0a22d53cfd9a","Type":"ContainerStarted","Data":"84074689d094c642a491904c697325ad20a74a8457f135f7b5d812a80b44bc99"}
Jul 20 22:24:03.819373 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.818658    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f" event={"ID":"a9869e93-8ba5-4240-a1ca-3bf6582f56a3","Type":"ContainerStarted","Data":"3ecbed143631703e499a36868ac8da3b7b2ced386534ed2bf4a7598391db16cc"}
Jul 20 22:24:03.819373 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.818716    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f" event={"ID":"a9869e93-8ba5-4240-a1ca-3bf6582f56a3","Type":"ContainerStarted","Data":"ae4c67f3f0beead454d615138021ca3fb4780458f62cf78e7ba9062b6b8d2926"}
Jul 20 22:24:03.819373 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.818939    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:24:03.821379 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.821348    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6" event={"ID":"2663b601-ccd3-4314-8ce5-6a93c643eb51","Type":"ContainerStarted","Data":"fabb22538ab5336309218d810bc9bba6ab6d3afd08b4778193ad3d6589d62d78"}
Jul 20 22:24:03.824606 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.824577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p" event={"ID":"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be","Type":"ContainerStarted","Data":"d28472aef762953910407ccebad58dca9c271da803ce03cc602b65d4b19a51d7"}
Jul 20 22:24:03.824741 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.824625    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p" event={"ID":"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be","Type":"ContainerStarted","Data":"abf181624406a21de02e3a2bd69752eecbd914584549619a015de7e3a3cebc77"}
Jul 20 22:24:03.824869 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.824833    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:24:03.827390 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.827294    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2xhxc" event={"ID":"d0eb750c-4154-4579-a580-b9f045a13f2d","Type":"ContainerStarted","Data":"ce4d5638a3fcc657031af38ef9a150b1bea05d8be4b50adf8dff68cf45d6d9c4"}
Jul 20 22:24:03.834333 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.833879    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bzj9t" podStartSLOduration=65.887582047 podStartE2EDuration="1m12.833860369s" totalImagesPullingTime="6.946278322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:03.832673208 +0000 UTC m=+73.948057854" watchObservedRunningTime="2026-07-20 22:24:03.833860369 +0000 UTC m=+73.949244992"
Jul 20 22:24:03.836472 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.836389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp" event={"ID":"43b7b7fb-df23-498e-b7c4-3bef917dcbc0","Type":"ContainerStarted","Data":"341c33d57a3ed2783e16f54ebd34af0888bfc367d1e9fc03ed6e4b6cdbdd6da3"}
Jul 20 22:24:03.839794 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.839710    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsjv5" event={"ID":"01045907-aeb2-4610-b86b-d212c0e3782d","Type":"ContainerStarted","Data":"6b75fa94c97ce903f8106dade01d483d7ad54f8aed1564eea9ee1d5bc09c507c"}
Jul 20 22:24:03.841966 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.841891    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-z8fbc" event={"ID":"2fb0f170-2c9e-4b05-8eb4-a93a4cc598f6","Type":"ContainerStarted","Data":"57f34bdd26449a9070437dd6b39403dc86f09832b1a00c8f3c5dbe9b260015ad"}
Jul 20 22:24:03.847444 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.846829    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lj2px" event={"ID":"44df20fa-9e1f-4ba3-af38-a8c785d394c1","Type":"ContainerStarted","Data":"cf73c74f33091fa0e6082086438236dc0ab6f8b982b5c07cc87e3713f2cf35e0"}
Jul 20 22:24:03.847444 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.847385    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:24:03.852368 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.851987    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f" podStartSLOduration=5.851968663 podStartE2EDuration="5.851968663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:03.851098223 +0000 UTC m=+73.966482868" watchObservedRunningTime="2026-07-20 22:24:03.851968663 +0000 UTC m=+73.967353290"
Jul 20 22:24:03.887327 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.887105    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p" podStartSLOduration=41.887082133 podStartE2EDuration="41.887082133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:03.871103599 +0000 UTC m=+73.986488251" watchObservedRunningTime="2026-07-20 22:24:03.887082133 +0000 UTC m=+74.002466759"
Jul 20 22:24:03.887954 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:03.887609    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lj2px" podStartSLOduration=66.16831042 podStartE2EDuration="1m12.887592847s" totalImagesPullingTime="6.719282427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:03.886569661 +0000 UTC m=+74.001954288" watchObservedRunningTime="2026-07-20 22:24:03.887592847 +0000 UTC m=+74.002977475"
Jul 20 22:24:05.859326 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:05.859209    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2xhxc" event={"ID":"d0eb750c-4154-4579-a580-b9f045a13f2d","Type":"ContainerStarted","Data":"c5468a143268b7da6866080841601f32f5e7c5bffdaed94f1281010d5c652679"}
Jul 20 22:24:05.862432 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:05.862360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp" event={"ID":"43b7b7fb-df23-498e-b7c4-3bef917dcbc0","Type":"ContainerStarted","Data":"332de946639a2c5a6104b1f99ee01d879d22d264fb4e312b1d980086f87dcf77"}
Jul 20 22:24:05.881582 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:05.881406    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-zjgkp" podStartSLOduration=5.667991096 podStartE2EDuration="7.88138059s" totalImagesPullingTime="2.213389494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:05.879335516 +0000 UTC m=+75.994720142" watchObservedRunningTime="2026-07-20 22:24:05.88138059 +0000 UTC m=+75.996765218"
Jul 20 22:24:08.530667 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.530637    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-574b9b7fc4-hg5z8"]
Jul 20 22:24:08.533264 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.533243    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.535932 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.535727    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 22:24:08.535932 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.535823    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-s2db9\""
Jul 20 22:24:08.536600 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.536530    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 22:24:08.536600 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.536586    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 22:24:08.536779 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.536705    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 22:24:08.536894 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.536840    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 22:24:08.544649 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.544603    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-574b9b7fc4-hg5z8"]
Jul 20 22:24:08.671115 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.671032    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-console-config\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.671115 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.671085    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-oauth-serving-cert\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.671115 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.671122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c823891b-f18c-49e3-af0e-d88a51704877-console-serving-cert\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.671763 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.671264    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c823891b-f18c-49e3-af0e-d88a51704877-console-oauth-config\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.671763 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.671369    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-service-ca\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.671763 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.671409    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqx4x\" (UniqueName: \"kubernetes.io/projected/c823891b-f18c-49e3-af0e-d88a51704877-kube-api-access-hqx4x\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.772368 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.772265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqx4x\" (UniqueName: \"kubernetes.io/projected/c823891b-f18c-49e3-af0e-d88a51704877-kube-api-access-hqx4x\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.772368 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.772358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-console-config\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.772626 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.772393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-oauth-serving-cert\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.772626 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.772423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c823891b-f18c-49e3-af0e-d88a51704877-console-serving-cert\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.772626 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.772457    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c823891b-f18c-49e3-af0e-d88a51704877-console-oauth-config\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.772626 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.772504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-service-ca\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.773339 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.773284    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-oauth-serving-cert\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.773474 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.773451    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-console-config\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.773538 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.773510    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-service-ca\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.775531 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.775509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c823891b-f18c-49e3-af0e-d88a51704877-console-oauth-config\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.775667 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.775651    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c823891b-f18c-49e3-af0e-d88a51704877-console-serving-cert\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.781864 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.781815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqx4x\" (UniqueName: \"kubernetes.io/projected/c823891b-f18c-49e3-af0e-d88a51704877-kube-api-access-hqx4x\") pod \"console-574b9b7fc4-hg5z8\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") " pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:08.845609 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:08.845525    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:09.098002 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.097934    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-574b9b7fc4-hg5z8"]
Jul 20 22:24:09.102331 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:24:09.102284    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc823891b_f18c_49e3_af0e_d88a51704877.slice/crio-cf587dfcec910e96267eaee2ae35c1a477301614b544cb9de0aaf3f6685cfc10 WatchSource:0}: Error finding container cf587dfcec910e96267eaee2ae35c1a477301614b544cb9de0aaf3f6685cfc10: Status 404 returned error can't find the container with id cf587dfcec910e96267eaee2ae35c1a477301614b544cb9de0aaf3f6685cfc10
Jul 20 22:24:09.577899 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.577865    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"]
Jul 20 22:24:09.580666 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.580643    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:09.583335 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.583284    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 22:24:09.583455 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.583334    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 22:24:09.584121 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.584100    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 20 22:24:09.584254 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.584229    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 20 22:24:09.584254 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.584241    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 22:24:09.584439 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.584384    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8j4s2\""
Jul 20 22:24:09.589578 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.589543    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"]
Jul 20 22:24:09.681592 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.681545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/973b0173-f06b-447b-843b-6e9c83d936b3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-nnvvs\" (UID: \"973b0173-f06b-447b-843b-6e9c83d936b3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:09.681787 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.681623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/973b0173-f06b-447b-843b-6e9c83d936b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-nnvvs\" (UID: \"973b0173-f06b-447b-843b-6e9c83d936b3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:09.681862 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.681798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r92f\" (UniqueName: \"kubernetes.io/projected/973b0173-f06b-447b-843b-6e9c83d936b3-kube-api-access-9r92f\") pod \"prometheus-operator-5945b5cfd-nnvvs\" (UID: \"973b0173-f06b-447b-843b-6e9c83d936b3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:09.681862 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.681831    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/973b0173-f06b-447b-843b-6e9c83d936b3-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-nnvvs\" (UID: \"973b0173-f06b-447b-843b-6e9c83d936b3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:09.782952 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.782913    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/973b0173-f06b-447b-843b-6e9c83d936b3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-nnvvs\" (UID: \"973b0173-f06b-447b-843b-6e9c83d936b3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:09.783140 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.782987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/973b0173-f06b-447b-843b-6e9c83d936b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-nnvvs\" (UID: \"973b0173-f06b-447b-843b-6e9c83d936b3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:09.783140 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.783036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r92f\" (UniqueName: \"kubernetes.io/projected/973b0173-f06b-447b-843b-6e9c83d936b3-kube-api-access-9r92f\") pod \"prometheus-operator-5945b5cfd-nnvvs\" (UID: \"973b0173-f06b-447b-843b-6e9c83d936b3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:09.783140 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.783066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/973b0173-f06b-447b-843b-6e9c83d936b3-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-nnvvs\" (UID: \"973b0173-f06b-447b-843b-6e9c83d936b3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:09.783140 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:24:09.783106    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 20 22:24:09.783892 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:24:09.783872    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/973b0173-f06b-447b-843b-6e9c83d936b3-prometheus-operator-tls podName:973b0173-f06b-447b-843b-6e9c83d936b3 nodeName:}" failed. No retries permitted until 2026-07-20 22:24:10.283847277 +0000 UTC m=+80.399231897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/973b0173-f06b-447b-843b-6e9c83d936b3-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-nnvvs" (UID: "973b0173-f06b-447b-843b-6e9c83d936b3") : secret "prometheus-operator-tls" not found
Jul 20 22:24:09.784005 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.783904    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/973b0173-f06b-447b-843b-6e9c83d936b3-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-nnvvs\" (UID: \"973b0173-f06b-447b-843b-6e9c83d936b3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:09.786156 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.786113    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/973b0173-f06b-447b-843b-6e9c83d936b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-nnvvs\" (UID: \"973b0173-f06b-447b-843b-6e9c83d936b3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:09.795521 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.795495    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r92f\" (UniqueName: \"kubernetes.io/projected/973b0173-f06b-447b-843b-6e9c83d936b3-kube-api-access-9r92f\") pod \"prometheus-operator-5945b5cfd-nnvvs\" (UID: \"973b0173-f06b-447b-843b-6e9c83d936b3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:09.881151 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.881114    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6" event={"ID":"2663b601-ccd3-4314-8ce5-6a93c643eb51","Type":"ContainerStarted","Data":"b4202f1395031dc1e6317fabd1ab581109bcef6cf3292900b7d312f0e35e1308"}
Jul 20 22:24:09.883336 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.883181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2xhxc" event={"ID":"d0eb750c-4154-4579-a580-b9f045a13f2d","Type":"ContainerStarted","Data":"7f2bf98c323d321b65691fd70d654d1fd68ea878b862b9bd98542698709a6cf6"}
Jul 20 22:24:09.884115 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.884092    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:24:09.890983 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.890459    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsjv5" event={"ID":"01045907-aeb2-4610-b86b-d212c0e3782d","Type":"ContainerStarted","Data":"15c458aae2ba4d138b28bff3cb259b07416e977a50355f7921ea3209a8bd21a2"}
Jul 20 22:24:09.892894 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.892864    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574b9b7fc4-hg5z8" event={"ID":"c823891b-f18c-49e3-af0e-d88a51704877","Type":"ContainerStarted","Data":"cf587dfcec910e96267eaee2ae35c1a477301614b544cb9de0aaf3f6685cfc10"}
Jul 20 22:24:09.901018 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.900866    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6fb47d8778-6fxt6" podStartSLOduration=7.234401666 podStartE2EDuration="12.900846458s" totalImagesPullingTime="5.666444792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:09.898499413 +0000 UTC m=+80.013884040" watchObservedRunningTime="2026-07-20 22:24:09.900846458 +0000 UTC m=+80.016231085"
Jul 20 22:24:09.919378 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.919254    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2xhxc" podStartSLOduration=42.700776994 podStartE2EDuration="44.919231296s" totalImagesPullingTime="2.218454302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:09.918689329 +0000 UTC m=+80.034073952" watchObservedRunningTime="2026-07-20 22:24:09.919231296 +0000 UTC m=+80.034615962"
Jul 20 22:24:09.941193 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:09.940870    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nsjv5" podStartSLOduration=18.187415645 podStartE2EDuration="35.940850679s" totalImagesPullingTime="17.753435034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 22:23:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:09.940161705 +0000 UTC m=+80.055546332" watchObservedRunningTime="2026-07-20 22:24:09.940850679 +0000 UTC m=+80.056235305"
Jul 20 22:24:10.287727 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:10.287633    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/973b0173-f06b-447b-843b-6e9c83d936b3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-nnvvs\" (UID: \"973b0173-f06b-447b-843b-6e9c83d936b3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:10.290821 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:10.290766    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/973b0173-f06b-447b-843b-6e9c83d936b3-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-nnvvs\" (UID: \"973b0173-f06b-447b-843b-6e9c83d936b3\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:10.492358 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:10.492256    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"
Jul 20 22:24:10.675610 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:10.675539    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs"]
Jul 20 22:24:10.679665 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:24:10.679621    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973b0173_f06b_447b_843b_6e9c83d936b3.slice/crio-599d4537a699cb131a368640eb408ffc0a72eecd41f09d76421147d228aa042c WatchSource:0}: Error finding container 599d4537a699cb131a368640eb408ffc0a72eecd41f09d76421147d228aa042c: Status 404 returned error can't find the container with id 599d4537a699cb131a368640eb408ffc0a72eecd41f09d76421147d228aa042c
Jul 20 22:24:10.899371 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:10.899228    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs" event={"ID":"973b0173-f06b-447b-843b-6e9c83d936b3","Type":"ContainerStarted","Data":"599d4537a699cb131a368640eb408ffc0a72eecd41f09d76421147d228aa042c"}
Jul 20 22:24:12.910253 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:12.910101    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs" event={"ID":"973b0173-f06b-447b-843b-6e9c83d936b3","Type":"ContainerStarted","Data":"41e2cdf640f9ccafef1b5d7a5fdadd1afd255b23a2c93ed3d44800eb9de0ec58"}
Jul 20 22:24:12.910253 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:12.910208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs" event={"ID":"973b0173-f06b-447b-843b-6e9c83d936b3","Type":"ContainerStarted","Data":"2808f8f7ee953faa536b780baf29d1d37107d6db084c6235691b01100d2163b5"}
Jul 20 22:24:12.912562 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:12.912482    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574b9b7fc4-hg5z8" event={"ID":"c823891b-f18c-49e3-af0e-d88a51704877","Type":"ContainerStarted","Data":"dfe94bd1592b05ab813eeace74c41bdfaeb4449387ba9c7603b4516743a54748"}
Jul 20 22:24:12.929621 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:12.929563    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-nnvvs" podStartSLOduration=1.913064012 podStartE2EDuration="3.929540899s" totalImagesPullingTime="2.016476887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:12.927742838 +0000 UTC m=+83.043127465" watchObservedRunningTime="2026-07-20 22:24:12.929540899 +0000 UTC m=+83.044925526"
Jul 20 22:24:12.947086 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:12.946974    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-574b9b7fc4-hg5z8" podStartSLOduration=1.3490968269999999 podStartE2EDuration="4.946958005s" totalImagesPullingTime="3.597861178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:12.945165386 +0000 UTC m=+83.060550022" watchObservedRunningTime="2026-07-20 22:24:12.946958005 +0000 UTC m=+83.062342631"
Jul 20 22:24:14.991930 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:14.991898    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bhmkx"]
Jul 20 22:24:14.996645 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:14.996617    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:14.998878 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:14.998771    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 22:24:14.999075 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:14.999052    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 22:24:14.999217 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:14.999197    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 22:24:14.999276 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:14.999257    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cdfk7\""
Jul 20 22:24:15.129166 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.129126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-wtmp\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.129394 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.129179    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-textfile\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.129394 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.129205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/23f2f526-b010-410a-a41e-73f9403a386e-root\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.129394 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.129288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.129394 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.129358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23f2f526-b010-410a-a41e-73f9403a386e-sys\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.129639 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.129399    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-tls\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.129639 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.129440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.129639 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.129471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23f2f526-b010-410a-a41e-73f9403a386e-metrics-client-ca\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.129639 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.129494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77fjx\" (UniqueName: \"kubernetes.io/projected/23f2f526-b010-410a-a41e-73f9403a386e-kube-api-access-77fjx\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.230453 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.230417    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-tls\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.230453 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.230459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.230694 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.230484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23f2f526-b010-410a-a41e-73f9403a386e-metrics-client-ca\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.230694 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.230513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77fjx\" (UniqueName: \"kubernetes.io/projected/23f2f526-b010-410a-a41e-73f9403a386e-kube-api-access-77fjx\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.230694 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.230566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-wtmp\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.230694 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.230600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-textfile\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.230694 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.230624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/23f2f526-b010-410a-a41e-73f9403a386e-root\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.230694 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.230674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.231035 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.230706    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23f2f526-b010-410a-a41e-73f9403a386e-sys\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.231035 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.230787    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/23f2f526-b010-410a-a41e-73f9403a386e-sys\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.231035 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.230916    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-wtmp\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.231035 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.230970    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/23f2f526-b010-410a-a41e-73f9403a386e-root\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.231659 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.231322    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-accelerators-collector-config\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.231659 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.231428    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-textfile\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.231933 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.231883    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/23f2f526-b010-410a-a41e-73f9403a386e-metrics-client-ca\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.233711 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.233688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-tls\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.233860 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.233837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/23f2f526-b010-410a-a41e-73f9403a386e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.243878 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.243794    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77fjx\" (UniqueName: \"kubernetes.io/projected/23f2f526-b010-410a-a41e-73f9403a386e-kube-api-access-77fjx\") pod \"node-exporter-bhmkx\" (UID: \"23f2f526-b010-410a-a41e-73f9403a386e\") " pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:15.310148 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:15.310113    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bhmkx"
Jul 20 22:24:16.025892 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.025855    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:24:16.036760 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.036724    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.039164 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.039133    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 22:24:16.039319 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.039179    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 22:24:16.039319 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.039193    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5km2s\""
Jul 20 22:24:16.039870 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.039680    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 22:24:16.039870 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.039692    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 22:24:16.039870 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.039740    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 22:24:16.040091 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.039976    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 22:24:16.040091 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.039984    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 22:24:16.040091 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.040009    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 22:24:16.040091 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.039984    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 22:24:16.047977 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.047809    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:24:16.138734 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.138699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.138734 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.138743    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.138967 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.138772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.138967 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.138797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.138967 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.138874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-config-out\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.138967 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.138916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.138967 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.138954    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-web-config\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.139217 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.138980    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.139217 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.139002    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.139217 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.139045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-config-volume\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.139217 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.139061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.139217 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.139084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.139217 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.139196    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnkkp\" (UniqueName: \"kubernetes.io/projected/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-kube-api-access-pnkkp\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.240325 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.240269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnkkp\" (UniqueName: \"kubernetes.io/projected/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-kube-api-access-pnkkp\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.240520 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.240338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.240520 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.240367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.240520 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.240393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.240520 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.240419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.240520 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.240455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-config-out\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.240520 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.240486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.240520 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.240518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-web-config\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.240870 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.240543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.240870 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:24:16.240792    2579 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 20 22:24:16.240870 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.240829    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.241026 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:24:16.240899    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-main-tls podName:3c98b4f3-b4db-4800-ad08-c0bf81600ef2 nodeName:}" failed. No retries permitted until 2026-07-20 22:24:16.740866267 +0000 UTC m=+86.856250872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2") : secret "alertmanager-main-tls" not found
Jul 20 22:24:16.241146 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:24:16.241127    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-trusted-ca-bundle podName:3c98b4f3-b4db-4800-ad08-c0bf81600ef2 nodeName:}" failed. No retries permitted until 2026-07-20 22:24:16.741101697 +0000 UTC m=+86.856486313 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2") : configmap references non-existent config key: ca-bundle.crt
Jul 20 22:24:16.241331 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.241285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.241426 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.241348    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.241426 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.241376    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-config-volume\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.241535 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.241403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.241535 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.241462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.244521 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.244496    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.245435 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.244859    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.245525 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.245485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.245918 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.245747    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-web-config\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.246272 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.246240    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-config-volume\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.247130 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.247088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.247684 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.247477    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-config-out\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.247778 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.247700    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.259266 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.259212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnkkp\" (UniqueName: \"kubernetes.io/projected/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-kube-api-access-pnkkp\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.747089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.747047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.747267 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.747127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.748183 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.748158    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.749790 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.749767    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:16.950148 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:16.950108    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:24:17.906043 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:17.906012    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2xhxc"
Jul 20 22:24:18.061708 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.061675    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5455dd967b-4wc2v"]
Jul 20 22:24:18.136579 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.136528    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5455dd967b-4wc2v"]
Jul 20 22:24:18.136765 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.136643    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.139096 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.139067    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 20 22:24:18.139236 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.139067    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 20 22:24:18.139574 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.139346    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 20 22:24:18.139574 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.139504    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 20 22:24:18.139574 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.139558    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 20 22:24:18.139796 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.139728    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ejh7thrf5029i\""
Jul 20 22:24:18.139855 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.139800    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-m7c8m\""
Jul 20 22:24:18.261991 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.261894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.261991 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.261953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.261991 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.261985    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-grpc-tls\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.262281 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.262037    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-tls\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.262281 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.262059    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-metrics-client-ca\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.262281 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.262086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hlxj\" (UniqueName: \"kubernetes.io/projected/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-kube-api-access-6hlxj\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.262281 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.262108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.262281 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.262234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.363537 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.363484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.363759 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.363589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.363759 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.363622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.363759 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.363655    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-grpc-tls\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.363759 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.363700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-tls\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.363759 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.363726    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-metrics-client-ca\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.363759 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.363758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hlxj\" (UniqueName: \"kubernetes.io/projected/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-kube-api-access-6hlxj\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.364076 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.363787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.364632 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.364601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-metrics-client-ca\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.367343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.367269    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.367832 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.367786    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.368499 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.368376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.368499 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.368412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-tls\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.368654 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.368552    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.369077 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.369047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-secret-grpc-tls\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.380080 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.380052    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hlxj\" (UniqueName: \"kubernetes.io/projected/21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01-kube-api-access-6hlxj\") pod \"thanos-querier-5455dd967b-4wc2v\" (UID: \"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01\") " pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.448509 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.448465    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:18.846217 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.846179    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:18.846428 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.846250    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:18.851708 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.851684    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:18.942327 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:18.942276    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:24:20.110175 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.110143    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7787949944-q8kq7"]
Jul 20 22:24:20.221396 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.221351    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7787949944-q8kq7"]
Jul 20 22:24:20.221589 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.221507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.224118 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.224082    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-hrr5c\""
Jul 20 22:24:20.224254 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.224124    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 20 22:24:20.224254 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.224132    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 20 22:24:20.224378 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.224346    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 20 22:24:20.224511 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.224485    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 20 22:24:20.224635 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.224557    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 20 22:24:20.229891 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.229851    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 20 22:24:20.381521 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.381435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/10eb4fd1-c451-491e-bd56-dab94fe124c6-federate-client-tls\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.381521 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.381482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/10eb4fd1-c451-491e-bd56-dab94fe124c6-telemeter-client-tls\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.381723 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.381545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10eb4fd1-c451-491e-bd56-dab94fe124c6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.381723 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.381590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10eb4fd1-c451-491e-bd56-dab94fe124c6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.381723 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.381635    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10eb4fd1-c451-491e-bd56-dab94fe124c6-metrics-client-ca\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.381723 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.381670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/10eb4fd1-c451-491e-bd56-dab94fe124c6-secret-telemeter-client\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.381858 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.381742    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcqgb\" (UniqueName: \"kubernetes.io/projected/10eb4fd1-c451-491e-bd56-dab94fe124c6-kube-api-access-rcqgb\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.381858 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.381820    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10eb4fd1-c451-491e-bd56-dab94fe124c6-serving-certs-ca-bundle\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.482275 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.482239    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10eb4fd1-c451-491e-bd56-dab94fe124c6-serving-certs-ca-bundle\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.482473 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.482317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/10eb4fd1-c451-491e-bd56-dab94fe124c6-federate-client-tls\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.482473 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.482348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/10eb4fd1-c451-491e-bd56-dab94fe124c6-telemeter-client-tls\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.482473 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.482372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10eb4fd1-c451-491e-bd56-dab94fe124c6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.482473 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.482398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10eb4fd1-c451-491e-bd56-dab94fe124c6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.482473 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.482428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10eb4fd1-c451-491e-bd56-dab94fe124c6-metrics-client-ca\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.482473 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.482459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/10eb4fd1-c451-491e-bd56-dab94fe124c6-secret-telemeter-client\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.483088 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.483068    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10eb4fd1-c451-491e-bd56-dab94fe124c6-serving-certs-ca-bundle\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.483201 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.483110    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10eb4fd1-c451-491e-bd56-dab94fe124c6-metrics-client-ca\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.483201 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.483164    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcqgb\" (UniqueName: \"kubernetes.io/projected/10eb4fd1-c451-491e-bd56-dab94fe124c6-kube-api-access-rcqgb\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.483390 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.483340    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10eb4fd1-c451-491e-bd56-dab94fe124c6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.485617 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.485589    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/10eb4fd1-c451-491e-bd56-dab94fe124c6-secret-telemeter-client\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.485726 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.485651    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/10eb4fd1-c451-491e-bd56-dab94fe124c6-federate-client-tls\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.485829 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.485809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/10eb4fd1-c451-491e-bd56-dab94fe124c6-telemeter-client-tls\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.486146 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.486123    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10eb4fd1-c451-491e-bd56-dab94fe124c6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.493405 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.493377    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcqgb\" (UniqueName: \"kubernetes.io/projected/10eb4fd1-c451-491e-bd56-dab94fe124c6-kube-api-access-rcqgb\") pod \"telemeter-client-7787949944-q8kq7\" (UID: \"10eb4fd1-c451-491e-bd56-dab94fe124c6\") " pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:20.534383 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:20.534345    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7787949944-q8kq7"
Jul 20 22:24:21.832894 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:24:21.832850    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f2f526_b010_410a_a41e_73f9403a386e.slice/crio-ec6c3c7a2ebad42f3cee809e8a70965492efded13678a184265b861f9426ed5a WatchSource:0}: Error finding container ec6c3c7a2ebad42f3cee809e8a70965492efded13678a184265b861f9426ed5a: Status 404 returned error can't find the container with id ec6c3c7a2ebad42f3cee809e8a70965492efded13678a184265b861f9426ed5a
Jul 20 22:24:21.951951 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:21.951873    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhmkx" event={"ID":"23f2f526-b010-410a-a41e-73f9403a386e","Type":"ContainerStarted","Data":"ec6c3c7a2ebad42f3cee809e8a70965492efded13678a184265b861f9426ed5a"}
Jul 20 22:24:21.984345 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:21.984316    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5455dd967b-4wc2v"]
Jul 20 22:24:22.004998 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:22.004976    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:24:22.024608 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:22.021457    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7787949944-q8kq7"]
Jul 20 22:24:22.113860 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:24:22.113824    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a78d7c_1bd0_4f8a_8bcb_51f289ab6a01.slice/crio-956e6f6a076f7fed4192a2c3815dfec0333c24e7cdfa2dac5ab4bb3375f5ec6f WatchSource:0}: Error finding container 956e6f6a076f7fed4192a2c3815dfec0333c24e7cdfa2dac5ab4bb3375f5ec6f: Status 404 returned error can't find the container with id 956e6f6a076f7fed4192a2c3815dfec0333c24e7cdfa2dac5ab4bb3375f5ec6f
Jul 20 22:24:22.114762 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:24:22.114442    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c98b4f3_b4db_4800_ad08_c0bf81600ef2.slice/crio-f2099a726c9770f36bff55401c46c654600e0c83bea127056f2af31b7b2e6a44 WatchSource:0}: Error finding container f2099a726c9770f36bff55401c46c654600e0c83bea127056f2af31b7b2e6a44: Status 404 returned error can't find the container with id f2099a726c9770f36bff55401c46c654600e0c83bea127056f2af31b7b2e6a44
Jul 20 22:24:22.115402 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:24:22.115356    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10eb4fd1_c451_491e_bd56_dab94fe124c6.slice/crio-dcdcdb4ccd5d110f214fbdde6550e67d3001007f99a2b0d9f158e230f3acf45a WatchSource:0}: Error finding container dcdcdb4ccd5d110f214fbdde6550e67d3001007f99a2b0d9f158e230f3acf45a: Status 404 returned error can't find the container with id dcdcdb4ccd5d110f214fbdde6550e67d3001007f99a2b0d9f158e230f3acf45a
Jul 20 22:24:22.956324 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:22.956271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerStarted","Data":"f2099a726c9770f36bff55401c46c654600e0c83bea127056f2af31b7b2e6a44"}
Jul 20 22:24:22.957536 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:22.957502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7787949944-q8kq7" event={"ID":"10eb4fd1-c451-491e-bd56-dab94fe124c6","Type":"ContainerStarted","Data":"dcdcdb4ccd5d110f214fbdde6550e67d3001007f99a2b0d9f158e230f3acf45a"}
Jul 20 22:24:22.959010 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:22.958982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-z8fbc" event={"ID":"2fb0f170-2c9e-4b05-8eb4-a93a4cc598f6","Type":"ContainerStarted","Data":"3b7eba2d618f92ef22dc2899fef4c97522d2dff2159f4110a4bd9dda42435a99"}
Jul 20 22:24:22.959121 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:22.959031    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-z8fbc"
Jul 20 22:24:22.960281 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:22.960254    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v" event={"ID":"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01","Type":"ContainerStarted","Data":"956e6f6a076f7fed4192a2c3815dfec0333c24e7cdfa2dac5ab4bb3375f5ec6f"}
Jul 20 22:24:22.960788 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:22.960765    2579 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-z8fbc container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused" start-of-body=
Jul 20 22:24:22.960851 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:22.960813    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-z8fbc" podUID="2fb0f170-2c9e-4b05-8eb4-a93a4cc598f6" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.12:8080/\": dial tcp 10.133.0.12:8080: connect: connection refused"
Jul 20 22:24:22.981092 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:22.981033    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-z8fbc" podStartSLOduration=5.354819086 podStartE2EDuration="24.981014937s" totalImagesPullingTime="19.626195851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:23:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:22.979544933 +0000 UTC m=+93.094929560" watchObservedRunningTime="2026-07-20 22:24:22.981014937 +0000 UTC m=+93.096399563"
Jul 20 22:24:23.393941 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.393907    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59d5977b98-tt5xn"]
Jul 20 22:24:23.403026 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.402995    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.422678 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.422646    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 22:24:23.423555 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.423523    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d5977b98-tt5xn"]
Jul 20 22:24:23.507743 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.507318    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vql9j\" (UniqueName: \"kubernetes.io/projected/affe6578-5d38-400e-9f47-0a5b6d255ae9-kube-api-access-vql9j\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.507743 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.507374    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-oauth-config\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.507743 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.507428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-serving-cert\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.507743 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.507458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-config\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.507743 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.507490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-service-ca\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.507743 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.507522    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-trusted-ca-bundle\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.507743 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.507548    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-oauth-serving-cert\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.611171 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.608761    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vql9j\" (UniqueName: \"kubernetes.io/projected/affe6578-5d38-400e-9f47-0a5b6d255ae9-kube-api-access-vql9j\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.611171 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.608821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-oauth-config\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.611171 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.608873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-serving-cert\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.611171 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.608905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-config\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.611171 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.608937    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-service-ca\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.611171 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.608962    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-trusted-ca-bundle\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.611171 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.608984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-oauth-serving-cert\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.611171 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.609839    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-oauth-serving-cert\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.611171 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.610470    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-config\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.611171 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.611068    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-service-ca\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.611825 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.611289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-trusted-ca-bundle\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.616010 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.615963    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-oauth-config\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.632357 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.632286    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vql9j\" (UniqueName: \"kubernetes.io/projected/affe6578-5d38-400e-9f47-0a5b6d255ae9-kube-api-access-vql9j\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.632946 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.632894    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-serving-cert\") pod \"console-59d5977b98-tt5xn\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") " pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.716425 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.716376    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:23.837556 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.837493    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:24:23.969080 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.967970    2579 generic.go:356] "Generic (PLEG): container finished" podID="23f2f526-b010-410a-a41e-73f9403a386e" containerID="663f3dfd2dc02dba37f5614089e4b3c59fe331e449914ad67b38acc4e061bd21" exitCode=0
Jul 20 22:24:23.969080 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.968507    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhmkx" event={"ID":"23f2f526-b010-410a-a41e-73f9403a386e","Type":"ContainerDied","Data":"663f3dfd2dc02dba37f5614089e4b3c59fe331e449914ad67b38acc4e061bd21"}
Jul 20 22:24:23.974312 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:23.973643    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-z8fbc"
Jul 20 22:24:24.246498 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:24.246448    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d5977b98-tt5xn"]
Jul 20 22:24:24.859103 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:24.859069    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55d5d8fd47-lrx9f"
Jul 20 22:24:24.977703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:24.977664    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerStarted","Data":"3f57de7c0ae11f3f20b459ef7ad691238e089f16025bf33101aa07b7bbcb50e9"}
Jul 20 22:24:24.981077 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:24.981045    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhmkx" event={"ID":"23f2f526-b010-410a-a41e-73f9403a386e","Type":"ContainerStarted","Data":"f72c8721ca7e16a9a354e24eebd384218901c3eecfb611f58680998c59f7a28a"}
Jul 20 22:24:24.981217 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:24.981097    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bhmkx" event={"ID":"23f2f526-b010-410a-a41e-73f9403a386e","Type":"ContainerStarted","Data":"abee4e5d172793fd81c5191720a9e482db3c669db8bbf2de5e0a569ddf06332c"}
Jul 20 22:24:24.984384 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:24.984324    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d5977b98-tt5xn" event={"ID":"affe6578-5d38-400e-9f47-0a5b6d255ae9","Type":"ContainerStarted","Data":"ff4ffa202a5cc77793e33821fb98b942bc0d1f3a31be191c3727fce79c05880e"}
Jul 20 22:24:24.984384 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:24.984365    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d5977b98-tt5xn" event={"ID":"affe6578-5d38-400e-9f47-0a5b6d255ae9","Type":"ContainerStarted","Data":"a7e51a938fb0a65b75dd35d140aab1c5394449913738da7610743215bbe3c9c4"}
Jul 20 22:24:25.031823 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:25.031639    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59d5977b98-tt5xn" podStartSLOduration=2.031614103 podStartE2EDuration="2.031614103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:25.028634472 +0000 UTC m=+95.144019134" watchObservedRunningTime="2026-07-20 22:24:25.031614103 +0000 UTC m=+95.146998737"
Jul 20 22:24:25.056641 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:25.056572    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bhmkx" podStartSLOduration=9.685805967 podStartE2EDuration="11.05654896s" totalImagesPullingTime="1.245343438s" totalInitContainerRuntime="125.399555ms" isStatefulPod=true podCreationTimestamp="2026-07-20 22:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:25.053934371 +0000 UTC m=+95.169319059" watchObservedRunningTime="2026-07-20 22:24:25.05654896 +0000 UTC m=+95.171933591"
Jul 20 22:24:25.991642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:25.991606    2579 generic.go:356] "Generic (PLEG): container finished" podID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerID="3f57de7c0ae11f3f20b459ef7ad691238e089f16025bf33101aa07b7bbcb50e9" exitCode=0
Jul 20 22:24:25.993064 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:25.993038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerDied","Data":"3f57de7c0ae11f3f20b459ef7ad691238e089f16025bf33101aa07b7bbcb50e9"}
Jul 20 22:24:27.001740 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:27.001707    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7787949944-q8kq7" event={"ID":"10eb4fd1-c451-491e-bd56-dab94fe124c6","Type":"ContainerStarted","Data":"7e7dba614bf0870fc9f53dee24b305baed9aec903ef9ad89e79a877d4c30aa82"}
Jul 20 22:24:27.002089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:27.001816    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7787949944-q8kq7" event={"ID":"10eb4fd1-c451-491e-bd56-dab94fe124c6","Type":"ContainerStarted","Data":"046ebdff7b184602871af989a3fcced7b2db4de472909c49052f49c7530f093e"}
Jul 20 22:24:27.005755 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:27.005210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v" event={"ID":"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01","Type":"ContainerStarted","Data":"7704d49a53df41a8574e76b2360a89f2947a7b8f4f46eeab53ceb79b7f3aa7cf"}
Jul 20 22:24:27.005755 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:27.005288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v" event={"ID":"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01","Type":"ContainerStarted","Data":"d089ac40d5ae478e5fe0c4e65babb4d17ac8685165c12c6bb33bda8a9c651f24"}
Jul 20 22:24:28.012981 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:28.012947    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v" event={"ID":"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01","Type":"ContainerStarted","Data":"15266065ce08a115b8dd26615dbdba082e45ee31b840d3fc14f1adff14b7ea55"}
Jul 20 22:24:28.015367 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:28.015331    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7787949944-q8kq7" event={"ID":"10eb4fd1-c451-491e-bd56-dab94fe124c6","Type":"ContainerStarted","Data":"cacbd14d3aa2d6e33693359ad0b00ff59c21415cf1eaea699fe876af11d795ba"}
Jul 20 22:24:28.043601 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:28.043533    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7787949944-q8kq7" podStartSLOduration=3.5955034340000003 podStartE2EDuration="8.043501719s" totalImagesPullingTime="4.447998285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:28.041057539 +0000 UTC m=+98.156442185" watchObservedRunningTime="2026-07-20 22:24:28.043501719 +0000 UTC m=+98.158886346"
Jul 20 22:24:28.856369 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:28.856098    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p" podUID="699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" containerName="registry" containerID="cri-o://d28472aef762953910407ccebad58dca9c271da803ce03cc602b65d4b19a51d7" gracePeriod=30
Jul 20 22:24:28.948654 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:28.948614    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59d5977b98-tt5xn"]
Jul 20 22:24:28.979578 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:28.979553    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cfb5d4c46-dbvr5"]
Jul 20 22:24:28.994809 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:28.994783    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:28.995034 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:28.995007    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cfb5d4c46-dbvr5"]
Jul 20 22:24:29.027755 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.027610    2579 generic.go:356] "Generic (PLEG): container finished" podID="699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" containerID="d28472aef762953910407ccebad58dca9c271da803ce03cc602b65d4b19a51d7" exitCode=0
Jul 20 22:24:29.028158 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.027805    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p" event={"ID":"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be","Type":"ContainerDied","Data":"d28472aef762953910407ccebad58dca9c271da803ce03cc602b65d4b19a51d7"}
Jul 20 22:24:29.031640 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.031606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v" event={"ID":"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01","Type":"ContainerStarted","Data":"170fe369696ef135ee44da32186ca0b0b760f0a6e1a8a4f8c48568d746d28f02"}
Jul 20 22:24:29.031773 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.031695    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v" event={"ID":"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01","Type":"ContainerStarted","Data":"6ccb7a165d729350393475bccbea0f21a9a08c4fc15bceed6ef20e4be4accc98"}
Jul 20 22:24:29.034799 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.034760    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerStarted","Data":"0eeae52169e08988d7282a82fc23875b3ab62c667282b545bcee87d01f907c61"}
Jul 20 22:24:29.157457 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.157423    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:24:29.174893 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.174858    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-installation-pull-secrets\") pod \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") "
Jul 20 22:24:29.175047 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.174912    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-ca-trust-extracted\") pod \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") "
Jul 20 22:24:29.175047 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.174942    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-bound-sa-token\") pod \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") "
Jul 20 22:24:29.175047 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175021    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-certificates\") pod \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") "
Jul 20 22:24:29.175219 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175063    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls\") pod \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") "
Jul 20 22:24:29.175219 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175101    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-trusted-ca\") pod \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") "
Jul 20 22:24:29.175219 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175149    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-image-registry-private-configuration\") pod \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") "
Jul 20 22:24:29.175219 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175175    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd4qz\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-kube-api-access-kd4qz\") pod \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\" (UID: \"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be\") "
Jul 20 22:24:29.175509 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-oauth-serving-cert\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.175509 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9946209e-7133-4c20-a2a5-35e8111c88e1-console-serving-cert\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.175509 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-trusted-ca-bundle\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.175685 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175527    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-console-config\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.175685 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175557    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9946209e-7133-4c20-a2a5-35e8111c88e1-console-oauth-config\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.175685 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlthc\" (UniqueName: \"kubernetes.io/projected/9946209e-7133-4c20-a2a5-35e8111c88e1-kube-api-access-tlthc\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.175685 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175655    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:24:29.175876 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175688    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-service-ca\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.175876 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.175761    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-certificates\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:29.176215 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.176193    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:24:29.179072 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.179049    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:24:29.179371 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.179348    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-kube-api-access-kd4qz" (OuterVolumeSpecName: "kube-api-access-kd4qz") pod "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be"). InnerVolumeSpecName "kube-api-access-kd4qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:24:29.179581 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.179548    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:24:29.180201 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.180172    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:24:29.180525 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.180501    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:24:29.186235 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.186196    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" (UID: "699c6c7a-0b4d-45d1-8671-b3e78a9fe9be"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:24:29.276983 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.276945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-oauth-serving-cert\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.277146 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.276995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9946209e-7133-4c20-a2a5-35e8111c88e1-console-serving-cert\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.277146 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.277046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-trusted-ca-bundle\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.277146 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.277080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-console-config\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.277146 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.277104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9946209e-7133-4c20-a2a5-35e8111c88e1-console-oauth-config\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.277146 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.277136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlthc\" (UniqueName: \"kubernetes.io/projected/9946209e-7133-4c20-a2a5-35e8111c88e1-kube-api-access-tlthc\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.277439 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.277199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-service-ca\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.277439 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.277272    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-trusted-ca\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:29.277439 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.277288    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-image-registry-private-configuration\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:29.277439 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.277329    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd4qz\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-kube-api-access-kd4qz\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:29.277439 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.277344    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-installation-pull-secrets\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:29.277439 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.277358    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-ca-trust-extracted\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:29.277439 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.277370    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-bound-sa-token\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:29.277439 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.277384    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be-registry-tls\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:29.277809 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.277769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-oauth-serving-cert\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.278224 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.278139    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-trusted-ca-bundle\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.278529 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.278485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-console-config\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.278690 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.278670    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-service-ca\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.280411 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.280385    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9946209e-7133-4c20-a2a5-35e8111c88e1-console-serving-cert\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.280583 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.280554    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9946209e-7133-4c20-a2a5-35e8111c88e1-console-oauth-config\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.286588 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.286565    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlthc\" (UniqueName: \"kubernetes.io/projected/9946209e-7133-4c20-a2a5-35e8111c88e1-kube-api-access-tlthc\") pod \"console-5cfb5d4c46-dbvr5\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") " pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.308470 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.308438    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:29.490906 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:29.490827    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cfb5d4c46-dbvr5"]
Jul 20 22:24:29.494010 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:24:29.493980    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9946209e_7133_4c20_a2a5_35e8111c88e1.slice/crio-a19f65cccbf1bbd1bb96e84147cc9000dbecd2573f9d49dda967e8436ba1d1cc WatchSource:0}: Error finding container a19f65cccbf1bbd1bb96e84147cc9000dbecd2573f9d49dda967e8436ba1d1cc: Status 404 returned error can't find the container with id a19f65cccbf1bbd1bb96e84147cc9000dbecd2573f9d49dda967e8436ba1d1cc
Jul 20 22:24:30.041839 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.041801    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p"
Jul 20 22:24:30.041839 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.041836    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b76b655b7-x7m2p" event={"ID":"699c6c7a-0b4d-45d1-8671-b3e78a9fe9be","Type":"ContainerDied","Data":"abf181624406a21de02e3a2bd69752eecbd914584549619a015de7e3a3cebc77"}
Jul 20 22:24:30.042483 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.041892    2579 scope.go:117] "RemoveContainer" containerID="d28472aef762953910407ccebad58dca9c271da803ce03cc602b65d4b19a51d7"
Jul 20 22:24:30.046211 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.046119    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v" event={"ID":"21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01","Type":"ContainerStarted","Data":"2db329d91071c3b2be7460b549f710d4c0075632ac9ac6a239a868450c666ae5"}
Jul 20 22:24:30.046355 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.046345    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:30.048373 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.048352    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfb5d4c46-dbvr5" event={"ID":"9946209e-7133-4c20-a2a5-35e8111c88e1","Type":"ContainerStarted","Data":"4c13e8c540ed059566bb60788431812c2ba3182c6bf56c902693a901cff62ae3"}
Jul 20 22:24:30.048485 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.048393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfb5d4c46-dbvr5" event={"ID":"9946209e-7133-4c20-a2a5-35e8111c88e1","Type":"ContainerStarted","Data":"a19f65cccbf1bbd1bb96e84147cc9000dbecd2573f9d49dda967e8436ba1d1cc"}
Jul 20 22:24:30.053155 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.053129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerStarted","Data":"70287daef0e90cbf64a6a5e8a42198bd85bcb32c34fa8db5a2f141a3b74259f0"}
Jul 20 22:24:30.053241 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.053196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerStarted","Data":"113bad1d64f1c5c9687e7e14f9fb9dc31fef18fa94208bf42c6b6d3aaecca59b"}
Jul 20 22:24:30.053241 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.053237    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerStarted","Data":"ef325e8e0bf2fa15271de10694cbd682f375f63287afdf272987edd275b17064"}
Jul 20 22:24:30.053401 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.053277    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerStarted","Data":"b0a7bd49b68b7e2b5fb418cafd1ebae914424cf40d6e475d0556621179e6a684"}
Jul 20 22:24:30.053401 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.053337    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerStarted","Data":"023286d739eb7cf4d00950c0ff36a35b1710786890f2d4a48802da074c8bce86"}
Jul 20 22:24:30.074320 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.074246    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v" podStartSLOduration=5.9898502780000005 podStartE2EDuration="12.074224721s" totalImagesPullingTime="6.084374443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:30.069082654 +0000 UTC m=+100.184467300" watchObservedRunningTime="2026-07-20 22:24:30.074224721 +0000 UTC m=+100.189609417"
Jul 20 22:24:30.098725 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.098242    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=9.035532859 podStartE2EDuration="14.098217681s" totalImagesPullingTime="5.03370125s" totalInitContainerRuntime="28.983572ms" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:30.097666441 +0000 UTC m=+100.213051068" watchObservedRunningTime="2026-07-20 22:24:30.098217681 +0000 UTC m=+100.213602311"
Jul 20 22:24:30.113125 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.113083    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b76b655b7-x7m2p"]
Jul 20 22:24:30.118515 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.118482    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b76b655b7-x7m2p"]
Jul 20 22:24:30.138158 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.138101    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cfb5d4c46-dbvr5" podStartSLOduration=2.138077202 podStartE2EDuration="2.138077202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:24:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:24:30.13768502 +0000 UTC m=+100.253069646" watchObservedRunningTime="2026-07-20 22:24:30.138077202 +0000 UTC m=+100.253461842"
Jul 20 22:24:30.376382 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:30.376346    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" path="/var/lib/kubelet/pods/699c6c7a-0b4d-45d1-8671-b3e78a9fe9be/volumes"
Jul 20 22:24:31.066462 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:31.066435    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5455dd967b-4wc2v"
Jul 20 22:24:33.716709 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:33.716659    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:35.864143 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:35.864111    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lj2px"
Jul 20 22:24:39.309343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:39.309281    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:39.309742 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:39.309399    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:39.314050 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:39.314029    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:40.104714 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:40.104686    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:24:40.154044 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:40.154003    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-574b9b7fc4-hg5z8"]
Jul 20 22:24:53.975630 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:53.975560    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59d5977b98-tt5xn" podUID="affe6578-5d38-400e-9f47-0a5b6d255ae9" containerName="console" containerID="cri-o://ff4ffa202a5cc77793e33821fb98b942bc0d1f3a31be191c3727fce79c05880e" gracePeriod=15
Jul 20 22:24:54.161459 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.161431    2579 generic.go:356] "Generic (PLEG): container finished" podID="affe6578-5d38-400e-9f47-0a5b6d255ae9" containerID="ff4ffa202a5cc77793e33821fb98b942bc0d1f3a31be191c3727fce79c05880e" exitCode=0
Jul 20 22:24:54.161596 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.161503    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d5977b98-tt5xn" event={"ID":"affe6578-5d38-400e-9f47-0a5b6d255ae9","Type":"ContainerDied","Data":"ff4ffa202a5cc77793e33821fb98b942bc0d1f3a31be191c3727fce79c05880e"}
Jul 20 22:24:54.253868 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.253835    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:54.399275 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.399240    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-config\") pod \"affe6578-5d38-400e-9f47-0a5b6d255ae9\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") "
Jul 20 22:24:54.399469 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.399323    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-service-ca\") pod \"affe6578-5d38-400e-9f47-0a5b6d255ae9\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") "
Jul 20 22:24:54.399469 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.399357    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-trusted-ca-bundle\") pod \"affe6578-5d38-400e-9f47-0a5b6d255ae9\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") "
Jul 20 22:24:54.399469 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.399382    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-oauth-config\") pod \"affe6578-5d38-400e-9f47-0a5b6d255ae9\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") "
Jul 20 22:24:54.399469 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.399438    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-oauth-serving-cert\") pod \"affe6578-5d38-400e-9f47-0a5b6d255ae9\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") "
Jul 20 22:24:54.399469 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.399464    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vql9j\" (UniqueName: \"kubernetes.io/projected/affe6578-5d38-400e-9f47-0a5b6d255ae9-kube-api-access-vql9j\") pod \"affe6578-5d38-400e-9f47-0a5b6d255ae9\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") "
Jul 20 22:24:54.399749 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.399515    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-serving-cert\") pod \"affe6578-5d38-400e-9f47-0a5b6d255ae9\" (UID: \"affe6578-5d38-400e-9f47-0a5b6d255ae9\") "
Jul 20 22:24:54.399811 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.399763    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-service-ca" (OuterVolumeSpecName: "service-ca") pod "affe6578-5d38-400e-9f47-0a5b6d255ae9" (UID: "affe6578-5d38-400e-9f47-0a5b6d255ae9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:24:54.399811 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.399785    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-config" (OuterVolumeSpecName: "console-config") pod "affe6578-5d38-400e-9f47-0a5b6d255ae9" (UID: "affe6578-5d38-400e-9f47-0a5b6d255ae9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:24:54.399890 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.399843    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "affe6578-5d38-400e-9f47-0a5b6d255ae9" (UID: "affe6578-5d38-400e-9f47-0a5b6d255ae9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:24:54.399942 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.399916    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "affe6578-5d38-400e-9f47-0a5b6d255ae9" (UID: "affe6578-5d38-400e-9f47-0a5b6d255ae9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:24:54.401711 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.401679    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/affe6578-5d38-400e-9f47-0a5b6d255ae9-kube-api-access-vql9j" (OuterVolumeSpecName: "kube-api-access-vql9j") pod "affe6578-5d38-400e-9f47-0a5b6d255ae9" (UID: "affe6578-5d38-400e-9f47-0a5b6d255ae9"). InnerVolumeSpecName "kube-api-access-vql9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:24:54.401817 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.401802    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "affe6578-5d38-400e-9f47-0a5b6d255ae9" (UID: "affe6578-5d38-400e-9f47-0a5b6d255ae9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:24:54.401873 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.401809    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "affe6578-5d38-400e-9f47-0a5b6d255ae9" (UID: "affe6578-5d38-400e-9f47-0a5b6d255ae9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:24:54.500545 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.500462    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-service-ca\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:54.500545 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.500491    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-trusted-ca-bundle\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:54.500545 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.500501    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-oauth-config\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:54.500545 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.500509    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-oauth-serving-cert\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:54.500545 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.500518    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vql9j\" (UniqueName: \"kubernetes.io/projected/affe6578-5d38-400e-9f47-0a5b6d255ae9-kube-api-access-vql9j\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:54.500545 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.500527    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-serving-cert\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:54.500545 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:54.500535    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/affe6578-5d38-400e-9f47-0a5b6d255ae9-console-config\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:24:55.166979 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:55.166942    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d5977b98-tt5xn"
Jul 20 22:24:55.166979 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:55.166947    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d5977b98-tt5xn" event={"ID":"affe6578-5d38-400e-9f47-0a5b6d255ae9","Type":"ContainerDied","Data":"a7e51a938fb0a65b75dd35d140aab1c5394449913738da7610743215bbe3c9c4"}
Jul 20 22:24:55.167458 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:55.167010    2579 scope.go:117] "RemoveContainer" containerID="ff4ffa202a5cc77793e33821fb98b942bc0d1f3a31be191c3727fce79c05880e"
Jul 20 22:24:55.188068 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:55.188039    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59d5977b98-tt5xn"]
Jul 20 22:24:55.193449 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:55.193426    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59d5977b98-tt5xn"]
Jul 20 22:24:56.368052 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:24:56.368018    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="affe6578-5d38-400e-9f47-0a5b6d255ae9" path="/var/lib/kubelet/pods/affe6578-5d38-400e-9f47-0a5b6d255ae9/volumes"
Jul 20 22:25:05.174660 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.174609    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-574b9b7fc4-hg5z8" podUID="c823891b-f18c-49e3-af0e-d88a51704877" containerName="console" containerID="cri-o://dfe94bd1592b05ab813eeace74c41bdfaeb4449387ba9c7603b4516743a54748" gracePeriod=15
Jul 20 22:25:05.450778 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.450694    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:25:05.601238 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.601198    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c823891b-f18c-49e3-af0e-d88a51704877-console-oauth-config\") pod \"c823891b-f18c-49e3-af0e-d88a51704877\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") "
Jul 20 22:25:05.601476 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.601252    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-console-config\") pod \"c823891b-f18c-49e3-af0e-d88a51704877\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") "
Jul 20 22:25:05.601476 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.601284    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-service-ca\") pod \"c823891b-f18c-49e3-af0e-d88a51704877\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") "
Jul 20 22:25:05.601476 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.601370    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c823891b-f18c-49e3-af0e-d88a51704877-console-serving-cert\") pod \"c823891b-f18c-49e3-af0e-d88a51704877\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") "
Jul 20 22:25:05.601476 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.601407    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-oauth-serving-cert\") pod \"c823891b-f18c-49e3-af0e-d88a51704877\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") "
Jul 20 22:25:05.601476 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.601437    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqx4x\" (UniqueName: \"kubernetes.io/projected/c823891b-f18c-49e3-af0e-d88a51704877-kube-api-access-hqx4x\") pod \"c823891b-f18c-49e3-af0e-d88a51704877\" (UID: \"c823891b-f18c-49e3-af0e-d88a51704877\") "
Jul 20 22:25:05.601768 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.601741    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-console-config" (OuterVolumeSpecName: "console-config") pod "c823891b-f18c-49e3-af0e-d88a51704877" (UID: "c823891b-f18c-49e3-af0e-d88a51704877"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:05.601863 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.601820    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-service-ca" (OuterVolumeSpecName: "service-ca") pod "c823891b-f18c-49e3-af0e-d88a51704877" (UID: "c823891b-f18c-49e3-af0e-d88a51704877"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:05.601863 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.601840    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c823891b-f18c-49e3-af0e-d88a51704877" (UID: "c823891b-f18c-49e3-af0e-d88a51704877"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:05.603581 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.603550    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c823891b-f18c-49e3-af0e-d88a51704877-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c823891b-f18c-49e3-af0e-d88a51704877" (UID: "c823891b-f18c-49e3-af0e-d88a51704877"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:05.603581 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.603547    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c823891b-f18c-49e3-af0e-d88a51704877-kube-api-access-hqx4x" (OuterVolumeSpecName: "kube-api-access-hqx4x") pod "c823891b-f18c-49e3-af0e-d88a51704877" (UID: "c823891b-f18c-49e3-af0e-d88a51704877"). InnerVolumeSpecName "kube-api-access-hqx4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:25:05.603706 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.603649    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c823891b-f18c-49e3-af0e-d88a51704877-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c823891b-f18c-49e3-af0e-d88a51704877" (UID: "c823891b-f18c-49e3-af0e-d88a51704877"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:05.702646 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.702550    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-oauth-serving-cert\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:05.702646 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.702584    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqx4x\" (UniqueName: \"kubernetes.io/projected/c823891b-f18c-49e3-af0e-d88a51704877-kube-api-access-hqx4x\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:05.702646 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.702595    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c823891b-f18c-49e3-af0e-d88a51704877-console-oauth-config\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:05.702646 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.702605    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-console-config\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:05.702646 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.702614    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c823891b-f18c-49e3-af0e-d88a51704877-service-ca\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:05.702646 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:05.702623    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c823891b-f18c-49e3-af0e-d88a51704877-console-serving-cert\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:06.212657 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:06.212620    2579 generic.go:356] "Generic (PLEG): container finished" podID="c823891b-f18c-49e3-af0e-d88a51704877" containerID="dfe94bd1592b05ab813eeace74c41bdfaeb4449387ba9c7603b4516743a54748" exitCode=0
Jul 20 22:25:06.213058 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:06.212667    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-574b9b7fc4-hg5z8"
Jul 20 22:25:06.213058 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:06.212707    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574b9b7fc4-hg5z8" event={"ID":"c823891b-f18c-49e3-af0e-d88a51704877","Type":"ContainerDied","Data":"dfe94bd1592b05ab813eeace74c41bdfaeb4449387ba9c7603b4516743a54748"}
Jul 20 22:25:06.213058 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:06.212758    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-574b9b7fc4-hg5z8" event={"ID":"c823891b-f18c-49e3-af0e-d88a51704877","Type":"ContainerDied","Data":"cf587dfcec910e96267eaee2ae35c1a477301614b544cb9de0aaf3f6685cfc10"}
Jul 20 22:25:06.213058 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:06.212779    2579 scope.go:117] "RemoveContainer" containerID="dfe94bd1592b05ab813eeace74c41bdfaeb4449387ba9c7603b4516743a54748"
Jul 20 22:25:06.221284 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:06.221269    2579 scope.go:117] "RemoveContainer" containerID="dfe94bd1592b05ab813eeace74c41bdfaeb4449387ba9c7603b4516743a54748"
Jul 20 22:25:06.221589 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:25:06.221571    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfe94bd1592b05ab813eeace74c41bdfaeb4449387ba9c7603b4516743a54748\": container with ID starting with dfe94bd1592b05ab813eeace74c41bdfaeb4449387ba9c7603b4516743a54748 not found: ID does not exist" containerID="dfe94bd1592b05ab813eeace74c41bdfaeb4449387ba9c7603b4516743a54748"
Jul 20 22:25:06.221634 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:06.221601    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfe94bd1592b05ab813eeace74c41bdfaeb4449387ba9c7603b4516743a54748"} err="failed to get container status \"dfe94bd1592b05ab813eeace74c41bdfaeb4449387ba9c7603b4516743a54748\": rpc error: code = NotFound desc = could not find container \"dfe94bd1592b05ab813eeace74c41bdfaeb4449387ba9c7603b4516743a54748\": container with ID starting with dfe94bd1592b05ab813eeace74c41bdfaeb4449387ba9c7603b4516743a54748 not found: ID does not exist"
Jul 20 22:25:06.233107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:06.233079    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-574b9b7fc4-hg5z8"]
Jul 20 22:25:06.236546 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:06.236525    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-574b9b7fc4-hg5z8"]
Jul 20 22:25:06.367879 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:06.367844    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c823891b-f18c-49e3-af0e-d88a51704877" path="/var/lib/kubelet/pods/c823891b-f18c-49e3-af0e-d88a51704877/volumes"
Jul 20 22:25:35.456609 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:35.456574    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:25:35.457154 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:35.456849    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="alertmanager" containerID="cri-o://0eeae52169e08988d7282a82fc23875b3ab62c667282b545bcee87d01f907c61" gracePeriod=120
Jul 20 22:25:35.457154 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:35.456941    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="kube-rbac-proxy-metric" containerID="cri-o://ef325e8e0bf2fa15271de10694cbd682f375f63287afdf272987edd275b17064" gracePeriod=120
Jul 20 22:25:35.457154 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:35.456979    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="config-reloader" containerID="cri-o://70287daef0e90cbf64a6a5e8a42198bd85bcb32c34fa8db5a2f141a3b74259f0" gracePeriod=120
Jul 20 22:25:35.457154 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:35.456942    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="kube-rbac-proxy-web" containerID="cri-o://023286d739eb7cf4d00950c0ff36a35b1710786890f2d4a48802da074c8bce86" gracePeriod=120
Jul 20 22:25:35.457154 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:35.456953    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="kube-rbac-proxy" containerID="cri-o://b0a7bd49b68b7e2b5fb418cafd1ebae914424cf40d6e475d0556621179e6a684" gracePeriod=120
Jul 20 22:25:35.457154 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:35.457038    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="prom-label-proxy" containerID="cri-o://113bad1d64f1c5c9687e7e14f9fb9dc31fef18fa94208bf42c6b6d3aaecca59b" gracePeriod=120
Jul 20 22:25:36.333507 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.333475    2579 generic.go:356] "Generic (PLEG): container finished" podID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerID="113bad1d64f1c5c9687e7e14f9fb9dc31fef18fa94208bf42c6b6d3aaecca59b" exitCode=0
Jul 20 22:25:36.333507 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.333498    2579 generic.go:356] "Generic (PLEG): container finished" podID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerID="ef325e8e0bf2fa15271de10694cbd682f375f63287afdf272987edd275b17064" exitCode=0
Jul 20 22:25:36.333507 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.333505    2579 generic.go:356] "Generic (PLEG): container finished" podID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerID="b0a7bd49b68b7e2b5fb418cafd1ebae914424cf40d6e475d0556621179e6a684" exitCode=0
Jul 20 22:25:36.333507 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.333513    2579 generic.go:356] "Generic (PLEG): container finished" podID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerID="70287daef0e90cbf64a6a5e8a42198bd85bcb32c34fa8db5a2f141a3b74259f0" exitCode=0
Jul 20 22:25:36.333507 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.333519    2579 generic.go:356] "Generic (PLEG): container finished" podID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerID="0eeae52169e08988d7282a82fc23875b3ab62c667282b545bcee87d01f907c61" exitCode=0
Jul 20 22:25:36.333801 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.333542    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerDied","Data":"113bad1d64f1c5c9687e7e14f9fb9dc31fef18fa94208bf42c6b6d3aaecca59b"}
Jul 20 22:25:36.333801 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.333602    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerDied","Data":"ef325e8e0bf2fa15271de10694cbd682f375f63287afdf272987edd275b17064"}
Jul 20 22:25:36.333801 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.333630    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerDied","Data":"b0a7bd49b68b7e2b5fb418cafd1ebae914424cf40d6e475d0556621179e6a684"}
Jul 20 22:25:36.333801 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.333655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerDied","Data":"70287daef0e90cbf64a6a5e8a42198bd85bcb32c34fa8db5a2f141a3b74259f0"}
Jul 20 22:25:36.333801 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.333681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerDied","Data":"0eeae52169e08988d7282a82fc23875b3ab62c667282b545bcee87d01f907c61"}
Jul 20 22:25:36.703460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.703433    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:36.752870 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.752833    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-cluster-tls-config\") pod \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") "
Jul 20 22:25:36.753069 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.752881    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-metrics-client-ca\") pod \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") "
Jul 20 22:25:36.753069 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.752909    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnkkp\" (UniqueName: \"kubernetes.io/projected/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-kube-api-access-pnkkp\") pod \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") "
Jul 20 22:25:36.753069 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.752955    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-main-db\") pod \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") "
Jul 20 22:25:36.753069 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.752980    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-main-tls\") pod \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") "
Jul 20 22:25:36.753069 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.752996    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy-web\") pod \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") "
Jul 20 22:25:36.753069 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.753014    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-config-out\") pod \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") "
Jul 20 22:25:36.753069 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.753045    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-trusted-ca-bundle\") pod \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") "
Jul 20 22:25:36.753529 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.753073    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy\") pod \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") "
Jul 20 22:25:36.753529 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.753106    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-tls-assets\") pod \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") "
Jul 20 22:25:36.753529 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.753137    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") "
Jul 20 22:25:36.753529 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.753167    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-web-config\") pod \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") "
Jul 20 22:25:36.753529 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.753210    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-config-volume\") pod \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\" (UID: \"3c98b4f3-b4db-4800-ad08-c0bf81600ef2\") "
Jul 20 22:25:36.753780 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.753555    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "3c98b4f3-b4db-4800-ad08-c0bf81600ef2" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:36.754098 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.754068    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "3c98b4f3-b4db-4800-ad08-c0bf81600ef2" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:25:36.754206 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.754182    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "3c98b4f3-b4db-4800-ad08-c0bf81600ef2" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:25:36.757417 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.757384    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3c98b4f3-b4db-4800-ad08-c0bf81600ef2" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:25:36.757767 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.757731    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-kube-api-access-pnkkp" (OuterVolumeSpecName: "kube-api-access-pnkkp") pod "3c98b4f3-b4db-4800-ad08-c0bf81600ef2" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2"). InnerVolumeSpecName "kube-api-access-pnkkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:25:36.757881 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.757800    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "3c98b4f3-b4db-4800-ad08-c0bf81600ef2" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:36.758079 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.758041    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-config-out" (OuterVolumeSpecName: "config-out") pod "3c98b4f3-b4db-4800-ad08-c0bf81600ef2" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:25:36.758188 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.758131    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-config-volume" (OuterVolumeSpecName: "config-volume") pod "3c98b4f3-b4db-4800-ad08-c0bf81600ef2" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:36.758719 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.758657    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "3c98b4f3-b4db-4800-ad08-c0bf81600ef2" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:36.758828 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.758740    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "3c98b4f3-b4db-4800-ad08-c0bf81600ef2" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:36.759244 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.759216    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "3c98b4f3-b4db-4800-ad08-c0bf81600ef2" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:36.761377 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.761224    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "3c98b4f3-b4db-4800-ad08-c0bf81600ef2" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:36.770664 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.770596    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-web-config" (OuterVolumeSpecName: "web-config") pod "3c98b4f3-b4db-4800-ad08-c0bf81600ef2" (UID: "3c98b4f3-b4db-4800-ad08-c0bf81600ef2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:25:36.854394 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.854359    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-web-config\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:36.854394 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.854386    2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-config-volume\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:36.854394 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.854395    2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-cluster-tls-config\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:36.854394 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.854404    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-metrics-client-ca\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:36.854648 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.854414    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnkkp\" (UniqueName: \"kubernetes.io/projected/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-kube-api-access-pnkkp\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:36.854648 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.854423    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-main-db\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:36.854648 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.854431    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-main-tls\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:36.854648 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.854441    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:36.854648 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.854451    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-config-out\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:36.854648 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.854459    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:36.854648 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.854467    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:36.854648 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.854475    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-tls-assets\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:36.854648 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:36.854483    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3c98b4f3-b4db-4800-ad08-c0bf81600ef2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:25:37.340581 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.340546    2579 generic.go:356] "Generic (PLEG): container finished" podID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerID="023286d739eb7cf4d00950c0ff36a35b1710786890f2d4a48802da074c8bce86" exitCode=0
Jul 20 22:25:37.340725 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.340587    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerDied","Data":"023286d739eb7cf4d00950c0ff36a35b1710786890f2d4a48802da074c8bce86"}
Jul 20 22:25:37.340725 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.340625    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.340725 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.340645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3c98b4f3-b4db-4800-ad08-c0bf81600ef2","Type":"ContainerDied","Data":"f2099a726c9770f36bff55401c46c654600e0c83bea127056f2af31b7b2e6a44"}
Jul 20 22:25:37.340725 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.340677    2579 scope.go:117] "RemoveContainer" containerID="113bad1d64f1c5c9687e7e14f9fb9dc31fef18fa94208bf42c6b6d3aaecca59b"
Jul 20 22:25:37.348876 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.348770    2579 scope.go:117] "RemoveContainer" containerID="ef325e8e0bf2fa15271de10694cbd682f375f63287afdf272987edd275b17064"
Jul 20 22:25:37.356154 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.356132    2579 scope.go:117] "RemoveContainer" containerID="b0a7bd49b68b7e2b5fb418cafd1ebae914424cf40d6e475d0556621179e6a684"
Jul 20 22:25:37.363196 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.363172    2579 scope.go:117] "RemoveContainer" containerID="023286d739eb7cf4d00950c0ff36a35b1710786890f2d4a48802da074c8bce86"
Jul 20 22:25:37.364683 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.364596    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:25:37.368263 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.368237    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:25:37.371146 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.371121    2579 scope.go:117] "RemoveContainer" containerID="70287daef0e90cbf64a6a5e8a42198bd85bcb32c34fa8db5a2f141a3b74259f0"
Jul 20 22:25:37.378139 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.378120    2579 scope.go:117] "RemoveContainer" containerID="0eeae52169e08988d7282a82fc23875b3ab62c667282b545bcee87d01f907c61"
Jul 20 22:25:37.384949 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.384931    2579 scope.go:117] "RemoveContainer" containerID="3f57de7c0ae11f3f20b459ef7ad691238e089f16025bf33101aa07b7bbcb50e9"
Jul 20 22:25:37.391958 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.391942    2579 scope.go:117] "RemoveContainer" containerID="113bad1d64f1c5c9687e7e14f9fb9dc31fef18fa94208bf42c6b6d3aaecca59b"
Jul 20 22:25:37.392214 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:25:37.392191    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"113bad1d64f1c5c9687e7e14f9fb9dc31fef18fa94208bf42c6b6d3aaecca59b\": container with ID starting with 113bad1d64f1c5c9687e7e14f9fb9dc31fef18fa94208bf42c6b6d3aaecca59b not found: ID does not exist" containerID="113bad1d64f1c5c9687e7e14f9fb9dc31fef18fa94208bf42c6b6d3aaecca59b"
Jul 20 22:25:37.392263 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.392224    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"113bad1d64f1c5c9687e7e14f9fb9dc31fef18fa94208bf42c6b6d3aaecca59b"} err="failed to get container status \"113bad1d64f1c5c9687e7e14f9fb9dc31fef18fa94208bf42c6b6d3aaecca59b\": rpc error: code = NotFound desc = could not find container \"113bad1d64f1c5c9687e7e14f9fb9dc31fef18fa94208bf42c6b6d3aaecca59b\": container with ID starting with 113bad1d64f1c5c9687e7e14f9fb9dc31fef18fa94208bf42c6b6d3aaecca59b not found: ID does not exist"
Jul 20 22:25:37.392263 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.392243    2579 scope.go:117] "RemoveContainer" containerID="ef325e8e0bf2fa15271de10694cbd682f375f63287afdf272987edd275b17064"
Jul 20 22:25:37.392506 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:25:37.392491    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef325e8e0bf2fa15271de10694cbd682f375f63287afdf272987edd275b17064\": container with ID starting with ef325e8e0bf2fa15271de10694cbd682f375f63287afdf272987edd275b17064 not found: ID does not exist" containerID="ef325e8e0bf2fa15271de10694cbd682f375f63287afdf272987edd275b17064"
Jul 20 22:25:37.392555 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.392511    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef325e8e0bf2fa15271de10694cbd682f375f63287afdf272987edd275b17064"} err="failed to get container status \"ef325e8e0bf2fa15271de10694cbd682f375f63287afdf272987edd275b17064\": rpc error: code = NotFound desc = could not find container \"ef325e8e0bf2fa15271de10694cbd682f375f63287afdf272987edd275b17064\": container with ID starting with ef325e8e0bf2fa15271de10694cbd682f375f63287afdf272987edd275b17064 not found: ID does not exist"
Jul 20 22:25:37.392555 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.392525    2579 scope.go:117] "RemoveContainer" containerID="b0a7bd49b68b7e2b5fb418cafd1ebae914424cf40d6e475d0556621179e6a684"
Jul 20 22:25:37.392740 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:25:37.392723    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0a7bd49b68b7e2b5fb418cafd1ebae914424cf40d6e475d0556621179e6a684\": container with ID starting with b0a7bd49b68b7e2b5fb418cafd1ebae914424cf40d6e475d0556621179e6a684 not found: ID does not exist" containerID="b0a7bd49b68b7e2b5fb418cafd1ebae914424cf40d6e475d0556621179e6a684"
Jul 20 22:25:37.392779 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.392747    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0a7bd49b68b7e2b5fb418cafd1ebae914424cf40d6e475d0556621179e6a684"} err="failed to get container status \"b0a7bd49b68b7e2b5fb418cafd1ebae914424cf40d6e475d0556621179e6a684\": rpc error: code = NotFound desc = could not find container \"b0a7bd49b68b7e2b5fb418cafd1ebae914424cf40d6e475d0556621179e6a684\": container with ID starting with b0a7bd49b68b7e2b5fb418cafd1ebae914424cf40d6e475d0556621179e6a684 not found: ID does not exist"
Jul 20 22:25:37.392779 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.392763    2579 scope.go:117] "RemoveContainer" containerID="023286d739eb7cf4d00950c0ff36a35b1710786890f2d4a48802da074c8bce86"
Jul 20 22:25:37.392965 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:25:37.392949    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"023286d739eb7cf4d00950c0ff36a35b1710786890f2d4a48802da074c8bce86\": container with ID starting with 023286d739eb7cf4d00950c0ff36a35b1710786890f2d4a48802da074c8bce86 not found: ID does not exist" containerID="023286d739eb7cf4d00950c0ff36a35b1710786890f2d4a48802da074c8bce86"
Jul 20 22:25:37.393003 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.392971    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"023286d739eb7cf4d00950c0ff36a35b1710786890f2d4a48802da074c8bce86"} err="failed to get container status \"023286d739eb7cf4d00950c0ff36a35b1710786890f2d4a48802da074c8bce86\": rpc error: code = NotFound desc = could not find container \"023286d739eb7cf4d00950c0ff36a35b1710786890f2d4a48802da074c8bce86\": container with ID starting with 023286d739eb7cf4d00950c0ff36a35b1710786890f2d4a48802da074c8bce86 not found: ID does not exist"
Jul 20 22:25:37.393003 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.392985    2579 scope.go:117] "RemoveContainer" containerID="70287daef0e90cbf64a6a5e8a42198bd85bcb32c34fa8db5a2f141a3b74259f0"
Jul 20 22:25:37.393173 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:25:37.393156    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70287daef0e90cbf64a6a5e8a42198bd85bcb32c34fa8db5a2f141a3b74259f0\": container with ID starting with 70287daef0e90cbf64a6a5e8a42198bd85bcb32c34fa8db5a2f141a3b74259f0 not found: ID does not exist" containerID="70287daef0e90cbf64a6a5e8a42198bd85bcb32c34fa8db5a2f141a3b74259f0"
Jul 20 22:25:37.393206 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.393179    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70287daef0e90cbf64a6a5e8a42198bd85bcb32c34fa8db5a2f141a3b74259f0"} err="failed to get container status \"70287daef0e90cbf64a6a5e8a42198bd85bcb32c34fa8db5a2f141a3b74259f0\": rpc error: code = NotFound desc = could not find container \"70287daef0e90cbf64a6a5e8a42198bd85bcb32c34fa8db5a2f141a3b74259f0\": container with ID starting with 70287daef0e90cbf64a6a5e8a42198bd85bcb32c34fa8db5a2f141a3b74259f0 not found: ID does not exist"
Jul 20 22:25:37.393206 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.393192    2579 scope.go:117] "RemoveContainer" containerID="0eeae52169e08988d7282a82fc23875b3ab62c667282b545bcee87d01f907c61"
Jul 20 22:25:37.393430 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:25:37.393410    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eeae52169e08988d7282a82fc23875b3ab62c667282b545bcee87d01f907c61\": container with ID starting with 0eeae52169e08988d7282a82fc23875b3ab62c667282b545bcee87d01f907c61 not found: ID does not exist" containerID="0eeae52169e08988d7282a82fc23875b3ab62c667282b545bcee87d01f907c61"
Jul 20 22:25:37.393476 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.393433    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eeae52169e08988d7282a82fc23875b3ab62c667282b545bcee87d01f907c61"} err="failed to get container status \"0eeae52169e08988d7282a82fc23875b3ab62c667282b545bcee87d01f907c61\": rpc error: code = NotFound desc = could not find container \"0eeae52169e08988d7282a82fc23875b3ab62c667282b545bcee87d01f907c61\": container with ID starting with 0eeae52169e08988d7282a82fc23875b3ab62c667282b545bcee87d01f907c61 not found: ID does not exist"
Jul 20 22:25:37.393476 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.393446    2579 scope.go:117] "RemoveContainer" containerID="3f57de7c0ae11f3f20b459ef7ad691238e089f16025bf33101aa07b7bbcb50e9"
Jul 20 22:25:37.393688 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:25:37.393671    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f57de7c0ae11f3f20b459ef7ad691238e089f16025bf33101aa07b7bbcb50e9\": container with ID starting with 3f57de7c0ae11f3f20b459ef7ad691238e089f16025bf33101aa07b7bbcb50e9 not found: ID does not exist" containerID="3f57de7c0ae11f3f20b459ef7ad691238e089f16025bf33101aa07b7bbcb50e9"
Jul 20 22:25:37.393738 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.393691    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f57de7c0ae11f3f20b459ef7ad691238e089f16025bf33101aa07b7bbcb50e9"} err="failed to get container status \"3f57de7c0ae11f3f20b459ef7ad691238e089f16025bf33101aa07b7bbcb50e9\": rpc error: code = NotFound desc = could not find container \"3f57de7c0ae11f3f20b459ef7ad691238e089f16025bf33101aa07b7bbcb50e9\": container with ID starting with 3f57de7c0ae11f3f20b459ef7ad691238e089f16025bf33101aa07b7bbcb50e9 not found: ID does not exist"
Jul 20 22:25:37.396166 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396146    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:25:37.396431 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396418    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c823891b-f18c-49e3-af0e-d88a51704877" containerName="console"
Jul 20 22:25:37.396481 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396433    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c823891b-f18c-49e3-af0e-d88a51704877" containerName="console"
Jul 20 22:25:37.396481 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396443    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" containerName="registry"
Jul 20 22:25:37.396481 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396449    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" containerName="registry"
Jul 20 22:25:37.396481 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396456    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="init-config-reloader"
Jul 20 22:25:37.396481 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396461    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="init-config-reloader"
Jul 20 22:25:37.396481 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396467    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="alertmanager"
Jul 20 22:25:37.396481 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396472    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="alertmanager"
Jul 20 22:25:37.396481 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396480    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="config-reloader"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396485    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="config-reloader"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396500    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="prom-label-proxy"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396506    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="prom-label-proxy"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396512    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="kube-rbac-proxy-metric"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396517    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="kube-rbac-proxy-metric"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396529    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="kube-rbac-proxy"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396535    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="kube-rbac-proxy"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396541    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="affe6578-5d38-400e-9f47-0a5b6d255ae9" containerName="console"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396547    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="affe6578-5d38-400e-9f47-0a5b6d255ae9" containerName="console"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396552    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="kube-rbac-proxy-web"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396557    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="kube-rbac-proxy-web"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396599    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="config-reloader"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396607    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="kube-rbac-proxy-web"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396615    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="alertmanager"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396621    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="prom-label-proxy"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396627    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="kube-rbac-proxy-metric"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396632    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" containerName="kube-rbac-proxy"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396637    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c823891b-f18c-49e3-af0e-d88a51704877" containerName="console"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396642    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="699c6c7a-0b4d-45d1-8671-b3e78a9fe9be" containerName="registry"
Jul 20 22:25:37.396703 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.396648    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="affe6578-5d38-400e-9f47-0a5b6d255ae9" containerName="console"
Jul 20 22:25:37.399890 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.399874    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.402112 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.402093    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5km2s\""
Jul 20 22:25:37.402197 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.402099    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 20 22:25:37.402449 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.402432    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 20 22:25:37.402512 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.402477    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 20 22:25:37.402512 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.402432    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 20 22:25:37.402512 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.402479    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 20 22:25:37.402665 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.402529    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 20 22:25:37.402665 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.402535    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 20 22:25:37.402781 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.402766    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 20 22:25:37.408388 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.408366    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 20 22:25:37.418942 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.418917    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:25:37.458653 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.458620    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.458784 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.458656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.458784 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.458683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-web-config\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.458784 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.458699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.458784 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.458765    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-config-out\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.458950 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.458797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.458950 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.458817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.458950 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.458834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gt64\" (UniqueName: \"kubernetes.io/projected/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-kube-api-access-7gt64\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.458950 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.458852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-config-volume\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.458950 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.458912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.459097 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.459013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.459097 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.459045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.459097 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.459064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.560206 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.560392 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.560392 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-web-config\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.560392 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560273    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.560392 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-config-out\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.560392 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560368    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.560652 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.560652 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560414    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gt64\" (UniqueName: \"kubernetes.io/projected/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-kube-api-access-7gt64\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.560652 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-config-volume\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.560652 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.560652 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.560652 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560580    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.560652 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.561031 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.560980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.561328 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.561273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.561753 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.561442    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.563390 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.563364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.563640 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.563615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-config-volume\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.563725 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.563661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-config-out\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.563857 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.563833    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-web-config\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.563921 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.563887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.564114 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.564094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.564231 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.564213    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.564293 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.564255    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.565719 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.565702    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.575292 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.575274    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gt64\" (UniqueName: \"kubernetes.io/projected/d26a2ca7-bb34-4355-8d5a-ae7d7f30e567-kube-api-access-7gt64\") pod \"alertmanager-main-0\" (UID: \"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.710118 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.710082    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 20 22:25:37.847344 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:37.847320    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 20 22:25:37.849672 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:25:37.849649    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26a2ca7_bb34_4355_8d5a_ae7d7f30e567.slice/crio-1b85a2ef4d9e0e9346b569ad7111e37d2642efc7c3530aac20830a5f5dade625 WatchSource:0}: Error finding container 1b85a2ef4d9e0e9346b569ad7111e37d2642efc7c3530aac20830a5f5dade625: Status 404 returned error can't find the container with id 1b85a2ef4d9e0e9346b569ad7111e37d2642efc7c3530aac20830a5f5dade625
Jul 20 22:25:38.346588 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:38.346552    2579 generic.go:356] "Generic (PLEG): container finished" podID="d26a2ca7-bb34-4355-8d5a-ae7d7f30e567" containerID="2bebc515bb1ef590e2c586f526eb733e67497ede0b8c5550950b5782fd27ab0a" exitCode=0
Jul 20 22:25:38.346732 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:38.346592    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567","Type":"ContainerDied","Data":"2bebc515bb1ef590e2c586f526eb733e67497ede0b8c5550950b5782fd27ab0a"}
Jul 20 22:25:38.346732 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:38.346651    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567","Type":"ContainerStarted","Data":"1b85a2ef4d9e0e9346b569ad7111e37d2642efc7c3530aac20830a5f5dade625"}
Jul 20 22:25:38.368628 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:38.368603    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c98b4f3-b4db-4800-ad08-c0bf81600ef2" path="/var/lib/kubelet/pods/3c98b4f3-b4db-4800-ad08-c0bf81600ef2/volumes"
Jul 20 22:25:39.355637 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:39.355604    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567","Type":"ContainerStarted","Data":"a78d468cb33903c100808a9b33ab002cd9524e8f41961f9592a5a525c06c6ba9"}
Jul 20 22:25:39.356025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:39.355665    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567","Type":"ContainerStarted","Data":"8eac1c45daaf52aa9f4c2d2fe4fd2eeb654613d8bcc8494fd68aeaa6b6ed8dbd"}
Jul 20 22:25:39.356025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:39.355694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567","Type":"ContainerStarted","Data":"3b5051505bc45b68a59e32241938263ac6c44b64334273ba80b2ee88d479fe9a"}
Jul 20 22:25:39.356025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:39.355717    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567","Type":"ContainerStarted","Data":"9e4cef89408d6506ef961dc66f0a2f6b7faef33f1ab26c0d90277c13f4ed6f91"}
Jul 20 22:25:39.356025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:39.355739    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567","Type":"ContainerStarted","Data":"d80a69a86b07549cf28b011e380425efdd7d4caeea1cf83521d31a20f036c3a1"}
Jul 20 22:25:39.356025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:39.355766    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d26a2ca7-bb34-4355-8d5a-ae7d7f30e567","Type":"ContainerStarted","Data":"f4218e4608df9276af2f81db37d413de77dd94ca8245981dc7eaa4da7c90bda6"}
Jul 20 22:25:39.385519 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:39.385455    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.370996126 podStartE2EDuration="2.385433123s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.436997ms" isStatefulPod=false podCreationTimestamp="2026-07-20 22:25:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:25:39.383352722 +0000 UTC m=+169.498737348" watchObservedRunningTime="2026-07-20 22:25:39.385433123 +0000 UTC m=+169.500817750"
Jul 20 22:25:43.727548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:25:43.727457    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cfb5d4c46-dbvr5"]
Jul 20 22:26:08.749057 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:08.748998    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cfb5d4c46-dbvr5" podUID="9946209e-7133-4c20-a2a5-35e8111c88e1" containerName="console" containerID="cri-o://4c13e8c540ed059566bb60788431812c2ba3182c6bf56c902693a901cff62ae3" gracePeriod=15
Jul 20 22:26:08.993938 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:08.993911    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:26:09.027705 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.027635    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-service-ca\") pod \"9946209e-7133-4c20-a2a5-35e8111c88e1\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") "
Jul 20 22:26:09.027866 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.027718    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlthc\" (UniqueName: \"kubernetes.io/projected/9946209e-7133-4c20-a2a5-35e8111c88e1-kube-api-access-tlthc\") pod \"9946209e-7133-4c20-a2a5-35e8111c88e1\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") "
Jul 20 22:26:09.027866 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.027756    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9946209e-7133-4c20-a2a5-35e8111c88e1-console-serving-cert\") pod \"9946209e-7133-4c20-a2a5-35e8111c88e1\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") "
Jul 20 22:26:09.027866 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.027781    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-console-config\") pod \"9946209e-7133-4c20-a2a5-35e8111c88e1\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") "
Jul 20 22:26:09.027866 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.027799    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9946209e-7133-4c20-a2a5-35e8111c88e1-console-oauth-config\") pod \"9946209e-7133-4c20-a2a5-35e8111c88e1\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") "
Jul 20 22:26:09.027866 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.027816    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-trusted-ca-bundle\") pod \"9946209e-7133-4c20-a2a5-35e8111c88e1\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") "
Jul 20 22:26:09.028126 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.028080    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-service-ca" (OuterVolumeSpecName: "service-ca") pod "9946209e-7133-4c20-a2a5-35e8111c88e1" (UID: "9946209e-7133-4c20-a2a5-35e8111c88e1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:26:09.028246 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.028210    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-console-config" (OuterVolumeSpecName: "console-config") pod "9946209e-7133-4c20-a2a5-35e8111c88e1" (UID: "9946209e-7133-4c20-a2a5-35e8111c88e1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:26:09.028395 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.028360    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9946209e-7133-4c20-a2a5-35e8111c88e1" (UID: "9946209e-7133-4c20-a2a5-35e8111c88e1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:26:09.029857 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.029834    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9946209e-7133-4c20-a2a5-35e8111c88e1-kube-api-access-tlthc" (OuterVolumeSpecName: "kube-api-access-tlthc") pod "9946209e-7133-4c20-a2a5-35e8111c88e1" (UID: "9946209e-7133-4c20-a2a5-35e8111c88e1"). InnerVolumeSpecName "kube-api-access-tlthc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:26:09.029955 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.029832    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9946209e-7133-4c20-a2a5-35e8111c88e1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9946209e-7133-4c20-a2a5-35e8111c88e1" (UID: "9946209e-7133-4c20-a2a5-35e8111c88e1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:26:09.030390 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.030370    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9946209e-7133-4c20-a2a5-35e8111c88e1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9946209e-7133-4c20-a2a5-35e8111c88e1" (UID: "9946209e-7133-4c20-a2a5-35e8111c88e1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:26:09.128757 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.128718    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-oauth-serving-cert\") pod \"9946209e-7133-4c20-a2a5-35e8111c88e1\" (UID: \"9946209e-7133-4c20-a2a5-35e8111c88e1\") "
Jul 20 22:26:09.128924 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.128889    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-console-config\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:26:09.128924 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.128901    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9946209e-7133-4c20-a2a5-35e8111c88e1-console-oauth-config\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:26:09.128924 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.128910    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-trusted-ca-bundle\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:26:09.128924 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.128919    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-service-ca\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:26:09.129048 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.128927    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlthc\" (UniqueName: \"kubernetes.io/projected/9946209e-7133-4c20-a2a5-35e8111c88e1-kube-api-access-tlthc\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:26:09.129048 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.128936    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9946209e-7133-4c20-a2a5-35e8111c88e1-console-serving-cert\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:26:09.129108 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.129048    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9946209e-7133-4c20-a2a5-35e8111c88e1" (UID: "9946209e-7133-4c20-a2a5-35e8111c88e1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:26:09.229996 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.229960    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9946209e-7133-4c20-a2a5-35e8111c88e1-oauth-serving-cert\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:26:09.468399 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.468362    2579 generic.go:356] "Generic (PLEG): container finished" podID="9946209e-7133-4c20-a2a5-35e8111c88e1" containerID="4c13e8c540ed059566bb60788431812c2ba3182c6bf56c902693a901cff62ae3" exitCode=0
Jul 20 22:26:09.468597 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.468406    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfb5d4c46-dbvr5" event={"ID":"9946209e-7133-4c20-a2a5-35e8111c88e1","Type":"ContainerDied","Data":"4c13e8c540ed059566bb60788431812c2ba3182c6bf56c902693a901cff62ae3"}
Jul 20 22:26:09.468597 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.468413    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfb5d4c46-dbvr5"
Jul 20 22:26:09.468597 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.468448    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfb5d4c46-dbvr5" event={"ID":"9946209e-7133-4c20-a2a5-35e8111c88e1","Type":"ContainerDied","Data":"a19f65cccbf1bbd1bb96e84147cc9000dbecd2573f9d49dda967e8436ba1d1cc"}
Jul 20 22:26:09.468597 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.468467    2579 scope.go:117] "RemoveContainer" containerID="4c13e8c540ed059566bb60788431812c2ba3182c6bf56c902693a901cff62ae3"
Jul 20 22:26:09.478859 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.478834    2579 scope.go:117] "RemoveContainer" containerID="4c13e8c540ed059566bb60788431812c2ba3182c6bf56c902693a901cff62ae3"
Jul 20 22:26:09.479179 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:26:09.479153    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c13e8c540ed059566bb60788431812c2ba3182c6bf56c902693a901cff62ae3\": container with ID starting with 4c13e8c540ed059566bb60788431812c2ba3182c6bf56c902693a901cff62ae3 not found: ID does not exist" containerID="4c13e8c540ed059566bb60788431812c2ba3182c6bf56c902693a901cff62ae3"
Jul 20 22:26:09.479268 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.479185    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c13e8c540ed059566bb60788431812c2ba3182c6bf56c902693a901cff62ae3"} err="failed to get container status \"4c13e8c540ed059566bb60788431812c2ba3182c6bf56c902693a901cff62ae3\": rpc error: code = NotFound desc = could not find container \"4c13e8c540ed059566bb60788431812c2ba3182c6bf56c902693a901cff62ae3\": container with ID starting with 4c13e8c540ed059566bb60788431812c2ba3182c6bf56c902693a901cff62ae3 not found: ID does not exist"
Jul 20 22:26:09.492140 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.492111    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cfb5d4c46-dbvr5"]
Jul 20 22:26:09.495876 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:09.495851    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cfb5d4c46-dbvr5"]
Jul 20 22:26:10.367293 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:26:10.367254    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9946209e-7133-4c20-a2a5-35e8111c88e1" path="/var/lib/kubelet/pods/9946209e-7133-4c20-a2a5-35e8111c88e1/volumes"
Jul 20 22:27:02.633796 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.633762    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb"]
Jul 20 22:27:02.634201 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.634058    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9946209e-7133-4c20-a2a5-35e8111c88e1" containerName="console"
Jul 20 22:27:02.634201 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.634068    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9946209e-7133-4c20-a2a5-35e8111c88e1" containerName="console"
Jul 20 22:27:02.634201 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.634122    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9946209e-7133-4c20-a2a5-35e8111c88e1" containerName="console"
Jul 20 22:27:02.636771 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.636751    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb"
Jul 20 22:27:02.639058 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.639036    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 20 22:27:02.639155 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.639100    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xr2hg\""
Jul 20 22:27:02.639335 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.639290    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 20 22:27:02.651699 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.651667    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb"]
Jul 20 22:27:02.670983 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.670950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz9f7\" (UniqueName: \"kubernetes.io/projected/494635ee-e94d-44bc-a3ab-61dc43c6e0f8-kube-api-access-wz9f7\") pod \"cert-manager-operator-controller-manager-55c444bf86-pgndb\" (UID: \"494635ee-e94d-44bc-a3ab-61dc43c6e0f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb"
Jul 20 22:27:02.671166 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.671049    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/494635ee-e94d-44bc-a3ab-61dc43c6e0f8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pgndb\" (UID: \"494635ee-e94d-44bc-a3ab-61dc43c6e0f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb"
Jul 20 22:27:02.771910 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.771869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz9f7\" (UniqueName: \"kubernetes.io/projected/494635ee-e94d-44bc-a3ab-61dc43c6e0f8-kube-api-access-wz9f7\") pod \"cert-manager-operator-controller-manager-55c444bf86-pgndb\" (UID: \"494635ee-e94d-44bc-a3ab-61dc43c6e0f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb"
Jul 20 22:27:02.772096 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.771930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/494635ee-e94d-44bc-a3ab-61dc43c6e0f8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pgndb\" (UID: \"494635ee-e94d-44bc-a3ab-61dc43c6e0f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb"
Jul 20 22:27:02.772274 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.772259    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/494635ee-e94d-44bc-a3ab-61dc43c6e0f8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pgndb\" (UID: \"494635ee-e94d-44bc-a3ab-61dc43c6e0f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb"
Jul 20 22:27:02.781416 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.781386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz9f7\" (UniqueName: \"kubernetes.io/projected/494635ee-e94d-44bc-a3ab-61dc43c6e0f8-kube-api-access-wz9f7\") pod \"cert-manager-operator-controller-manager-55c444bf86-pgndb\" (UID: \"494635ee-e94d-44bc-a3ab-61dc43c6e0f8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb"
Jul 20 22:27:02.945863 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:02.945781    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb"
Jul 20 22:27:03.088698 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:03.088501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb"]
Jul 20 22:27:03.092047 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:27:03.092019    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494635ee_e94d_44bc_a3ab_61dc43c6e0f8.slice/crio-8353d454d76174f6cd3b76750b743d4d598c76d049be593e7946a45e77c34613 WatchSource:0}: Error finding container 8353d454d76174f6cd3b76750b743d4d598c76d049be593e7946a45e77c34613: Status 404 returned error can't find the container with id 8353d454d76174f6cd3b76750b743d4d598c76d049be593e7946a45e77c34613
Jul 20 22:27:03.672718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:03.672680    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb" event={"ID":"494635ee-e94d-44bc-a3ab-61dc43c6e0f8","Type":"ContainerStarted","Data":"8353d454d76174f6cd3b76750b743d4d598c76d049be593e7946a45e77c34613"}
Jul 20 22:27:05.683744 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:05.683703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb" event={"ID":"494635ee-e94d-44bc-a3ab-61dc43c6e0f8","Type":"ContainerStarted","Data":"2b3b6a7e638eaa12462797994e9125309c65e2104605a48b133c5e5ee909580d"}
Jul 20 22:27:05.706988 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:05.706936    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pgndb" podStartSLOduration=1.259491886 podStartE2EDuration="3.706922141s" totalImagesPullingTime="2.447430255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:27:05.706095167 +0000 UTC m=+255.821479803" watchObservedRunningTime="2026-07-20 22:27:05.706922141 +0000 UTC m=+255.822306766"
Jul 20 22:27:14.100128 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.100043    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sdhnt"]
Jul 20 22:27:14.103283 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.103263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sdhnt"
Jul 20 22:27:14.105542 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.105521    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 22:27:14.106102 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.106087    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 22:27:14.106153 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.106121    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-cqs5h\""
Jul 20 22:27:14.113347 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.113327    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sdhnt"]
Jul 20 22:27:14.161155 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.161120    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a85584c1-5c6b-4db6-ba4f-e78736f2e5d9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sdhnt\" (UID: \"a85584c1-5c6b-4db6-ba4f-e78736f2e5d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sdhnt"
Jul 20 22:27:14.161356 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.161167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw8h8\" (UniqueName: \"kubernetes.io/projected/a85584c1-5c6b-4db6-ba4f-e78736f2e5d9-kube-api-access-zw8h8\") pod \"cert-manager-webhook-6486ffd997-sdhnt\" (UID: \"a85584c1-5c6b-4db6-ba4f-e78736f2e5d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sdhnt"
Jul 20 22:27:14.262215 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.262181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a85584c1-5c6b-4db6-ba4f-e78736f2e5d9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sdhnt\" (UID: \"a85584c1-5c6b-4db6-ba4f-e78736f2e5d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sdhnt"
Jul 20 22:27:14.262450 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.262229    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw8h8\" (UniqueName: \"kubernetes.io/projected/a85584c1-5c6b-4db6-ba4f-e78736f2e5d9-kube-api-access-zw8h8\") pod \"cert-manager-webhook-6486ffd997-sdhnt\" (UID: \"a85584c1-5c6b-4db6-ba4f-e78736f2e5d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sdhnt"
Jul 20 22:27:14.271371 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.271336    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a85584c1-5c6b-4db6-ba4f-e78736f2e5d9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sdhnt\" (UID: \"a85584c1-5c6b-4db6-ba4f-e78736f2e5d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sdhnt"
Jul 20 22:27:14.271530 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.271513    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw8h8\" (UniqueName: \"kubernetes.io/projected/a85584c1-5c6b-4db6-ba4f-e78736f2e5d9-kube-api-access-zw8h8\") pod \"cert-manager-webhook-6486ffd997-sdhnt\" (UID: \"a85584c1-5c6b-4db6-ba4f-e78736f2e5d9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sdhnt"
Jul 20 22:27:14.411548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.411516    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sdhnt"
Jul 20 22:27:14.557008 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.556970    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sdhnt"]
Jul 20 22:27:14.559759 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:27:14.559727    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda85584c1_5c6b_4db6_ba4f_e78736f2e5d9.slice/crio-49c285c59862a235ee81ad640760056ca52acdb53615fa946f822aa02c461a66 WatchSource:0}: Error finding container 49c285c59862a235ee81ad640760056ca52acdb53615fa946f822aa02c461a66: Status 404 returned error can't find the container with id 49c285c59862a235ee81ad640760056ca52acdb53615fa946f822aa02c461a66
Jul 20 22:27:14.721341 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:14.721214    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sdhnt" event={"ID":"a85584c1-5c6b-4db6-ba4f-e78736f2e5d9","Type":"ContainerStarted","Data":"49c285c59862a235ee81ad640760056ca52acdb53615fa946f822aa02c461a66"}
Jul 20 22:27:16.708745 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:16.708705    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76"]
Jul 20 22:27:16.712272 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:16.712246    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76"
Jul 20 22:27:16.714994 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:16.714970    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 22:27:16.715713 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:16.715686    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-x2qrq\""
Jul 20 22:27:16.715713 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:16.715686    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 22:27:16.722523 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:16.722499    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76"]
Jul 20 22:27:16.783577 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:16.783539    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74170034-6c55-4469-bb0c-7b12435b8ae2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f8r76\" (UID: \"74170034-6c55-4469-bb0c-7b12435b8ae2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76"
Jul 20 22:27:16.783781 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:16.783658    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws77b\" (UniqueName: \"kubernetes.io/projected/74170034-6c55-4469-bb0c-7b12435b8ae2-kube-api-access-ws77b\") pod \"openshift-lws-operator-fd8ccff4c-f8r76\" (UID: \"74170034-6c55-4469-bb0c-7b12435b8ae2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76"
Jul 20 22:27:16.885017 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:16.884994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws77b\" (UniqueName: \"kubernetes.io/projected/74170034-6c55-4469-bb0c-7b12435b8ae2-kube-api-access-ws77b\") pod \"openshift-lws-operator-fd8ccff4c-f8r76\" (UID: \"74170034-6c55-4469-bb0c-7b12435b8ae2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76"
Jul 20 22:27:16.885102 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:16.885058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74170034-6c55-4469-bb0c-7b12435b8ae2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f8r76\" (UID: \"74170034-6c55-4469-bb0c-7b12435b8ae2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76"
Jul 20 22:27:16.885400 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:16.885383    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74170034-6c55-4469-bb0c-7b12435b8ae2-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f8r76\" (UID: \"74170034-6c55-4469-bb0c-7b12435b8ae2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76"
Jul 20 22:27:16.893157 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:16.893134    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws77b\" (UniqueName: \"kubernetes.io/projected/74170034-6c55-4469-bb0c-7b12435b8ae2-kube-api-access-ws77b\") pod \"openshift-lws-operator-fd8ccff4c-f8r76\" (UID: \"74170034-6c55-4469-bb0c-7b12435b8ae2\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76"
Jul 20 22:27:17.024642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:17.024554    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76"
Jul 20 22:27:17.182604 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:17.182576    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76"]
Jul 20 22:27:17.185116 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:27:17.185089    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74170034_6c55_4469_bb0c_7b12435b8ae2.slice/crio-572fcf217077f8567a7c40996eb55d386ac74a1a187c273e29dce489d54497e8 WatchSource:0}: Error finding container 572fcf217077f8567a7c40996eb55d386ac74a1a187c273e29dce489d54497e8: Status 404 returned error can't find the container with id 572fcf217077f8567a7c40996eb55d386ac74a1a187c273e29dce489d54497e8
Jul 20 22:27:17.737477 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:17.737439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sdhnt" event={"ID":"a85584c1-5c6b-4db6-ba4f-e78736f2e5d9","Type":"ContainerStarted","Data":"291a1828acff4ce5191c5d80848e8cdba8ff4c77f0b823ca64d2c57fa14b80cb"}
Jul 20 22:27:17.737910 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:17.737494    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sdhnt"
Jul 20 22:27:17.738880 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:17.738856    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76" event={"ID":"74170034-6c55-4469-bb0c-7b12435b8ae2","Type":"ContainerStarted","Data":"572fcf217077f8567a7c40996eb55d386ac74a1a187c273e29dce489d54497e8"}
Jul 20 22:27:17.760792 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:17.760741    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-sdhnt" podStartSLOduration=1.437619836 podStartE2EDuration="3.760726074s" totalImagesPullingTime="2.323106238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:27:17.759722938 +0000 UTC m=+267.875107563" watchObservedRunningTime="2026-07-20 22:27:17.760726074 +0000 UTC m=+267.876110699"
Jul 20 22:27:19.749265 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:19.749234    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76" event={"ID":"74170034-6c55-4469-bb0c-7b12435b8ae2","Type":"ContainerStarted","Data":"e3cdcf907e57fdf161399753975c7bc0dd2d6c155307704772f3adac76a3fdc6"}
Jul 20 22:27:19.768262 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:19.768214    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f8r76" podStartSLOduration=1.293269875 podStartE2EDuration="3.7681952s" totalImagesPullingTime="2.474925325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:27:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:27:19.767201485 +0000 UTC m=+269.882586131" watchObservedRunningTime="2026-07-20 22:27:19.7681952 +0000 UTC m=+269.883579825"
Jul 20 22:27:23.746726 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:23.746690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sdhnt"
Jul 20 22:27:36.798918 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:36.798881    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"]
Jul 20 22:27:36.807914 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:36.807881    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:36.811416 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:36.811393    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 22:27:36.811565 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:36.811540    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s6fj4\""
Jul 20 22:27:36.811748 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:36.811735    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 22:27:36.811994 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:36.811976    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 22:27:36.812134 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:36.812118    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 22:27:36.823420 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:36.823390    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"]
Jul 20 22:27:36.958246 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:36.958216    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9bb1c24-b396-409b-9a03-9a84691b3d93-tmp\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:36.958432 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:36.958255    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78jqm\" (UniqueName: \"kubernetes.io/projected/a9bb1c24-b396-409b-9a03-9a84691b3d93-kube-api-access-78jqm\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:36.958432 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:36.958281    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a9bb1c24-b396-409b-9a03-9a84691b3d93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:36.958432 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:36.958333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9bb1c24-b396-409b-9a03-9a84691b3d93-webhook-cert\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:36.958432 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:36.958413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a9bb1c24-b396-409b-9a03-9a84691b3d93-manifests\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:37.059297 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:37.059217    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9bb1c24-b396-409b-9a03-9a84691b3d93-tmp\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:37.059297 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:37.059252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78jqm\" (UniqueName: \"kubernetes.io/projected/a9bb1c24-b396-409b-9a03-9a84691b3d93-kube-api-access-78jqm\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:37.059297 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:37.059275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a9bb1c24-b396-409b-9a03-9a84691b3d93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:37.059548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:37.059322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9bb1c24-b396-409b-9a03-9a84691b3d93-webhook-cert\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:37.059548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:37.059433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a9bb1c24-b396-409b-9a03-9a84691b3d93-manifests\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:37.059765 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:37.059743    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a9bb1c24-b396-409b-9a03-9a84691b3d93-manifests\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:37.061688 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:37.061663    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a9bb1c24-b396-409b-9a03-9a84691b3d93-tmp\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:37.061800 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:37.061740    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a9bb1c24-b396-409b-9a03-9a84691b3d93-webhook-cert\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:37.061976 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:37.061953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a9bb1c24-b396-409b-9a03-9a84691b3d93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:37.073501 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:37.073471    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78jqm\" (UniqueName: \"kubernetes.io/projected/a9bb1c24-b396-409b-9a03-9a84691b3d93-kube-api-access-78jqm\") pod \"opendatahub-operator-controller-manager-6795f5f468-cwj52\" (UID: \"a9bb1c24-b396-409b-9a03-9a84691b3d93\") " pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:37.118972 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:37.118934    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:37.261455 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:37.261419    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"]
Jul 20 22:27:37.264743 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:27:37.264716    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9bb1c24_b396_409b_9a03_9a84691b3d93.slice/crio-845873503cbf902f53301cf61bf6e4ba3db51a9a1aff82886f34c9159a749e1a WatchSource:0}: Error finding container 845873503cbf902f53301cf61bf6e4ba3db51a9a1aff82886f34c9159a749e1a: Status 404 returned error can't find the container with id 845873503cbf902f53301cf61bf6e4ba3db51a9a1aff82886f34c9159a749e1a
Jul 20 22:27:37.827723 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:37.827686    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52" event={"ID":"a9bb1c24-b396-409b-9a03-9a84691b3d93","Type":"ContainerStarted","Data":"845873503cbf902f53301cf61bf6e4ba3db51a9a1aff82886f34c9159a749e1a"}
Jul 20 22:27:40.844583 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:40.844548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52" event={"ID":"a9bb1c24-b396-409b-9a03-9a84691b3d93","Type":"ContainerStarted","Data":"fc41b4d25bf0efbda303e1a1a98169566d937b3145e5bb4ff0ffe7ae389492d2"}
Jul 20 22:27:41.850244 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:41.850153    2579 generic.go:356] "Generic (PLEG): container finished" podID="a9bb1c24-b396-409b-9a03-9a84691b3d93" containerID="fc41b4d25bf0efbda303e1a1a98169566d937b3145e5bb4ff0ffe7ae389492d2" exitCode=0
Jul 20 22:27:41.850614 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:41.850242    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52" event={"ID":"a9bb1c24-b396-409b-9a03-9a84691b3d93","Type":"ContainerDied","Data":"fc41b4d25bf0efbda303e1a1a98169566d937b3145e5bb4ff0ffe7ae389492d2"}
Jul 20 22:27:42.857787 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:42.857753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52" event={"ID":"a9bb1c24-b396-409b-9a03-9a84691b3d93","Type":"ContainerStarted","Data":"adedadde3dd472016122dfc9fc8c545c3f1b3bce989540136709334e6f0afb4e"}
Jul 20 22:27:42.858270 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:42.857889    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:42.897966 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:42.897913    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52" podStartSLOduration=2.425969996 podStartE2EDuration="6.897893603s" totalImagesPullingTime="3.428026839s" totalInitContainerRuntime="1.043896768s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:27:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:27:42.896688407 +0000 UTC m=+293.012073032" watchObservedRunningTime="2026-07-20 22:27:42.897893603 +0000 UTC m=+293.013278228"
Jul 20 22:27:50.250038 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:50.250012    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 22:27:53.864264 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:53.864232    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6795f5f468-cwj52"
Jul 20 22:27:57.137908 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.137872    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"]
Jul 20 22:27:57.141623 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.141599    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"
Jul 20 22:27:57.150685 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.150657    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 22:27:57.154139 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.154112    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 22:27:57.155274 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.155251    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 22:27:57.170080 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.170054    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 22:27:57.170256 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.170137    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"]
Jul 20 22:27:57.341785 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.341747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggmsp\" (UniqueName: \"kubernetes.io/projected/662561cb-4db4-4a66-b4b3-86597bc326b8-kube-api-access-ggmsp\") pod \"kube-auth-proxy-5957d7d59-g2p4f\" (UID: \"662561cb-4db4-4a66-b4b3-86597bc326b8\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"
Jul 20 22:27:57.341785 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.341785    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/662561cb-4db4-4a66-b4b3-86597bc326b8-tmp\") pod \"kube-auth-proxy-5957d7d59-g2p4f\" (UID: \"662561cb-4db4-4a66-b4b3-86597bc326b8\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"
Jul 20 22:27:57.342025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.341813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/662561cb-4db4-4a66-b4b3-86597bc326b8-tls-certs\") pod \"kube-auth-proxy-5957d7d59-g2p4f\" (UID: \"662561cb-4db4-4a66-b4b3-86597bc326b8\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"
Jul 20 22:27:57.442971 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.442865    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggmsp\" (UniqueName: \"kubernetes.io/projected/662561cb-4db4-4a66-b4b3-86597bc326b8-kube-api-access-ggmsp\") pod \"kube-auth-proxy-5957d7d59-g2p4f\" (UID: \"662561cb-4db4-4a66-b4b3-86597bc326b8\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"
Jul 20 22:27:57.442971 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.442907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/662561cb-4db4-4a66-b4b3-86597bc326b8-tmp\") pod \"kube-auth-proxy-5957d7d59-g2p4f\" (UID: \"662561cb-4db4-4a66-b4b3-86597bc326b8\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"
Jul 20 22:27:57.442971 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.442933    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/662561cb-4db4-4a66-b4b3-86597bc326b8-tls-certs\") pod \"kube-auth-proxy-5957d7d59-g2p4f\" (UID: \"662561cb-4db4-4a66-b4b3-86597bc326b8\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"
Jul 20 22:27:57.445455 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.445426    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/662561cb-4db4-4a66-b4b3-86597bc326b8-tmp\") pod \"kube-auth-proxy-5957d7d59-g2p4f\" (UID: \"662561cb-4db4-4a66-b4b3-86597bc326b8\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"
Jul 20 22:27:57.445762 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.445739    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/662561cb-4db4-4a66-b4b3-86597bc326b8-tls-certs\") pod \"kube-auth-proxy-5957d7d59-g2p4f\" (UID: \"662561cb-4db4-4a66-b4b3-86597bc326b8\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"
Jul 20 22:27:57.469174 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.469136    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xn9sf"]
Jul 20 22:27:57.470152 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.470125    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggmsp\" (UniqueName: \"kubernetes.io/projected/662561cb-4db4-4a66-b4b3-86597bc326b8-kube-api-access-ggmsp\") pod \"kube-auth-proxy-5957d7d59-g2p4f\" (UID: \"662561cb-4db4-4a66-b4b3-86597bc326b8\") " pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"
Jul 20 22:27:57.472645 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.472615    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf"
Jul 20 22:27:57.474767 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.474743    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lpfgz\""
Jul 20 22:27:57.475128 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.475110    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 20 22:27:57.491277 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.491244    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xn9sf"]
Jul 20 22:27:57.543466 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.543431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0-cert\") pod \"odh-model-controller-7998c67dc4-xn9sf\" (UID: \"f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0\") " pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf"
Jul 20 22:27:57.543680 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.543519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brbxt\" (UniqueName: \"kubernetes.io/projected/f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0-kube-api-access-brbxt\") pod \"odh-model-controller-7998c67dc4-xn9sf\" (UID: \"f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0\") " pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf"
Jul 20 22:27:57.644028 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.643995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brbxt\" (UniqueName: \"kubernetes.io/projected/f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0-kube-api-access-brbxt\") pod \"odh-model-controller-7998c67dc4-xn9sf\" (UID: \"f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0\") " pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf"
Jul 20 22:27:57.644358 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.644051    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0-cert\") pod \"odh-model-controller-7998c67dc4-xn9sf\" (UID: \"f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0\") " pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf"
Jul 20 22:27:57.644358 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:27:57.644169    2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 20 22:27:57.644358 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:27:57.644250    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0-cert podName:f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0 nodeName:}" failed. No retries permitted until 2026-07-20 22:27:58.144225698 +0000 UTC m=+308.259610317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0-cert") pod "odh-model-controller-7998c67dc4-xn9sf" (UID: "f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0") : secret "odh-model-controller-webhook-cert" not found
Jul 20 22:27:57.684381 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.684351    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brbxt\" (UniqueName: \"kubernetes.io/projected/f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0-kube-api-access-brbxt\") pod \"odh-model-controller-7998c67dc4-xn9sf\" (UID: \"f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0\") " pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf"
Jul 20 22:27:57.753269 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.753186    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"
Jul 20 22:27:57.960517 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:27:57.960488    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662561cb_4db4_4a66_b4b3_86597bc326b8.slice/crio-16393a8f5597dd9266c175ef6ebcd8b659493f0a771d4af20d02b8023bd26b27 WatchSource:0}: Error finding container 16393a8f5597dd9266c175ef6ebcd8b659493f0a771d4af20d02b8023bd26b27: Status 404 returned error can't find the container with id 16393a8f5597dd9266c175ef6ebcd8b659493f0a771d4af20d02b8023bd26b27
Jul 20 22:27:57.962744 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.962726    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:27:57.974597 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:57.974569    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f"]
Jul 20 22:27:58.148382 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:58.148339    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0-cert\") pod \"odh-model-controller-7998c67dc4-xn9sf\" (UID: \"f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0\") " pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf"
Jul 20 22:27:58.148790 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:27:58.148534    2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 20 22:27:58.148790 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:27:58.148613    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0-cert podName:f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0 nodeName:}" failed. No retries permitted until 2026-07-20 22:27:59.148591039 +0000 UTC m=+309.263975643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0-cert") pod "odh-model-controller-7998c67dc4-xn9sf" (UID: "f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0") : secret "odh-model-controller-webhook-cert" not found
Jul 20 22:27:58.927328 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:58.927270    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f" event={"ID":"662561cb-4db4-4a66-b4b3-86597bc326b8","Type":"ContainerStarted","Data":"16393a8f5597dd9266c175ef6ebcd8b659493f0a771d4af20d02b8023bd26b27"}
Jul 20 22:27:59.158833 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.158792    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0-cert\") pod \"odh-model-controller-7998c67dc4-xn9sf\" (UID: \"f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0\") " pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf"
Jul 20 22:27:59.161987 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.161953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0-cert\") pod \"odh-model-controller-7998c67dc4-xn9sf\" (UID: \"f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0\") " pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf"
Jul 20 22:27:59.287249 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.287155    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf"
Jul 20 22:27:59.301123 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.301076    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5rf4f"]
Jul 20 22:27:59.305141 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.305084    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f"
Jul 20 22:27:59.309042 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:27:59.308945    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"model-serving-api-54d89bd5fc-5rf4f\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="a70b5f3a-7c00-41f2-8dab-3ec7c0f36879" pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f"
Jul 20 22:27:59.309177 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:27:59.309069    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"model-serving-api-tls\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" type="*v1.Secret"
Jul 20 22:27:59.309353 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:27:59.309324    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"model-serving-api-dockercfg-hmvpl\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hmvpl\"" type="*v1.Secret"
Jul 20 22:27:59.360064 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.360029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a70b5f3a-7c00-41f2-8dab-3ec7c0f36879-tls-certs\") pod \"model-serving-api-54d89bd5fc-5rf4f\" (UID: \"a70b5f3a-7c00-41f2-8dab-3ec7c0f36879\") " pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f"
Jul 20 22:27:59.360220 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.360095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lcdx\" (UniqueName: \"kubernetes.io/projected/a70b5f3a-7c00-41f2-8dab-3ec7c0f36879-kube-api-access-5lcdx\") pod \"model-serving-api-54d89bd5fc-5rf4f\" (UID: \"a70b5f3a-7c00-41f2-8dab-3ec7c0f36879\") " pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f"
Jul 20 22:27:59.385858 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.385786    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5rf4f"]
Jul 20 22:27:59.464365 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.464327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lcdx\" (UniqueName: \"kubernetes.io/projected/a70b5f3a-7c00-41f2-8dab-3ec7c0f36879-kube-api-access-5lcdx\") pod \"model-serving-api-54d89bd5fc-5rf4f\" (UID: \"a70b5f3a-7c00-41f2-8dab-3ec7c0f36879\") " pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f"
Jul 20 22:27:59.464511 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.464470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a70b5f3a-7c00-41f2-8dab-3ec7c0f36879-tls-certs\") pod \"model-serving-api-54d89bd5fc-5rf4f\" (UID: \"a70b5f3a-7c00-41f2-8dab-3ec7c0f36879\") " pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f"
Jul 20 22:27:59.464837 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.464809    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xn9sf"]
Jul 20 22:27:59.484274 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.484243    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lcdx\" (UniqueName: \"kubernetes.io/projected/a70b5f3a-7c00-41f2-8dab-3ec7c0f36879-kube-api-access-5lcdx\") pod \"model-serving-api-54d89bd5fc-5rf4f\" (UID: \"a70b5f3a-7c00-41f2-8dab-3ec7c0f36879\") " pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f"
Jul 20 22:27:59.861493 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.861455    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"]
Jul 20 22:27:59.866162 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.866080    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:27:59.869035 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.869010    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 20 22:27:59.869187 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.869014    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 20 22:27:59.869187 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.869083    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6qqcw\""
Jul 20 22:27:59.869187 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.869154    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 20 22:27:59.869710 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.869690    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 22:27:59.878059 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.878031    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"]
Jul 20 22:27:59.940930 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.940892    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf" event={"ID":"f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0","Type":"ContainerStarted","Data":"d1ec36f551b501b96cac5cb69c89387b1c2b74f24edcb45cb815ce9fa737f91b"}
Jul 20 22:27:59.968985 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.968943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:27:59.969187 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.969037    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:27:59.969187 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.969079    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-local-certs\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:27:59.969187 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.969102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-cacerts\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:27:59.969187 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.969167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:27:59.969427 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.969214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-token\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:27:59.969427 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:27:59.969293    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7c4d\" (UniqueName: \"kubernetes.io/projected/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-kube-api-access-j7c4d\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.070559 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.070520    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-local-certs\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.070559 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.070568    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-cacerts\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.070820 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.070603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.070820 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.070631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-token\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.070820 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.070666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7c4d\" (UniqueName: \"kubernetes.io/projected/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-kube-api-access-j7c4d\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.070820 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.070699    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.070820 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.070785    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.071564 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.071509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.073918 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.073858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-local-certs\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.074186 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.074159    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.074568 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.074525    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.074966 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.074944    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-cacerts\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.085241 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.085208    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-token\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.085656 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.085633    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7c4d\" (UniqueName: \"kubernetes.io/projected/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-kube-api-access-j7c4d\") pod \"istiod-openshift-gateway-7574459656-md4c4\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.210289 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.210197    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:00.422179 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.422146    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"]
Jul 20 22:28:00.425000 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:28:00.424966    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e1c37a_e1ab_45e0_bb28_21d41b948f6b.slice/crio-5d6c8e4b422847cfd0e9b8bb452989228f3aca9d7c0984a9a2f23b0f26e977e0 WatchSource:0}: Error finding container 5d6c8e4b422847cfd0e9b8bb452989228f3aca9d7c0984a9a2f23b0f26e977e0: Status 404 returned error can't find the container with id 5d6c8e4b422847cfd0e9b8bb452989228f3aca9d7c0984a9a2f23b0f26e977e0
Jul 20 22:28:00.465142 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:28:00.465063    2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: failed to sync secret cache: timed out waiting for the condition
Jul 20 22:28:00.465314 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:28:00.465157    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a70b5f3a-7c00-41f2-8dab-3ec7c0f36879-tls-certs podName:a70b5f3a-7c00-41f2-8dab-3ec7c0f36879 nodeName:}" failed. No retries permitted until 2026-07-20 22:28:00.965132559 +0000 UTC m=+311.080517162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a70b5f3a-7c00-41f2-8dab-3ec7c0f36879-tls-certs") pod "model-serving-api-54d89bd5fc-5rf4f" (UID: "a70b5f3a-7c00-41f2-8dab-3ec7c0f36879") : failed to sync secret cache: timed out waiting for the condition
Jul 20 22:28:00.568432 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.568392    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 20 22:28:00.887264 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.887075    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hmvpl\""
Jul 20 22:28:00.949368 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.949327    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4" event={"ID":"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b","Type":"ContainerStarted","Data":"5d6c8e4b422847cfd0e9b8bb452989228f3aca9d7c0984a9a2f23b0f26e977e0"}
Jul 20 22:28:00.951901 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.951863    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f" event={"ID":"662561cb-4db4-4a66-b4b3-86597bc326b8","Type":"ContainerStarted","Data":"7c98eac26083999bf6b81eca95a6d6b7fc11566004471b401b63f79d01ebe101"}
Jul 20 22:28:00.975971 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.974961    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5957d7d59-g2p4f" podStartSLOduration=1.6171493300000002 podStartE2EDuration="3.974935324s" totalImagesPullingTime="2.357785994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:28:00.972611752 +0000 UTC m=+311.087996382" watchObservedRunningTime="2026-07-20 22:28:00.974935324 +0000 UTC m=+311.090319953"
Jul 20 22:28:00.980404 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.979856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a70b5f3a-7c00-41f2-8dab-3ec7c0f36879-tls-certs\") pod \"model-serving-api-54d89bd5fc-5rf4f\" (UID: \"a70b5f3a-7c00-41f2-8dab-3ec7c0f36879\") " pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f"
Jul 20 22:28:00.992344 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:00.989945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a70b5f3a-7c00-41f2-8dab-3ec7c0f36879-tls-certs\") pod \"model-serving-api-54d89bd5fc-5rf4f\" (UID: \"a70b5f3a-7c00-41f2-8dab-3ec7c0f36879\") " pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f"
Jul 20 22:28:01.127592 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:01.127547    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f"
Jul 20 22:28:01.305367 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:01.305327    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5rf4f"]
Jul 20 22:28:01.309604 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:28:01.309570    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70b5f3a_7c00_41f2_8dab_3ec7c0f36879.slice/crio-7ad17284dad235f1ea2529e024e7404af82463fc3e239cc021b0bb41c17b88fe WatchSource:0}: Error finding container 7ad17284dad235f1ea2529e024e7404af82463fc3e239cc021b0bb41c17b88fe: Status 404 returned error can't find the container with id 7ad17284dad235f1ea2529e024e7404af82463fc3e239cc021b0bb41c17b88fe
Jul 20 22:28:01.960435 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:01.960344    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f" event={"ID":"a70b5f3a-7c00-41f2-8dab-3ec7c0f36879","Type":"ContainerStarted","Data":"7ad17284dad235f1ea2529e024e7404af82463fc3e239cc021b0bb41c17b88fe"}
Jul 20 22:28:04.444543 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:04.444500    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 22:28:04.444802 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:04.444576    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 22:28:04.979711 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:04.979669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4" event={"ID":"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b","Type":"ContainerStarted","Data":"e7c8b4869e574a908e5c745fe3521d547fa8a389515ea2fd8747ac47218b62c8"}
Jul 20 22:28:04.979911 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:04.979775    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:04.981349 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:04.981323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf" event={"ID":"f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0","Type":"ContainerStarted","Data":"f5115ebf9b9fe1733553a95599fcf2e56e68d0b3e9977e209e0a3e115faed359"}
Jul 20 22:28:04.981479 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:04.981372    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf"
Jul 20 22:28:04.982778 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:04.982756    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f" event={"ID":"a70b5f3a-7c00-41f2-8dab-3ec7c0f36879","Type":"ContainerStarted","Data":"20378cefba6098e782c0fdf38c471bbb9addaf3c747791aa69e661afa394b1e5"}
Jul 20 22:28:04.982911 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:04.982891    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f"
Jul 20 22:28:05.050710 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:05.050641    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f" podStartSLOduration=2.879686777 podStartE2EDuration="6.050618777s" totalImagesPullingTime="3.170932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:28:05.049700889 +0000 UTC m=+315.165085560" watchObservedRunningTime="2026-07-20 22:28:05.050618777 +0000 UTC m=+315.166003405"
Jul 20 22:28:05.051955 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:05.051903    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4" podStartSLOduration=2.035285327 podStartE2EDuration="6.051891351s" totalImagesPullingTime="4.016606024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:28:05.01898819 +0000 UTC m=+315.134372817" watchObservedRunningTime="2026-07-20 22:28:05.051891351 +0000 UTC m=+315.167275978"
Jul 20 22:28:05.080754 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:05.080692    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf" podStartSLOduration=3.102481037 podStartE2EDuration="8.080669665s" totalImagesPullingTime="4.978188628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:28:05.079927187 +0000 UTC m=+315.195311832" watchObservedRunningTime="2026-07-20 22:28:05.080669665 +0000 UTC m=+315.196054291"
Jul 20 22:28:05.989570 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:05.989540    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-md4c4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 22:28:05.989950 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:05.989589    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4" podUID="e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 22:28:07.026890 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.026853    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"]
Jul 20 22:28:07.030621 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.030601    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.048585 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.048549    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"]
Jul 20 22:28:07.153643 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.153597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f11ba961-c943-44d3-b272-793934fbd890-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.153643 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.153643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f11ba961-c943-44d3-b272-793934fbd890-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.153860 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.153662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmw5t\" (UniqueName: \"kubernetes.io/projected/f11ba961-c943-44d3-b272-793934fbd890-kube-api-access-kmw5t\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.153860 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.153785    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f11ba961-c943-44d3-b272-793934fbd890-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.153860 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.153822    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f11ba961-c943-44d3-b272-793934fbd890-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.153860 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.153846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f11ba961-c943-44d3-b272-793934fbd890-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.153981 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.153905    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f11ba961-c943-44d3-b272-793934fbd890-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.254919 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.254873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f11ba961-c943-44d3-b272-793934fbd890-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.255100 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.254939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f11ba961-c943-44d3-b272-793934fbd890-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.255100 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.254978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f11ba961-c943-44d3-b272-793934fbd890-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.255100 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.255009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f11ba961-c943-44d3-b272-793934fbd890-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.255100 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.255030    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmw5t\" (UniqueName: \"kubernetes.io/projected/f11ba961-c943-44d3-b272-793934fbd890-kube-api-access-kmw5t\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.255100 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.255098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f11ba961-c943-44d3-b272-793934fbd890-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.255484 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.255131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f11ba961-c943-44d3-b272-793934fbd890-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.255857 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.255832    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f11ba961-c943-44d3-b272-793934fbd890-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.257472 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.257442    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f11ba961-c943-44d3-b272-793934fbd890-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.257565 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.257476    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f11ba961-c943-44d3-b272-793934fbd890-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.257695 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.257676    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f11ba961-c943-44d3-b272-793934fbd890-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.257729 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.257715    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f11ba961-c943-44d3-b272-793934fbd890-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.269184 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.269151    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f11ba961-c943-44d3-b272-793934fbd890-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.289663 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.289583    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmw5t\" (UniqueName: \"kubernetes.io/projected/f11ba961-c943-44d3-b272-793934fbd890-kube-api-access-kmw5t\") pod \"istiod-openshift-gateway-94bb8fbfd-kmrcw\" (UID: \"f11ba961-c943-44d3-b272-793934fbd890\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.341084 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.341049    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:07.509047 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.508999    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"]
Jul 20 22:28:07.515886 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:28:07.515849    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf11ba961_c943_44d3_b272_793934fbd890.slice/crio-c5c89fd75d696625607530088eb9c683f25a004e337b27fc0e1b3f9c2b41eba5 WatchSource:0}: Error finding container c5c89fd75d696625607530088eb9c683f25a004e337b27fc0e1b3f9c2b41eba5: Status 404 returned error can't find the container with id c5c89fd75d696625607530088eb9c683f25a004e337b27fc0e1b3f9c2b41eba5
Jul 20 22:28:07.518917 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.518887    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 22:28:07.518983 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:07.518952    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 22:28:08.000569 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:08.000526    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw" event={"ID":"f11ba961-c943-44d3-b272-793934fbd890","Type":"ContainerStarted","Data":"9be8560b3c2f57401eea2aae462bd73b8dd42a339af5272cfd591330af843251"}
Jul 20 22:28:08.000788 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:08.000593    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw" event={"ID":"f11ba961-c943-44d3-b272-793934fbd890","Type":"ContainerStarted","Data":"c5c89fd75d696625607530088eb9c683f25a004e337b27fc0e1b3f9c2b41eba5"}
Jul 20 22:28:08.000854 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:08.000825    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:08.002784 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:08.002745    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-kmrcw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 20 22:28:08.002949 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:08.002813    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw" podUID="f11ba961-c943-44d3-b272-793934fbd890" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 22:28:08.039004 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:08.038943    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw" podStartSLOduration=1.038922471 podStartE2EDuration="1.038922471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:28:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:28:08.036166321 +0000 UTC m=+318.151550958" watchObservedRunningTime="2026-07-20 22:28:08.038922471 +0000 UTC m=+318.154307098"
Jul 20 22:28:08.989119 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:08.989080    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:09.005786 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.005756    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kmrcw"
Jul 20 22:28:09.109453 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.109420    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"]
Jul 20 22:28:09.109849 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.109595    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4" podUID="e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" containerName="discovery" containerID="cri-o://e7c8b4869e574a908e5c745fe3521d547fa8a389515ea2fd8747ac47218b62c8" gracePeriod=30
Jul 20 22:28:09.368264 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.368231    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:09.478981 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.478945    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-local-certs\") pod \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") "
Jul 20 22:28:09.478981 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.478996    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-csr-ca-configmap\") pod \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") "
Jul 20 22:28:09.479218 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.479026    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-kubeconfig\") pod \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") "
Jul 20 22:28:09.479218 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.479049    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-cacerts\") pod \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") "
Jul 20 22:28:09.479218 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.479124    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7c4d\" (UniqueName: \"kubernetes.io/projected/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-kube-api-access-j7c4d\") pod \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") "
Jul 20 22:28:09.479422 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.479252    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-csr-dns-cert\") pod \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") "
Jul 20 22:28:09.479422 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.479375    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-token\") pod \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\" (UID: \"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b\") "
Jul 20 22:28:09.479912 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.479856    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" (UID: "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:28:09.481649 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.481617    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" (UID: "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:28:09.481649 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.481641    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-cacerts" (OuterVolumeSpecName: "cacerts") pod "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" (UID: "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:28:09.481786 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.481709    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-kube-api-access-j7c4d" (OuterVolumeSpecName: "kube-api-access-j7c4d") pod "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" (UID: "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b"). InnerVolumeSpecName "kube-api-access-j7c4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:28:09.481786 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.481747    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-local-certs" (OuterVolumeSpecName: "local-certs") pod "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" (UID: "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:28:09.482000 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.481980    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" (UID: "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:28:09.482046 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.481995    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-token" (OuterVolumeSpecName: "istio-token") pod "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" (UID: "e9e1c37a-e1ab-45e0-bb28-21d41b948f6b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:28:09.580613 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.580421    2579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-local-certs\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:28:09.580613 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.580460    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-csr-ca-configmap\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:28:09.580613 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.580475    2579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-kubeconfig\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:28:09.580613 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.580485    2579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-cacerts\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:28:09.580613 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.580495    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7c4d\" (UniqueName: \"kubernetes.io/projected/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-kube-api-access-j7c4d\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:28:09.580613 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.580504    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-csr-dns-cert\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:28:09.580613 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:09.580512    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b-istio-token\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:28:10.010887 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.010847    2579 generic.go:356] "Generic (PLEG): container finished" podID="e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" containerID="e7c8b4869e574a908e5c745fe3521d547fa8a389515ea2fd8747ac47218b62c8" exitCode=0
Jul 20 22:28:10.011038 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.010896    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"
Jul 20 22:28:10.011038 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.010937    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4" event={"ID":"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b","Type":"ContainerDied","Data":"e7c8b4869e574a908e5c745fe3521d547fa8a389515ea2fd8747ac47218b62c8"}
Jul 20 22:28:10.011038 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.011016    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-md4c4" event={"ID":"e9e1c37a-e1ab-45e0-bb28-21d41b948f6b","Type":"ContainerDied","Data":"5d6c8e4b422847cfd0e9b8bb452989228f3aca9d7c0984a9a2f23b0f26e977e0"}
Jul 20 22:28:10.011038 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.011037    2579 scope.go:117] "RemoveContainer" containerID="e7c8b4869e574a908e5c745fe3521d547fa8a389515ea2fd8747ac47218b62c8"
Jul 20 22:28:10.019872 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.019850    2579 scope.go:117] "RemoveContainer" containerID="e7c8b4869e574a908e5c745fe3521d547fa8a389515ea2fd8747ac47218b62c8"
Jul 20 22:28:10.020162 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:28:10.020145    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7c8b4869e574a908e5c745fe3521d547fa8a389515ea2fd8747ac47218b62c8\": container with ID starting with e7c8b4869e574a908e5c745fe3521d547fa8a389515ea2fd8747ac47218b62c8 not found: ID does not exist" containerID="e7c8b4869e574a908e5c745fe3521d547fa8a389515ea2fd8747ac47218b62c8"
Jul 20 22:28:10.020229 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.020169    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7c8b4869e574a908e5c745fe3521d547fa8a389515ea2fd8747ac47218b62c8"} err="failed to get container status \"e7c8b4869e574a908e5c745fe3521d547fa8a389515ea2fd8747ac47218b62c8\": rpc error: code = NotFound desc = could not find container \"e7c8b4869e574a908e5c745fe3521d547fa8a389515ea2fd8747ac47218b62c8\": container with ID starting with e7c8b4869e574a908e5c745fe3521d547fa8a389515ea2fd8747ac47218b62c8 not found: ID does not exist"
Jul 20 22:28:10.077236 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.077193    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"]
Jul 20 22:28:10.086813 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.086784    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-md4c4"]
Jul 20 22:28:10.370660 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.370624    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" path="/var/lib/kubelet/pods/e9e1c37a-e1ab-45e0-bb28-21d41b948f6b/volumes"
Jul 20 22:28:10.810507 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.810423    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9"]
Jul 20 22:28:10.810786 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.810773    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" containerName="discovery"
Jul 20 22:28:10.810855 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.810787    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" containerName="discovery"
Jul 20 22:28:10.810855 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.810848    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9e1c37a-e1ab-45e0-bb28-21d41b948f6b" containerName="discovery"
Jul 20 22:28:10.817060 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.817037    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9"
Jul 20 22:28:10.831707 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.831678    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-f27rl\""
Jul 20 22:28:10.832012 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.831994    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 20 22:28:10.843390 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.843356    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9"]
Jul 20 22:28:10.891580 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.891541    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld9vw\" (UniqueName: \"kubernetes.io/projected/12660b54-505b-41be-8c58-8b5467f28ace-kube-api-access-ld9vw\") pod \"llmisvc-controller-manager-777c6bd7d5-fm2m9\" (UID: \"12660b54-505b-41be-8c58-8b5467f28ace\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9"
Jul 20 22:28:10.891757 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.891589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12660b54-505b-41be-8c58-8b5467f28ace-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fm2m9\" (UID: \"12660b54-505b-41be-8c58-8b5467f28ace\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9"
Jul 20 22:28:10.992050 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.992012    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld9vw\" (UniqueName: \"kubernetes.io/projected/12660b54-505b-41be-8c58-8b5467f28ace-kube-api-access-ld9vw\") pod \"llmisvc-controller-manager-777c6bd7d5-fm2m9\" (UID: \"12660b54-505b-41be-8c58-8b5467f28ace\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9"
Jul 20 22:28:10.992233 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.992061    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12660b54-505b-41be-8c58-8b5467f28ace-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fm2m9\" (UID: \"12660b54-505b-41be-8c58-8b5467f28ace\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9"
Jul 20 22:28:10.994650 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:10.994617    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12660b54-505b-41be-8c58-8b5467f28ace-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fm2m9\" (UID: \"12660b54-505b-41be-8c58-8b5467f28ace\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9"
Jul 20 22:28:11.044876 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:11.044839    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld9vw\" (UniqueName: \"kubernetes.io/projected/12660b54-505b-41be-8c58-8b5467f28ace-kube-api-access-ld9vw\") pod \"llmisvc-controller-manager-777c6bd7d5-fm2m9\" (UID: \"12660b54-505b-41be-8c58-8b5467f28ace\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9"
Jul 20 22:28:11.127043 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:11.127006    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9"
Jul 20 22:28:11.310502 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:11.310467    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9"]
Jul 20 22:28:11.313379 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:28:11.313348    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod12660b54_505b_41be_8c58_8b5467f28ace.slice/crio-4993a7fe3ac2e66b9c98e36b82c13b24f8a3860b07fb7349d6c3ebe8e71d92c3 WatchSource:0}: Error finding container 4993a7fe3ac2e66b9c98e36b82c13b24f8a3860b07fb7349d6c3ebe8e71d92c3: Status 404 returned error can't find the container with id 4993a7fe3ac2e66b9c98e36b82c13b24f8a3860b07fb7349d6c3ebe8e71d92c3
Jul 20 22:28:12.024656 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:12.024617    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9" event={"ID":"12660b54-505b-41be-8c58-8b5467f28ace","Type":"ContainerStarted","Data":"4993a7fe3ac2e66b9c98e36b82c13b24f8a3860b07fb7349d6c3ebe8e71d92c3"}
Jul 20 22:28:15.044909 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:15.044873    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9" event={"ID":"12660b54-505b-41be-8c58-8b5467f28ace","Type":"ContainerStarted","Data":"07c34453da8038919b1cda3f0ae0dae6e1e2c0e1057301427164d1bcaa1128bb"}
Jul 20 22:28:15.045332 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:15.045035    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9"
Jul 20 22:28:15.990126 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:15.990097    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xn9sf"
Jul 20 22:28:15.992499 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:15.992469    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5rf4f"
Jul 20 22:28:16.054510 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:16.054452    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9" podStartSLOduration=3.039597771 podStartE2EDuration="6.054434478s" totalImagesPullingTime="3.014836707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:28:15.079059883 +0000 UTC m=+325.194444509" watchObservedRunningTime="2026-07-20 22:28:16.054434478 +0000 UTC m=+326.169819104"
Jul 20 22:28:46.052737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:28:46.052662    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fm2m9"
Jul 20 22:29:32.526015 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.525977    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cff776d94-ssllk"]
Jul 20 22:29:32.529253 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.529236    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.536257 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.536226    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 22:29:32.536881 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.536857    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 22:29:32.537031 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.537014    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-s2db9\""
Jul 20 22:29:32.537091 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.537051    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 22:29:32.537148 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.537126    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 22:29:32.537204 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.537140    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 22:29:32.542605 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.542585    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 22:29:32.611029 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.610990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ec85c2c-5482-40dc-914d-65165f0e50df-console-serving-cert\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.611199 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.611039    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-5482-40dc-914d-65165f0e50df-console-config\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.611199 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.611056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-5482-40dc-914d-65165f0e50df-service-ca\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.611199 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.611139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-5482-40dc-914d-65165f0e50df-oauth-serving-cert\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.611199 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.611173    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-5482-40dc-914d-65165f0e50df-trusted-ca-bundle\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.611374 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.611207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ec85c2c-5482-40dc-914d-65165f0e50df-console-oauth-config\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.611374 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.611260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz6v9\" (UniqueName: \"kubernetes.io/projected/7ec85c2c-5482-40dc-914d-65165f0e50df-kube-api-access-cz6v9\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.665988 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.665945    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cff776d94-ssllk"]
Jul 20 22:29:32.711928 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.711892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-5482-40dc-914d-65165f0e50df-console-config\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.711928 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.711927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-5482-40dc-914d-65165f0e50df-service-ca\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.712140 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.711959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-5482-40dc-914d-65165f0e50df-oauth-serving-cert\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.712140 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.712057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-5482-40dc-914d-65165f0e50df-trusted-ca-bundle\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.712140 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.712106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ec85c2c-5482-40dc-914d-65165f0e50df-console-oauth-config\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.712254 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.712148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz6v9\" (UniqueName: \"kubernetes.io/projected/7ec85c2c-5482-40dc-914d-65165f0e50df-kube-api-access-cz6v9\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.712254 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.712219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ec85c2c-5482-40dc-914d-65165f0e50df-console-serving-cert\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.712822 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.712790    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-5482-40dc-914d-65165f0e50df-service-ca\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.712947 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.712790    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-5482-40dc-914d-65165f0e50df-oauth-serving-cert\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.712947 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.712933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-5482-40dc-914d-65165f0e50df-console-config\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.713228 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.713208    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7ec85c2c-5482-40dc-914d-65165f0e50df-trusted-ca-bundle\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.714622 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.714591    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7ec85c2c-5482-40dc-914d-65165f0e50df-console-serving-cert\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.714745 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.714684    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7ec85c2c-5482-40dc-914d-65165f0e50df-console-oauth-config\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.757768 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.757738    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz6v9\" (UniqueName: \"kubernetes.io/projected/7ec85c2c-5482-40dc-914d-65165f0e50df-kube-api-access-cz6v9\") pod \"console-6cff776d94-ssllk\" (UID: \"7ec85c2c-5482-40dc-914d-65165f0e50df\") " pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:32.839765 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:32.839672    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:33.022918 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:33.022883    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cff776d94-ssllk"]
Jul 20 22:29:33.026788 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:29:33.026757    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ec85c2c_5482_40dc_914d_65165f0e50df.slice/crio-f9a8ccecd4cc465a3043e70d749550da2216f393427f8fd0b941a7e74b240dfa WatchSource:0}: Error finding container f9a8ccecd4cc465a3043e70d749550da2216f393427f8fd0b941a7e74b240dfa: Status 404 returned error can't find the container with id f9a8ccecd4cc465a3043e70d749550da2216f393427f8fd0b941a7e74b240dfa
Jul 20 22:29:33.401073 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:33.401036    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cff776d94-ssllk" event={"ID":"7ec85c2c-5482-40dc-914d-65165f0e50df","Type":"ContainerStarted","Data":"bc1c2095184f4975dac0610f1a70280743269309766b0b731ecacca6ed3c2ac4"}
Jul 20 22:29:33.401251 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:33.401089    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cff776d94-ssllk" event={"ID":"7ec85c2c-5482-40dc-914d-65165f0e50df","Type":"ContainerStarted","Data":"f9a8ccecd4cc465a3043e70d749550da2216f393427f8fd0b941a7e74b240dfa"}
Jul 20 22:29:33.536968 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:33.536907    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cff776d94-ssllk" podStartSLOduration=1.53688793 podStartE2EDuration="1.53688793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:29:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:29:33.535362703 +0000 UTC m=+403.650754454" watchObservedRunningTime="2026-07-20 22:29:33.53688793 +0000 UTC m=+403.652272555"
Jul 20 22:29:34.478464 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:34.478434    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"]
Jul 20 22:29:34.481798 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:34.481781    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:29:34.489415 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:34.489395    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 22:29:34.489983 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:34.489965    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 22:29:34.490076 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:34.489967    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-8jr6c\""
Jul 20 22:29:34.531230 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:34.531194    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxzxh\" (UniqueName: \"kubernetes.io/projected/02a034df-a96c-4ae2-a6e0-949ccb966a54-kube-api-access-xxzxh\") pod \"limitador-operator-controller-manager-859d7b78bd-vptmm\" (UID: \"02a034df-a96c-4ae2-a6e0-949ccb966a54\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:29:34.631673 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:34.631631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxzxh\" (UniqueName: \"kubernetes.io/projected/02a034df-a96c-4ae2-a6e0-949ccb966a54-kube-api-access-xxzxh\") pod \"limitador-operator-controller-manager-859d7b78bd-vptmm\" (UID: \"02a034df-a96c-4ae2-a6e0-949ccb966a54\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:29:34.644118 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:34.644079    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxzxh\" (UniqueName: \"kubernetes.io/projected/02a034df-a96c-4ae2-a6e0-949ccb966a54-kube-api-access-xxzxh\") pod \"limitador-operator-controller-manager-859d7b78bd-vptmm\" (UID: \"02a034df-a96c-4ae2-a6e0-949ccb966a54\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:29:34.652945 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:34.652916    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"]
Jul 20 22:29:34.792483 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:34.792396    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:29:34.971087 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:34.971062    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"]
Jul 20 22:29:34.973164 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:29:34.973138    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a034df_a96c_4ae2_a6e0_949ccb966a54.slice/crio-50b2f52f7f289454576e5c9981634ba16166872818f275015458e6cff2a2ab55 WatchSource:0}: Error finding container 50b2f52f7f289454576e5c9981634ba16166872818f275015458e6cff2a2ab55: Status 404 returned error can't find the container with id 50b2f52f7f289454576e5c9981634ba16166872818f275015458e6cff2a2ab55
Jul 20 22:29:35.413167 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:35.413130    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm" event={"ID":"02a034df-a96c-4ae2-a6e0-949ccb966a54","Type":"ContainerStarted","Data":"50b2f52f7f289454576e5c9981634ba16166872818f275015458e6cff2a2ab55"}
Jul 20 22:29:37.425850 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:37.425814    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm" event={"ID":"02a034df-a96c-4ae2-a6e0-949ccb966a54","Type":"ContainerStarted","Data":"f3a26ea70212f3bde6f97eb8d60bea9b27db69d8dea7e84d426cfcadff7171f6"}
Jul 20 22:29:37.426242 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:37.425928    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:29:37.470965 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:37.470908    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm" podStartSLOduration=1.654882804 podStartE2EDuration="3.470888596s" totalImagesPullingTime="1.816005792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:29:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:29:37.459608566 +0000 UTC m=+407.574993193" watchObservedRunningTime="2026-07-20 22:29:37.470888596 +0000 UTC m=+407.586273223"
Jul 20 22:29:39.553069 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:39.553031    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"]
Jul 20 22:29:39.556544 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:39.556521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:39.559859 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:39.559835    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rmxj9\""
Jul 20 22:29:39.589189 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:39.589156    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"]
Jul 20 22:29:39.678232 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:39.678188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsfrv\" (UniqueName: \"kubernetes.io/projected/9e427476-135a-4cc5-9a3c-8c2cec07b901-kube-api-access-gsfrv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\" (UID: \"9e427476-135a-4cc5-9a3c-8c2cec07b901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:39.678449 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:39.678339    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e427476-135a-4cc5-9a3c-8c2cec07b901-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\" (UID: \"9e427476-135a-4cc5-9a3c-8c2cec07b901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:39.779016 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:39.778973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e427476-135a-4cc5-9a3c-8c2cec07b901-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\" (UID: \"9e427476-135a-4cc5-9a3c-8c2cec07b901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:39.779208 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:39.779061    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsfrv\" (UniqueName: \"kubernetes.io/projected/9e427476-135a-4cc5-9a3c-8c2cec07b901-kube-api-access-gsfrv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\" (UID: \"9e427476-135a-4cc5-9a3c-8c2cec07b901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:39.779418 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:39.779396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e427476-135a-4cc5-9a3c-8c2cec07b901-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\" (UID: \"9e427476-135a-4cc5-9a3c-8c2cec07b901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:39.801719 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:39.801689    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsfrv\" (UniqueName: \"kubernetes.io/projected/9e427476-135a-4cc5-9a3c-8c2cec07b901-kube-api-access-gsfrv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\" (UID: \"9e427476-135a-4cc5-9a3c-8c2cec07b901\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:39.866742 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:39.866708    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:40.071178 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:40.071141    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"]
Jul 20 22:29:40.090889 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:29:40.090852    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e427476_135a_4cc5_9a3c_8c2cec07b901.slice/crio-7999600ec2e217b5438274e2b4cde8b0cd87f1ef2c5785bff7e02a2adb424380 WatchSource:0}: Error finding container 7999600ec2e217b5438274e2b4cde8b0cd87f1ef2c5785bff7e02a2adb424380: Status 404 returned error can't find the container with id 7999600ec2e217b5438274e2b4cde8b0cd87f1ef2c5785bff7e02a2adb424380
Jul 20 22:29:40.440922 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:40.440887    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g" event={"ID":"9e427476-135a-4cc5-9a3c-8c2cec07b901","Type":"ContainerStarted","Data":"7999600ec2e217b5438274e2b4cde8b0cd87f1ef2c5785bff7e02a2adb424380"}
Jul 20 22:29:42.840877 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:42.840831    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:42.841281 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:42.840912    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:42.845588 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:42.845557    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:43.460623 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:43.460594    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cff776d94-ssllk"
Jul 20 22:29:46.474540 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:46.474506    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g" event={"ID":"9e427476-135a-4cc5-9a3c-8c2cec07b901","Type":"ContainerStarted","Data":"e4cf8e0b7686931f9ceb1c8713720a641847debbbcc531e5eab4258d4c0e1b00"}
Jul 20 22:29:46.474908 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:46.474583    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:46.526066 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:46.526006    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g" podStartSLOduration=2.07310466 podStartE2EDuration="7.525990328s" totalImagesPullingTime="5.452885668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:29:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:29:46.525407582 +0000 UTC m=+416.640792226" watchObservedRunningTime="2026-07-20 22:29:46.525990328 +0000 UTC m=+416.641374953"
Jul 20 22:29:48.432637 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:48.432610    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:29:57.481408 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:57.481374    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:59.391259 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.391205    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"]
Jul 20 22:29:59.391734 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.391462    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g" podUID="9e427476-135a-4cc5-9a3c-8c2cec07b901" containerName="manager" containerID="cri-o://e4cf8e0b7686931f9ceb1c8713720a641847debbbcc531e5eab4258d4c0e1b00" gracePeriod=2
Jul 20 22:29:59.402915 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.402881    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"]
Jul 20 22:29:59.411643 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:29:59.411599    2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9e427476-135a-4cc5-9a3c-8c2cec07b901\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\": pods \"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:59.419933 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.419900    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"]
Jul 20 22:29:59.420192 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.420165    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm" podUID="02a034df-a96c-4ae2-a6e0-949ccb966a54" containerName="manager" containerID="cri-o://f3a26ea70212f3bde6f97eb8d60bea9b27db69d8dea7e84d426cfcadff7171f6" gracePeriod=2
Jul 20 22:29:59.422785 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:29:59.422756    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="9e427476-135a-4cc5-9a3c-8c2cec07b901" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:59.429395 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.429364    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"]
Jul 20 22:29:59.429915 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.429900    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e427476-135a-4cc5-9a3c-8c2cec07b901" containerName="manager"
Jul 20 22:29:59.429971 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.429918    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e427476-135a-4cc5-9a3c-8c2cec07b901" containerName="manager"
Jul 20 22:29:59.430046 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.430035    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e427476-135a-4cc5-9a3c-8c2cec07b901" containerName="manager"
Jul 20 22:29:59.433349 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.433327    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"
Jul 20 22:29:59.438465 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.438428    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"]
Jul 20 22:29:59.453552 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:29:59.453503    2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"02a034df-a96c-4ae2-a6e0-949ccb966a54\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-vptmm\": pods \"limitador-operator-controller-manager-859d7b78bd-vptmm\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:29:59.455570 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:29:59.455537    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vptmm\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="02a034df-a96c-4ae2-a6e0-949ccb966a54" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:29:59.456962 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.456935    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjrhj"]
Jul 20 22:29:59.457492 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.457470    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02a034df-a96c-4ae2-a6e0-949ccb966a54" containerName="manager"
Jul 20 22:29:59.457583 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.457495    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="02a034df-a96c-4ae2-a6e0-949ccb966a54" containerName="manager"
Jul 20 22:29:59.457633 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.457621    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="02a034df-a96c-4ae2-a6e0-949ccb966a54" containerName="manager"
Jul 20 22:29:59.458797 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:29:59.458766    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="9e427476-135a-4cc5-9a3c-8c2cec07b901" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:59.461522 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.461502    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"]
Jul 20 22:29:59.461618 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.461592    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjrhj"
Jul 20 22:29:59.489733 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.489702    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjrhj"]
Jul 20 22:29:59.500574 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:29:59.500535    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="9e427476-135a-4cc5-9a3c-8c2cec07b901" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:59.504547 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:29:59.504520    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vptmm\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="02a034df-a96c-4ae2-a6e0-949ccb966a54" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:29:59.535396 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.535361    2579 generic.go:356] "Generic (PLEG): container finished" podID="02a034df-a96c-4ae2-a6e0-949ccb966a54" containerID="f3a26ea70212f3bde6f97eb8d60bea9b27db69d8dea7e84d426cfcadff7171f6" exitCode=0
Jul 20 22:29:59.537346 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.537323    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e427476-135a-4cc5-9a3c-8c2cec07b901" containerID="e4cf8e0b7686931f9ceb1c8713720a641847debbbcc531e5eab4258d4c0e1b00" exitCode=0
Jul 20 22:29:59.564089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.564050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq4j4\" (UniqueName: \"kubernetes.io/projected/56878563-9b56-44bd-85fc-8881aefe0f3e-kube-api-access-lq4j4\") pod \"limitador-operator-controller-manager-859d7b78bd-pjrhj\" (UID: \"56878563-9b56-44bd-85fc-8881aefe0f3e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjrhj"
Jul 20 22:29:59.564331 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.564110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tfqs\" (UniqueName: \"kubernetes.io/projected/2a7661a6-7167-4ae9-b1b1-540b6d3f6d39-kube-api-access-2tfqs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t5l4z\" (UID: \"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"
Jul 20 22:29:59.564331 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.564235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a7661a6-7167-4ae9-b1b1-540b6d3f6d39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t5l4z\" (UID: \"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"
Jul 20 22:29:59.665079 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.665053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq4j4\" (UniqueName: \"kubernetes.io/projected/56878563-9b56-44bd-85fc-8881aefe0f3e-kube-api-access-lq4j4\") pod \"limitador-operator-controller-manager-859d7b78bd-pjrhj\" (UID: \"56878563-9b56-44bd-85fc-8881aefe0f3e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjrhj"
Jul 20 22:29:59.665168 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.665105    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tfqs\" (UniqueName: \"kubernetes.io/projected/2a7661a6-7167-4ae9-b1b1-540b6d3f6d39-kube-api-access-2tfqs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t5l4z\" (UID: \"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"
Jul 20 22:29:59.665217 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.665176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a7661a6-7167-4ae9-b1b1-540b6d3f6d39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t5l4z\" (UID: \"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"
Jul 20 22:29:59.665642 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.665616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a7661a6-7167-4ae9-b1b1-540b6d3f6d39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t5l4z\" (UID: \"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"
Jul 20 22:29:59.670361 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.670340    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:59.673160 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.673140    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:29:59.673378 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:29:59.673357    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="9e427476-135a-4cc5-9a3c-8c2cec07b901" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:59.675606 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:29:59.675580    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vptmm\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="02a034df-a96c-4ae2-a6e0-949ccb966a54" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:29:59.675718 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.675700    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tfqs\" (UniqueName: \"kubernetes.io/projected/2a7661a6-7167-4ae9-b1b1-540b6d3f6d39-kube-api-access-2tfqs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-t5l4z\" (UID: \"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"
Jul 20 22:29:59.679004 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:29:59.678977    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="9e427476-135a-4cc5-9a3c-8c2cec07b901" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:29:59.680775 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.680753    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq4j4\" (UniqueName: \"kubernetes.io/projected/56878563-9b56-44bd-85fc-8881aefe0f3e-kube-api-access-lq4j4\") pod \"limitador-operator-controller-manager-859d7b78bd-pjrhj\" (UID: \"56878563-9b56-44bd-85fc-8881aefe0f3e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjrhj"
Jul 20 22:29:59.681042 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:29:59.681021    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vptmm\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="02a034df-a96c-4ae2-a6e0-949ccb966a54" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:29:59.766380 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.766345    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsfrv\" (UniqueName: \"kubernetes.io/projected/9e427476-135a-4cc5-9a3c-8c2cec07b901-kube-api-access-gsfrv\") pod \"9e427476-135a-4cc5-9a3c-8c2cec07b901\" (UID: \"9e427476-135a-4cc5-9a3c-8c2cec07b901\") "
Jul 20 22:29:59.766380 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.766386    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxzxh\" (UniqueName: \"kubernetes.io/projected/02a034df-a96c-4ae2-a6e0-949ccb966a54-kube-api-access-xxzxh\") pod \"02a034df-a96c-4ae2-a6e0-949ccb966a54\" (UID: \"02a034df-a96c-4ae2-a6e0-949ccb966a54\") "
Jul 20 22:29:59.766583 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.766474    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e427476-135a-4cc5-9a3c-8c2cec07b901-extensions-socket-volume\") pod \"9e427476-135a-4cc5-9a3c-8c2cec07b901\" (UID: \"9e427476-135a-4cc5-9a3c-8c2cec07b901\") "
Jul 20 22:29:59.766896 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.766873    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e427476-135a-4cc5-9a3c-8c2cec07b901-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9e427476-135a-4cc5-9a3c-8c2cec07b901" (UID: "9e427476-135a-4cc5-9a3c-8c2cec07b901"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:29:59.768741 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.768711    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02a034df-a96c-4ae2-a6e0-949ccb966a54-kube-api-access-xxzxh" (OuterVolumeSpecName: "kube-api-access-xxzxh") pod "02a034df-a96c-4ae2-a6e0-949ccb966a54" (UID: "02a034df-a96c-4ae2-a6e0-949ccb966a54"). InnerVolumeSpecName "kube-api-access-xxzxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:29:59.768895 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.768739    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e427476-135a-4cc5-9a3c-8c2cec07b901-kube-api-access-gsfrv" (OuterVolumeSpecName: "kube-api-access-gsfrv") pod "9e427476-135a-4cc5-9a3c-8c2cec07b901" (UID: "9e427476-135a-4cc5-9a3c-8c2cec07b901"). InnerVolumeSpecName "kube-api-access-gsfrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:29:59.817156 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.817112    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"
Jul 20 22:29:59.822456 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.822426    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjrhj"
Jul 20 22:29:59.867879 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.867843    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e427476-135a-4cc5-9a3c-8c2cec07b901-extensions-socket-volume\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:29:59.867879 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.867876    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsfrv\" (UniqueName: \"kubernetes.io/projected/9e427476-135a-4cc5-9a3c-8c2cec07b901-kube-api-access-gsfrv\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:29:59.867879 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.867887    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxzxh\" (UniqueName: \"kubernetes.io/projected/02a034df-a96c-4ae2-a6e0-949ccb966a54-kube-api-access-xxzxh\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:29:59.971342 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.971295    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"]
Jul 20 22:29:59.974060 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:29:59.974029    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a7661a6_7167_4ae9_b1b1_540b6d3f6d39.slice/crio-c799597ee907cf43c95ba0e55b26db560129a853a74f0fda8a410d57ee52deb7 WatchSource:0}: Error finding container c799597ee907cf43c95ba0e55b26db560129a853a74f0fda8a410d57ee52deb7: Status 404 returned error can't find the container with id c799597ee907cf43c95ba0e55b26db560129a853a74f0fda8a410d57ee52deb7
Jul 20 22:29:59.991977 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:29:59.991944    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjrhj"]
Jul 20 22:29:59.994378 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:29:59.994352    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56878563_9b56_44bd_85fc_8881aefe0f3e.slice/crio-32b5a358678a839e034a7bd0a0148214219642701ad0d6acea909991c63835de WatchSource:0}: Error finding container 32b5a358678a839e034a7bd0a0148214219642701ad0d6acea909991c63835de: Status 404 returned error can't find the container with id 32b5a358678a839e034a7bd0a0148214219642701ad0d6acea909991c63835de
Jul 20 22:30:00.366909 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:30:00.366876    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-nvx9g\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="9e427476-135a-4cc5-9a3c-8c2cec07b901" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:30:00.368691 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:30:00.368658    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vptmm\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="02a034df-a96c-4ae2-a6e0-949ccb966a54" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:30:00.369050 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.369029    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02a034df-a96c-4ae2-a6e0-949ccb966a54" path="/var/lib/kubelet/pods/02a034df-a96c-4ae2-a6e0-949ccb966a54/volumes"
Jul 20 22:30:00.369406 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.369393    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e427476-135a-4cc5-9a3c-8c2cec07b901" path="/var/lib/kubelet/pods/9e427476-135a-4cc5-9a3c-8c2cec07b901/volumes"
Jul 20 22:30:00.543107 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.543075    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nvx9g"
Jul 20 22:30:00.543580 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.543088    2579 scope.go:117] "RemoveContainer" containerID="e4cf8e0b7686931f9ceb1c8713720a641847debbbcc531e5eab4258d4c0e1b00"
Jul 20 22:30:00.544694 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.544677    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vptmm"
Jul 20 22:30:00.546952 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.546907    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z" event={"ID":"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39","Type":"ContainerStarted","Data":"8f6ef3b69d56fdf6f9be0a9d328e77b240cb0e66de607fdd030449f52aa0aa66"}
Jul 20 22:30:00.547092 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.547074    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"
Jul 20 22:30:00.547379 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.547227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z" event={"ID":"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39","Type":"ContainerStarted","Data":"c799597ee907cf43c95ba0e55b26db560129a853a74f0fda8a410d57ee52deb7"}
Jul 20 22:30:00.552251 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.552227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjrhj" event={"ID":"56878563-9b56-44bd-85fc-8881aefe0f3e","Type":"ContainerStarted","Data":"937b0f2c1e44725c1cd14e2c86c0fde2c62dc5c69ab2d2e0556c9871a5825bb3"}
Jul 20 22:30:00.552397 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.552271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjrhj" event={"ID":"56878563-9b56-44bd-85fc-8881aefe0f3e","Type":"ContainerStarted","Data":"32b5a358678a839e034a7bd0a0148214219642701ad0d6acea909991c63835de"}
Jul 20 22:30:00.552397 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.552330    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjrhj"
Jul 20 22:30:00.555995 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.555979    2579 scope.go:117] "RemoveContainer" containerID="f3a26ea70212f3bde6f97eb8d60bea9b27db69d8dea7e84d426cfcadff7171f6"
Jul 20 22:30:00.570215 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.570163    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z" podStartSLOduration=1.570146781 podStartE2EDuration="1.570146781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:30:00.569504197 +0000 UTC m=+430.684888848" watchObservedRunningTime="2026-07-20 22:30:00.570146781 +0000 UTC m=+430.685531407"
Jul 20 22:30:00.589405 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:00.589348    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjrhj" podStartSLOduration=1.589329739 podStartE2EDuration="1.589329739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:30:00.587686688 +0000 UTC m=+430.703071334" watchObservedRunningTime="2026-07-20 22:30:00.589329739 +0000 UTC m=+430.704714364"
Jul 20 22:30:11.561119 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:11.561032    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"
Jul 20 22:30:11.561119 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:11.561106    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-pjrhj"
Jul 20 22:30:15.846496 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:15.846457    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"]
Jul 20 22:30:15.846888 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:15.846680    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z" podUID="2a7661a6-7167-4ae9-b1b1-540b6d3f6d39" containerName="manager" containerID="cri-o://8f6ef3b69d56fdf6f9be0a9d328e77b240cb0e66de607fdd030449f52aa0aa66" gracePeriod=10
Jul 20 22:30:16.093443 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.093411    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"
Jul 20 22:30:16.198462 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.198422    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a7661a6-7167-4ae9-b1b1-540b6d3f6d39-extensions-socket-volume\") pod \"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39\" (UID: \"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39\") "
Jul 20 22:30:16.198694 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.198484    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tfqs\" (UniqueName: \"kubernetes.io/projected/2a7661a6-7167-4ae9-b1b1-540b6d3f6d39-kube-api-access-2tfqs\") pod \"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39\" (UID: \"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39\") "
Jul 20 22:30:16.198835 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.198805    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a7661a6-7167-4ae9-b1b1-540b6d3f6d39-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2a7661a6-7167-4ae9-b1b1-540b6d3f6d39" (UID: "2a7661a6-7167-4ae9-b1b1-540b6d3f6d39"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 22:30:16.200602 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.200577    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a7661a6-7167-4ae9-b1b1-540b6d3f6d39-kube-api-access-2tfqs" (OuterVolumeSpecName: "kube-api-access-2tfqs") pod "2a7661a6-7167-4ae9-b1b1-540b6d3f6d39" (UID: "2a7661a6-7167-4ae9-b1b1-540b6d3f6d39"). InnerVolumeSpecName "kube-api-access-2tfqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:30:16.299907 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.299869    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tfqs\" (UniqueName: \"kubernetes.io/projected/2a7661a6-7167-4ae9-b1b1-540b6d3f6d39-kube-api-access-2tfqs\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:30:16.299907 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.299902    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a7661a6-7167-4ae9-b1b1-540b6d3f6d39-extensions-socket-volume\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:30:16.636211 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.636172    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a7661a6-7167-4ae9-b1b1-540b6d3f6d39" containerID="8f6ef3b69d56fdf6f9be0a9d328e77b240cb0e66de607fdd030449f52aa0aa66" exitCode=0
Jul 20 22:30:16.636401 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.636221    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"
Jul 20 22:30:16.636401 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.636252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z" event={"ID":"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39","Type":"ContainerDied","Data":"8f6ef3b69d56fdf6f9be0a9d328e77b240cb0e66de607fdd030449f52aa0aa66"}
Jul 20 22:30:16.636401 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.636317    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z" event={"ID":"2a7661a6-7167-4ae9-b1b1-540b6d3f6d39","Type":"ContainerDied","Data":"c799597ee907cf43c95ba0e55b26db560129a853a74f0fda8a410d57ee52deb7"}
Jul 20 22:30:16.636401 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.636337    2579 scope.go:117] "RemoveContainer" containerID="8f6ef3b69d56fdf6f9be0a9d328e77b240cb0e66de607fdd030449f52aa0aa66"
Jul 20 22:30:16.644714 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.644690    2579 scope.go:117] "RemoveContainer" containerID="8f6ef3b69d56fdf6f9be0a9d328e77b240cb0e66de607fdd030449f52aa0aa66"
Jul 20 22:30:16.644989 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:30:16.644970    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f6ef3b69d56fdf6f9be0a9d328e77b240cb0e66de607fdd030449f52aa0aa66\": container with ID starting with 8f6ef3b69d56fdf6f9be0a9d328e77b240cb0e66de607fdd030449f52aa0aa66 not found: ID does not exist" containerID="8f6ef3b69d56fdf6f9be0a9d328e77b240cb0e66de607fdd030449f52aa0aa66"
Jul 20 22:30:16.645080 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.644996    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f6ef3b69d56fdf6f9be0a9d328e77b240cb0e66de607fdd030449f52aa0aa66"} err="failed to get container status \"8f6ef3b69d56fdf6f9be0a9d328e77b240cb0e66de607fdd030449f52aa0aa66\": rpc error: code = NotFound desc = could not find container \"8f6ef3b69d56fdf6f9be0a9d328e77b240cb0e66de607fdd030449f52aa0aa66\": container with ID starting with 8f6ef3b69d56fdf6f9be0a9d328e77b240cb0e66de607fdd030449f52aa0aa66 not found: ID does not exist"
Jul 20 22:30:16.674019 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.673986    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"]
Jul 20 22:30:16.683343 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:16.683314    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-t5l4z"]
Jul 20 22:30:18.369083 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:18.369050    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a7661a6-7167-4ae9-b1b1-540b6d3f6d39" path="/var/lib/kubelet/pods/2a7661a6-7167-4ae9-b1b1-540b6d3f6d39/volumes"
Jul 20 22:30:35.303230 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.303194    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"]
Jul 20 22:30:35.303730 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.303600    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a7661a6-7167-4ae9-b1b1-540b6d3f6d39" containerName="manager"
Jul 20 22:30:35.303730 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.303612    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a7661a6-7167-4ae9-b1b1-540b6d3f6d39" containerName="manager"
Jul 20 22:30:35.303730 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.303692    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a7661a6-7167-4ae9-b1b1-540b6d3f6d39" containerName="manager"
Jul 20 22:30:35.306336 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.306291    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"
Jul 20 22:30:35.308895 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.308869    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f8w42\""
Jul 20 22:30:35.309332 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.309295    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 22:30:35.317917 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.317892    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"]
Jul 20 22:30:35.367177 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.367143    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/594ff54f-85c6-4794-bd0c-a4f34a6f2e2a-config-file\") pod \"limitador-limitador-64c94fd64f-lfmbv\" (UID: \"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"
Jul 20 22:30:35.367177 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.367182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbx74\" (UniqueName: \"kubernetes.io/projected/594ff54f-85c6-4794-bd0c-a4f34a6f2e2a-kube-api-access-bbx74\") pod \"limitador-limitador-64c94fd64f-lfmbv\" (UID: \"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"
Jul 20 22:30:35.415345 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.415311    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"]
Jul 20 22:30:35.467904 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.467867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/594ff54f-85c6-4794-bd0c-a4f34a6f2e2a-config-file\") pod \"limitador-limitador-64c94fd64f-lfmbv\" (UID: \"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"
Jul 20 22:30:35.468068 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.467917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbx74\" (UniqueName: \"kubernetes.io/projected/594ff54f-85c6-4794-bd0c-a4f34a6f2e2a-kube-api-access-bbx74\") pod \"limitador-limitador-64c94fd64f-lfmbv\" (UID: \"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"
Jul 20 22:30:35.468609 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.468588    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/594ff54f-85c6-4794-bd0c-a4f34a6f2e2a-config-file\") pod \"limitador-limitador-64c94fd64f-lfmbv\" (UID: \"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"
Jul 20 22:30:35.478478 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.478451    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbx74\" (UniqueName: \"kubernetes.io/projected/594ff54f-85c6-4794-bd0c-a4f34a6f2e2a-kube-api-access-bbx74\") pod \"limitador-limitador-64c94fd64f-lfmbv\" (UID: \"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"
Jul 20 22:30:35.617640 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.617608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"
Jul 20 22:30:35.770270 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.770197    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:30:35.773473 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.773454    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"]
Jul 20 22:30:35.773574 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.773557    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n25z2"
Jul 20 22:30:35.775940 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:30:35.775915    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594ff54f_85c6_4794_bd0c_a4f34a6f2e2a.slice/crio-5170f509a9ad9797c35dd9ab40652e841d3958cbcca124f67207942da965aee8 WatchSource:0}: Error finding container 5170f509a9ad9797c35dd9ab40652e841d3958cbcca124f67207942da965aee8: Status 404 returned error can't find the container with id 5170f509a9ad9797c35dd9ab40652e841d3958cbcca124f67207942da965aee8
Jul 20 22:30:35.798572 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.798544    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:30:35.871734 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.871639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st66f\" (UniqueName: \"kubernetes.io/projected/f1ebe177-fca6-4472-bc14-7320c1de9131-kube-api-access-st66f\") pod \"limitador-limitador-54d6d988d5-n25z2\" (UID: \"f1ebe177-fca6-4472-bc14-7320c1de9131\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n25z2"
Jul 20 22:30:35.871907 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.871736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1ebe177-fca6-4472-bc14-7320c1de9131-config-file\") pod \"limitador-limitador-54d6d988d5-n25z2\" (UID: \"f1ebe177-fca6-4472-bc14-7320c1de9131\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n25z2"
Jul 20 22:30:35.891626 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.891593    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:30:35.972456 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.972420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st66f\" (UniqueName: \"kubernetes.io/projected/f1ebe177-fca6-4472-bc14-7320c1de9131-kube-api-access-st66f\") pod \"limitador-limitador-54d6d988d5-n25z2\" (UID: \"f1ebe177-fca6-4472-bc14-7320c1de9131\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n25z2"
Jul 20 22:30:35.972634 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.972472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1ebe177-fca6-4472-bc14-7320c1de9131-config-file\") pod \"limitador-limitador-54d6d988d5-n25z2\" (UID: \"f1ebe177-fca6-4472-bc14-7320c1de9131\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n25z2"
Jul 20 22:30:35.973038 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.973019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f1ebe177-fca6-4472-bc14-7320c1de9131-config-file\") pod \"limitador-limitador-54d6d988d5-n25z2\" (UID: \"f1ebe177-fca6-4472-bc14-7320c1de9131\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n25z2"
Jul 20 22:30:35.989974 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:35.989949    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st66f\" (UniqueName: \"kubernetes.io/projected/f1ebe177-fca6-4472-bc14-7320c1de9131-kube-api-access-st66f\") pod \"limitador-limitador-54d6d988d5-n25z2\" (UID: \"f1ebe177-fca6-4472-bc14-7320c1de9131\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-n25z2"
Jul 20 22:30:36.091454 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:36.091424    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-n25z2"
Jul 20 22:30:36.225850 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:36.225823    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:30:36.227263 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:30:36.227237    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ebe177_fca6_4472_bc14_7320c1de9131.slice/crio-259f1268b9bfc2380de9e99c5634c56cafe78eda4eea21a54cd3fb244f2f78c2 WatchSource:0}: Error finding container 259f1268b9bfc2380de9e99c5634c56cafe78eda4eea21a54cd3fb244f2f78c2: Status 404 returned error can't find the container with id 259f1268b9bfc2380de9e99c5634c56cafe78eda4eea21a54cd3fb244f2f78c2
Jul 20 22:30:36.748538 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:36.748295    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n25z2" event={"ID":"f1ebe177-fca6-4472-bc14-7320c1de9131","Type":"ContainerStarted","Data":"259f1268b9bfc2380de9e99c5634c56cafe78eda4eea21a54cd3fb244f2f78c2"}
Jul 20 22:30:36.750848 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:36.750816    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv" event={"ID":"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a","Type":"ContainerStarted","Data":"5170f509a9ad9797c35dd9ab40652e841d3958cbcca124f67207942da965aee8"}
Jul 20 22:30:38.763749 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:38.763705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-n25z2" event={"ID":"f1ebe177-fca6-4472-bc14-7320c1de9131","Type":"ContainerStarted","Data":"f752526fb1d13527df09edd59b8ebf23979e093e68db042a1966712fc4c1d72d"}
Jul 20 22:30:38.764202 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:38.763857    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n25z2"
Jul 20 22:30:38.765200 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:38.765177    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv" event={"ID":"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a","Type":"ContainerStarted","Data":"13a1ed4c963eecbda4e410c91fecf224ed97fc59e80cfb3aba5a6b913e6e788f"}
Jul 20 22:30:38.765332 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:38.765312    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"
Jul 20 22:30:38.795038 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:38.794941    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-n25z2" podStartSLOduration=1.4853046220000001 podStartE2EDuration="3.794925236s" totalImagesPullingTime="2.309620614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:30:38.794577404 +0000 UTC m=+468.909962031" watchObservedRunningTime="2026-07-20 22:30:38.794925236 +0000 UTC m=+468.910309861"
Jul 20 22:30:38.814940 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:38.814877    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv" podStartSLOduration=1.04302913 podStartE2EDuration="3.81485679s" totalImagesPullingTime="2.77182766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:30:38.81381168 +0000 UTC m=+468.929196306" watchObservedRunningTime="2026-07-20 22:30:38.81485679 +0000 UTC m=+468.930241417"
Jul 20 22:30:49.772027 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:49.771988    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-n25z2"
Jul 20 22:30:49.772462 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:49.772056    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"
Jul 20 22:30:49.861480 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:49.861441    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"]
Jul 20 22:30:49.861664 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:49.861616    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv" podUID="594ff54f-85c6-4794-bd0c-a4f34a6f2e2a" containerName="limitador" containerID="cri-o://13a1ed4c963eecbda4e410c91fecf224ed97fc59e80cfb3aba5a6b913e6e788f" gracePeriod=30
Jul 20 22:30:50.809495 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:50.809470    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"
Jul 20 22:30:50.825616 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:50.825583    2579 generic.go:356] "Generic (PLEG): container finished" podID="594ff54f-85c6-4794-bd0c-a4f34a6f2e2a" containerID="13a1ed4c963eecbda4e410c91fecf224ed97fc59e80cfb3aba5a6b913e6e788f" exitCode=0
Jul 20 22:30:50.825783 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:50.825625    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"
Jul 20 22:30:50.825783 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:50.825661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv" event={"ID":"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a","Type":"ContainerDied","Data":"13a1ed4c963eecbda4e410c91fecf224ed97fc59e80cfb3aba5a6b913e6e788f"}
Jul 20 22:30:50.825783 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:50.825738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lfmbv" event={"ID":"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a","Type":"ContainerDied","Data":"5170f509a9ad9797c35dd9ab40652e841d3958cbcca124f67207942da965aee8"}
Jul 20 22:30:50.825890 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:50.825805    2579 scope.go:117] "RemoveContainer" containerID="13a1ed4c963eecbda4e410c91fecf224ed97fc59e80cfb3aba5a6b913e6e788f"
Jul 20 22:30:50.837985 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:50.837848    2579 scope.go:117] "RemoveContainer" containerID="13a1ed4c963eecbda4e410c91fecf224ed97fc59e80cfb3aba5a6b913e6e788f"
Jul 20 22:30:50.838606 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:30:50.838529    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13a1ed4c963eecbda4e410c91fecf224ed97fc59e80cfb3aba5a6b913e6e788f\": container with ID starting with 13a1ed4c963eecbda4e410c91fecf224ed97fc59e80cfb3aba5a6b913e6e788f not found: ID does not exist" containerID="13a1ed4c963eecbda4e410c91fecf224ed97fc59e80cfb3aba5a6b913e6e788f"
Jul 20 22:30:50.838606 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:50.838576    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13a1ed4c963eecbda4e410c91fecf224ed97fc59e80cfb3aba5a6b913e6e788f"} err="failed to get container status \"13a1ed4c963eecbda4e410c91fecf224ed97fc59e80cfb3aba5a6b913e6e788f\": rpc error: code = NotFound desc = could not find container \"13a1ed4c963eecbda4e410c91fecf224ed97fc59e80cfb3aba5a6b913e6e788f\": container with ID starting with 13a1ed4c963eecbda4e410c91fecf224ed97fc59e80cfb3aba5a6b913e6e788f not found: ID does not exist"
Jul 20 22:30:50.913586 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:50.913552    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbx74\" (UniqueName: \"kubernetes.io/projected/594ff54f-85c6-4794-bd0c-a4f34a6f2e2a-kube-api-access-bbx74\") pod \"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a\" (UID: \"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a\") "
Jul 20 22:30:50.913759 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:50.913654    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/594ff54f-85c6-4794-bd0c-a4f34a6f2e2a-config-file\") pod \"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a\" (UID: \"594ff54f-85c6-4794-bd0c-a4f34a6f2e2a\") "
Jul 20 22:30:50.914016 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:50.913993    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/594ff54f-85c6-4794-bd0c-a4f34a6f2e2a-config-file" (OuterVolumeSpecName: "config-file") pod "594ff54f-85c6-4794-bd0c-a4f34a6f2e2a" (UID: "594ff54f-85c6-4794-bd0c-a4f34a6f2e2a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:30:50.915674 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:50.915649    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/594ff54f-85c6-4794-bd0c-a4f34a6f2e2a-kube-api-access-bbx74" (OuterVolumeSpecName: "kube-api-access-bbx74") pod "594ff54f-85c6-4794-bd0c-a4f34a6f2e2a" (UID: "594ff54f-85c6-4794-bd0c-a4f34a6f2e2a"). InnerVolumeSpecName "kube-api-access-bbx74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:30:51.014548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:51.014463    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbx74\" (UniqueName: \"kubernetes.io/projected/594ff54f-85c6-4794-bd0c-a4f34a6f2e2a-kube-api-access-bbx74\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:30:51.014548 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:51.014493    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/594ff54f-85c6-4794-bd0c-a4f34a6f2e2a-config-file\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:30:51.165177 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:51.165146    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"]
Jul 20 22:30:51.166688 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:51.166658    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lfmbv"]
Jul 20 22:30:52.369235 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:30:52.369198    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="594ff54f-85c6-4794-bd0c-a4f34a6f2e2a" path="/var/lib/kubelet/pods/594ff54f-85c6-4794-bd0c-a4f34a6f2e2a/volumes"
Jul 20 22:31:14.954410 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:14.954374    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6945b87898-52t6q"]
Jul 20 22:31:14.955056 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:14.954758    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594ff54f-85c6-4794-bd0c-a4f34a6f2e2a" containerName="limitador"
Jul 20 22:31:14.955056 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:14.954768    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="594ff54f-85c6-4794-bd0c-a4f34a6f2e2a" containerName="limitador"
Jul 20 22:31:14.955056 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:14.954827    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="594ff54f-85c6-4794-bd0c-a4f34a6f2e2a" containerName="limitador"
Jul 20 22:31:14.957641 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:14.957624    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6945b87898-52t6q"
Jul 20 22:31:14.964729 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:14.964707    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 22:31:14.964847 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:14.964738    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vcxp2\""
Jul 20 22:31:14.964847 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:14.964747    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 22:31:14.985850 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:14.985812    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6945b87898-52t6q"]
Jul 20 22:31:15.017234 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:15.017197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7657c095-d528-4655-9483-0e178e3a5e1e-webhook-cert\") pod \"maas-controller-6945b87898-52t6q\" (UID: \"7657c095-d528-4655-9483-0e178e3a5e1e\") " pod="opendatahub/maas-controller-6945b87898-52t6q"
Jul 20 22:31:15.017520 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:15.017503    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxdsb\" (UniqueName: \"kubernetes.io/projected/7657c095-d528-4655-9483-0e178e3a5e1e-kube-api-access-nxdsb\") pod \"maas-controller-6945b87898-52t6q\" (UID: \"7657c095-d528-4655-9483-0e178e3a5e1e\") " pod="opendatahub/maas-controller-6945b87898-52t6q"
Jul 20 22:31:15.118102 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:15.118066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxdsb\" (UniqueName: \"kubernetes.io/projected/7657c095-d528-4655-9483-0e178e3a5e1e-kube-api-access-nxdsb\") pod \"maas-controller-6945b87898-52t6q\" (UID: \"7657c095-d528-4655-9483-0e178e3a5e1e\") " pod="opendatahub/maas-controller-6945b87898-52t6q"
Jul 20 22:31:15.118326 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:15.118160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7657c095-d528-4655-9483-0e178e3a5e1e-webhook-cert\") pod \"maas-controller-6945b87898-52t6q\" (UID: \"7657c095-d528-4655-9483-0e178e3a5e1e\") " pod="opendatahub/maas-controller-6945b87898-52t6q"
Jul 20 22:31:15.118326 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:31:15.118258    2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 20 22:31:15.118443 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:31:15.118348    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7657c095-d528-4655-9483-0e178e3a5e1e-webhook-cert podName:7657c095-d528-4655-9483-0e178e3a5e1e nodeName:}" failed. No retries permitted until 2026-07-20 22:31:15.618296371 +0000 UTC m=+505.733680974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7657c095-d528-4655-9483-0e178e3a5e1e-webhook-cert") pod "maas-controller-6945b87898-52t6q" (UID: "7657c095-d528-4655-9483-0e178e3a5e1e") : secret "maas-controller-webhook-cert" not found
Jul 20 22:31:15.140344 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:15.140287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxdsb\" (UniqueName: \"kubernetes.io/projected/7657c095-d528-4655-9483-0e178e3a5e1e-kube-api-access-nxdsb\") pod \"maas-controller-6945b87898-52t6q\" (UID: \"7657c095-d528-4655-9483-0e178e3a5e1e\") " pod="opendatahub/maas-controller-6945b87898-52t6q"
Jul 20 22:31:15.622881 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:15.622844    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7657c095-d528-4655-9483-0e178e3a5e1e-webhook-cert\") pod \"maas-controller-6945b87898-52t6q\" (UID: \"7657c095-d528-4655-9483-0e178e3a5e1e\") " pod="opendatahub/maas-controller-6945b87898-52t6q"
Jul 20 22:31:15.625366 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:15.625291    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7657c095-d528-4655-9483-0e178e3a5e1e-webhook-cert\") pod \"maas-controller-6945b87898-52t6q\" (UID: \"7657c095-d528-4655-9483-0e178e3a5e1e\") " pod="opendatahub/maas-controller-6945b87898-52t6q"
Jul 20 22:31:15.867430 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:15.867395    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6945b87898-52t6q"
Jul 20 22:31:16.002838 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:16.002813    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6945b87898-52t6q"]
Jul 20 22:31:16.004973 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:31:16.004937    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7657c095_d528_4655_9483_0e178e3a5e1e.slice/crio-29f299c7a1ece0bee7998e1b8043c1f5efabd1b7d4c172057cbb2172e0f11e51 WatchSource:0}: Error finding container 29f299c7a1ece0bee7998e1b8043c1f5efabd1b7d4c172057cbb2172e0f11e51: Status 404 returned error can't find the container with id 29f299c7a1ece0bee7998e1b8043c1f5efabd1b7d4c172057cbb2172e0f11e51
Jul 20 22:31:16.954617 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:16.954573    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6945b87898-52t6q" event={"ID":"7657c095-d528-4655-9483-0e178e3a5e1e","Type":"ContainerStarted","Data":"29f299c7a1ece0bee7998e1b8043c1f5efabd1b7d4c172057cbb2172e0f11e51"}
Jul 20 22:31:18.967170 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:18.967129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6945b87898-52t6q" event={"ID":"7657c095-d528-4655-9483-0e178e3a5e1e","Type":"ContainerStarted","Data":"2db99f8f1e2cf439cacd6e0409545546b063de961f646e845a654049d9b928b2"}
Jul 20 22:31:18.967658 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:18.967250    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6945b87898-52t6q"
Jul 20 22:31:19.052005 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:19.051940    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6945b87898-52t6q" podStartSLOduration=2.793605824 podStartE2EDuration="5.051918507s" totalImagesPullingTime="2.258312683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:31:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:31:19.049933638 +0000 UTC m=+509.165318263" watchObservedRunningTime="2026-07-20 22:31:19.051918507 +0000 UTC m=+509.167303135"
Jul 20 22:31:29.973796 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:29.973758    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6945b87898-52t6q"
Jul 20 22:31:30.464083 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:30.464047    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6945b87898-52t6q"]
Jul 20 22:31:30.464275 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:30.464230    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6945b87898-52t6q" podUID="7657c095-d528-4655-9483-0e178e3a5e1e" containerName="manager" containerID="cri-o://2db99f8f1e2cf439cacd6e0409545546b063de961f646e845a654049d9b928b2" gracePeriod=30
Jul 20 22:31:30.712279 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:30.712251    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6945b87898-52t6q"
Jul 20 22:31:30.766510 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:30.766420    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxdsb\" (UniqueName: \"kubernetes.io/projected/7657c095-d528-4655-9483-0e178e3a5e1e-kube-api-access-nxdsb\") pod \"7657c095-d528-4655-9483-0e178e3a5e1e\" (UID: \"7657c095-d528-4655-9483-0e178e3a5e1e\") "
Jul 20 22:31:30.766510 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:30.766493    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7657c095-d528-4655-9483-0e178e3a5e1e-webhook-cert\") pod \"7657c095-d528-4655-9483-0e178e3a5e1e\" (UID: \"7657c095-d528-4655-9483-0e178e3a5e1e\") "
Jul 20 22:31:30.768736 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:30.768703    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7657c095-d528-4655-9483-0e178e3a5e1e-kube-api-access-nxdsb" (OuterVolumeSpecName: "kube-api-access-nxdsb") pod "7657c095-d528-4655-9483-0e178e3a5e1e" (UID: "7657c095-d528-4655-9483-0e178e3a5e1e"). InnerVolumeSpecName "kube-api-access-nxdsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:31:30.768827 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:30.768761    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7657c095-d528-4655-9483-0e178e3a5e1e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7657c095-d528-4655-9483-0e178e3a5e1e" (UID: "7657c095-d528-4655-9483-0e178e3a5e1e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:31:30.867180 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:30.867148    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxdsb\" (UniqueName: \"kubernetes.io/projected/7657c095-d528-4655-9483-0e178e3a5e1e-kube-api-access-nxdsb\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:31:30.867180 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:30.867178    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7657c095-d528-4655-9483-0e178e3a5e1e-webhook-cert\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:31:31.026154 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:31.026060    2579 generic.go:356] "Generic (PLEG): container finished" podID="7657c095-d528-4655-9483-0e178e3a5e1e" containerID="2db99f8f1e2cf439cacd6e0409545546b063de961f646e845a654049d9b928b2" exitCode=0
Jul 20 22:31:31.026154 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:31.026110    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6945b87898-52t6q"
Jul 20 22:31:31.026672 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:31.026151    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6945b87898-52t6q" event={"ID":"7657c095-d528-4655-9483-0e178e3a5e1e","Type":"ContainerDied","Data":"2db99f8f1e2cf439cacd6e0409545546b063de961f646e845a654049d9b928b2"}
Jul 20 22:31:31.026672 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:31.026214    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6945b87898-52t6q" event={"ID":"7657c095-d528-4655-9483-0e178e3a5e1e","Type":"ContainerDied","Data":"29f299c7a1ece0bee7998e1b8043c1f5efabd1b7d4c172057cbb2172e0f11e51"}
Jul 20 22:31:31.026672 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:31.026247    2579 scope.go:117] "RemoveContainer" containerID="2db99f8f1e2cf439cacd6e0409545546b063de961f646e845a654049d9b928b2"
Jul 20 22:31:31.035659 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:31.035638    2579 scope.go:117] "RemoveContainer" containerID="2db99f8f1e2cf439cacd6e0409545546b063de961f646e845a654049d9b928b2"
Jul 20 22:31:31.035926 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:31:31.035908    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2db99f8f1e2cf439cacd6e0409545546b063de961f646e845a654049d9b928b2\": container with ID starting with 2db99f8f1e2cf439cacd6e0409545546b063de961f646e845a654049d9b928b2 not found: ID does not exist" containerID="2db99f8f1e2cf439cacd6e0409545546b063de961f646e845a654049d9b928b2"
Jul 20 22:31:31.035979 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:31.035935    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2db99f8f1e2cf439cacd6e0409545546b063de961f646e845a654049d9b928b2"} err="failed to get container status \"2db99f8f1e2cf439cacd6e0409545546b063de961f646e845a654049d9b928b2\": rpc error: code = NotFound desc = could not find container \"2db99f8f1e2cf439cacd6e0409545546b063de961f646e845a654049d9b928b2\": container with ID starting with 2db99f8f1e2cf439cacd6e0409545546b063de961f646e845a654049d9b928b2 not found: ID does not exist"
Jul 20 22:31:31.051009 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:31.050976    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6945b87898-52t6q"]
Jul 20 22:31:31.054351 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:31.054328    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6945b87898-52t6q"]
Jul 20 22:31:32.369076 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:32.369043    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7657c095-d528-4655-9483-0e178e3a5e1e" path="/var/lib/kubelet/pods/7657c095-d528-4655-9483-0e178e3a5e1e/volumes"
Jul 20 22:31:51.574481 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.574440    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fvcq6"]
Jul 20 22:31:51.574976 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.574955    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7657c095-d528-4655-9483-0e178e3a5e1e" containerName="manager"
Jul 20 22:31:51.575049 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.574979    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7657c095-d528-4655-9483-0e178e3a5e1e" containerName="manager"
Jul 20 22:31:51.575128 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.575116    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7657c095-d528-4655-9483-0e178e3a5e1e" containerName="manager"
Jul 20 22:31:51.579541 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.579520    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fvcq6"
Jul 20 22:31:51.585543 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.585518    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 20 22:31:51.586175 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.586013    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4rgdc\""
Jul 20 22:31:51.596562 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.596533    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:31:51.598254 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.598231    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fvcq6"]
Jul 20 22:31:51.608550 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.608518    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-mjdbx"]
Jul 20 22:31:51.612093 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.612072    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-mjdbx"
Jul 20 22:31:51.627615 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.627588    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-mjdbx"]
Jul 20 22:31:51.660945 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.660911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr2cf\" (UniqueName: \"kubernetes.io/projected/cf483c8c-2cf9-4272-ab49-26e0e8c7161f-kube-api-access-vr2cf\") pod \"payload-processing-5bf47cd988-mjdbx\" (UID: \"cf483c8c-2cf9-4272-ab49-26e0e8c7161f\") " pod="openshift-ingress/payload-processing-5bf47cd988-mjdbx"
Jul 20 22:31:51.661114 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.660977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-928xc\" (UniqueName: \"kubernetes.io/projected/e34c1737-1f4c-447b-ba48-b8a219d8b77a-kube-api-access-928xc\") pod \"payload-pre-processing-7677b774bb-fvcq6\" (UID: \"e34c1737-1f4c-447b-ba48-b8a219d8b77a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fvcq6"
Jul 20 22:31:51.661114 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.661035    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e34c1737-1f4c-447b-ba48-b8a219d8b77a-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fvcq6\" (UID: \"e34c1737-1f4c-447b-ba48-b8a219d8b77a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fvcq6"
Jul 20 22:31:51.661260 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.661237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf483c8c-2cf9-4272-ab49-26e0e8c7161f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-mjdbx\" (UID: \"cf483c8c-2cf9-4272-ab49-26e0e8c7161f\") " pod="openshift-ingress/payload-processing-5bf47cd988-mjdbx"
Jul 20 22:31:51.762400 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.762367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e34c1737-1f4c-447b-ba48-b8a219d8b77a-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fvcq6\" (UID: \"e34c1737-1f4c-447b-ba48-b8a219d8b77a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fvcq6"
Jul 20 22:31:51.762571 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.762437    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf483c8c-2cf9-4272-ab49-26e0e8c7161f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-mjdbx\" (UID: \"cf483c8c-2cf9-4272-ab49-26e0e8c7161f\") " pod="openshift-ingress/payload-processing-5bf47cd988-mjdbx"
Jul 20 22:31:51.762571 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.762465    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr2cf\" (UniqueName: \"kubernetes.io/projected/cf483c8c-2cf9-4272-ab49-26e0e8c7161f-kube-api-access-vr2cf\") pod \"payload-processing-5bf47cd988-mjdbx\" (UID: \"cf483c8c-2cf9-4272-ab49-26e0e8c7161f\") " pod="openshift-ingress/payload-processing-5bf47cd988-mjdbx"
Jul 20 22:31:51.762571 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.762501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-928xc\" (UniqueName: \"kubernetes.io/projected/e34c1737-1f4c-447b-ba48-b8a219d8b77a-kube-api-access-928xc\") pod \"payload-pre-processing-7677b774bb-fvcq6\" (UID: \"e34c1737-1f4c-447b-ba48-b8a219d8b77a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fvcq6"
Jul 20 22:31:51.763201 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.763175    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e34c1737-1f4c-447b-ba48-b8a219d8b77a-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-fvcq6\" (UID: \"e34c1737-1f4c-447b-ba48-b8a219d8b77a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fvcq6"
Jul 20 22:31:51.763319 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.763175    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf483c8c-2cf9-4272-ab49-26e0e8c7161f-plugins-config-volume\") pod \"payload-processing-5bf47cd988-mjdbx\" (UID: \"cf483c8c-2cf9-4272-ab49-26e0e8c7161f\") " pod="openshift-ingress/payload-processing-5bf47cd988-mjdbx"
Jul 20 22:31:51.778320 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.778276    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr2cf\" (UniqueName: \"kubernetes.io/projected/cf483c8c-2cf9-4272-ab49-26e0e8c7161f-kube-api-access-vr2cf\") pod \"payload-processing-5bf47cd988-mjdbx\" (UID: \"cf483c8c-2cf9-4272-ab49-26e0e8c7161f\") " pod="openshift-ingress/payload-processing-5bf47cd988-mjdbx"
Jul 20 22:31:51.778716 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.778697    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-928xc\" (UniqueName: \"kubernetes.io/projected/e34c1737-1f4c-447b-ba48-b8a219d8b77a-kube-api-access-928xc\") pod \"payload-pre-processing-7677b774bb-fvcq6\" (UID: \"e34c1737-1f4c-447b-ba48-b8a219d8b77a\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-fvcq6"
Jul 20 22:31:51.889114 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.889085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-fvcq6"
Jul 20 22:31:51.921949 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:51.921916    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-mjdbx"
Jul 20 22:31:52.058289 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:52.058238    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-fvcq6"]
Jul 20 22:31:52.062987 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:31:52.062953    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34c1737_1f4c_447b_ba48_b8a219d8b77a.slice/crio-8cdc4e4cb67be4b68ce4f22d396864b831a94178e49472c12e73e217b63f05e9 WatchSource:0}: Error finding container 8cdc4e4cb67be4b68ce4f22d396864b831a94178e49472c12e73e217b63f05e9: Status 404 returned error can't find the container with id 8cdc4e4cb67be4b68ce4f22d396864b831a94178e49472c12e73e217b63f05e9
Jul 20 22:31:52.090775 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:52.090751    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-mjdbx"]
Jul 20 22:31:52.092622 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:31:52.092595    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf483c8c_2cf9_4272_ab49_26e0e8c7161f.slice/crio-2d152476fe616697c59bdd6c9fb00aa3a47066f2bb1f0cd70bccfedac64f2205 WatchSource:0}: Error finding container 2d152476fe616697c59bdd6c9fb00aa3a47066f2bb1f0cd70bccfedac64f2205: Status 404 returned error can't find the container with id 2d152476fe616697c59bdd6c9fb00aa3a47066f2bb1f0cd70bccfedac64f2205
Jul 20 22:31:52.126569 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:52.126529    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-mjdbx" event={"ID":"cf483c8c-2cf9-4272-ab49-26e0e8c7161f","Type":"ContainerStarted","Data":"2d152476fe616697c59bdd6c9fb00aa3a47066f2bb1f0cd70bccfedac64f2205"}
Jul 20 22:31:52.127649 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:52.127626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fvcq6" event={"ID":"e34c1737-1f4c-447b-ba48-b8a219d8b77a","Type":"ContainerStarted","Data":"8cdc4e4cb67be4b68ce4f22d396864b831a94178e49472c12e73e217b63f05e9"}
Jul 20 22:31:54.141874 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:54.141837    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-mjdbx" event={"ID":"cf483c8c-2cf9-4272-ab49-26e0e8c7161f","Type":"ContainerStarted","Data":"980ac7262f70a1a96827bd33817686ec8335eec5ece2830b6c2493fb118db6a5"}
Jul 20 22:31:54.142350 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:54.141944    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-mjdbx"
Jul 20 22:31:54.143469 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:54.143446    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-fvcq6" event={"ID":"e34c1737-1f4c-447b-ba48-b8a219d8b77a","Type":"ContainerStarted","Data":"9cdedc05dcdc69ecd7e347e3e0220a2c3a0bdedda33387497cb22340da9fb3e3"}
Jul 20 22:31:54.143589 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:54.143571    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fvcq6"
Jul 20 22:31:54.162809 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:54.162743    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-mjdbx" podStartSLOduration=1.436650502 podStartE2EDuration="3.162726409s" totalImagesPullingTime="1.726075907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:31:54.159952823 +0000 UTC m=+544.275337479" watchObservedRunningTime="2026-07-20 22:31:54.162726409 +0000 UTC m=+544.278111016"
Jul 20 22:31:54.177367 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:31:54.177288    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-fvcq6" podStartSLOduration=1.4148510029999999 podStartE2EDuration="3.177276046s" totalImagesPullingTime="1.762425043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:31:54.177155098 +0000 UTC m=+544.292539726" watchObservedRunningTime="2026-07-20 22:31:54.177276046 +0000 UTC m=+544.292660672"
Jul 20 22:32:05.150492 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:05.150458    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-mjdbx"
Jul 20 22:32:05.150979 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:05.150669    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-fvcq6"
Jul 20 22:32:10.306867 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.306834    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"]
Jul 20 22:32:10.310981 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.310953    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.313735 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.313711    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 22:32:10.313854 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.313753    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 22:32:10.314332 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.314315    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-brv49\""
Jul 20 22:32:10.314417 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.314357    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 20 22:32:10.322180 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.322153    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"]
Jul 20 22:32:10.449969 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.449943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ef76bc-9d56-4450-9a7b-d9f73c675b83-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.450176 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.450007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ef76bc-9d56-4450-9a7b-d9f73c675b83-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.450176 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.450128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ef76bc-9d56-4450-9a7b-d9f73c675b83-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.450326 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.450283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ef76bc-9d56-4450-9a7b-d9f73c675b83-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.450377 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.450364    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ef76bc-9d56-4450-9a7b-d9f73c675b83-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.450428 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.450402    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg7xs\" (UniqueName: \"kubernetes.io/projected/98ef76bc-9d56-4450-9a7b-d9f73c675b83-kube-api-access-mg7xs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.551251 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.551213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ef76bc-9d56-4450-9a7b-d9f73c675b83-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.551446 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.551264    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ef76bc-9d56-4450-9a7b-d9f73c675b83-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.551446 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.551362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ef76bc-9d56-4450-9a7b-d9f73c675b83-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.551446 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.551442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ef76bc-9d56-4450-9a7b-d9f73c675b83-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.551587 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.551478    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ef76bc-9d56-4450-9a7b-d9f73c675b83-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.551587 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.551510    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg7xs\" (UniqueName: \"kubernetes.io/projected/98ef76bc-9d56-4450-9a7b-d9f73c675b83-kube-api-access-mg7xs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.551798 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.551775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98ef76bc-9d56-4450-9a7b-d9f73c675b83-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.551890 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.551808    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98ef76bc-9d56-4450-9a7b-d9f73c675b83-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.551890 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.551845    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98ef76bc-9d56-4450-9a7b-d9f73c675b83-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.553574 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.553555    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98ef76bc-9d56-4450-9a7b-d9f73c675b83-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.553999 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.553976    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98ef76bc-9d56-4450-9a7b-d9f73c675b83-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.560661 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.560605    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg7xs\" (UniqueName: \"kubernetes.io/projected/98ef76bc-9d56-4450-9a7b-d9f73c675b83-kube-api-access-mg7xs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl\" (UID: \"98ef76bc-9d56-4450-9a7b-d9f73c675b83\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.622657 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.622615    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:10.724534 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.724498    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:32:10.763737 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:10.763711    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"]
Jul 20 22:32:10.766002 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:32:10.765974    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98ef76bc_9d56_4450_9a7b_d9f73c675b83.slice/crio-8217f6bc4a9ac46b1a2f78fed3c53470ec172118c686d4e7b2a3d832904bbedb WatchSource:0}: Error finding container 8217f6bc4a9ac46b1a2f78fed3c53470ec172118c686d4e7b2a3d832904bbedb: Status 404 returned error can't find the container with id 8217f6bc4a9ac46b1a2f78fed3c53470ec172118c686d4e7b2a3d832904bbedb
Jul 20 22:32:11.228830 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:11.228791    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl" event={"ID":"98ef76bc-9d56-4450-9a7b-d9f73c675b83","Type":"ContainerStarted","Data":"8217f6bc4a9ac46b1a2f78fed3c53470ec172118c686d4e7b2a3d832904bbedb"}
Jul 20 22:32:12.235739 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:12.235654    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl" event={"ID":"98ef76bc-9d56-4450-9a7b-d9f73c675b83","Type":"ContainerStarted","Data":"d9b07efaeefe0df6db8b5694a0de4a7961b89f9515603c72130cede406d2ba42"}
Jul 20 22:32:12.258685 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:12.258628    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl" podStartSLOduration=1.118854586 podStartE2EDuration="2.258610511s" totalImagesPullingTime="1.139755925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:32:12.256885137 +0000 UTC m=+562.372269772" watchObservedRunningTime="2026-07-20 22:32:12.258610511 +0000 UTC m=+562.373995137"
Jul 20 22:32:20.622911 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:20.622875    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:20.623388 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:20.622931    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:20.635440 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:20.635414    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:21.288051 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:21.288023    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl"
Jul 20 22:32:54.338460 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:32:54.338420    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:33:06.036689 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:06.036650    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:33:11.091848 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.091808    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"]
Jul 20 22:33:11.095702 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.095680    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.097929 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.097910    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 20 22:33:11.108436 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.108415    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"]
Jul 20 22:33:11.112354 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.112331    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3526caa-a8e4-4df4-bbf7-325aac03f084-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.112458 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.112358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3526caa-a8e4-4df4-bbf7-325aac03f084-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.112458 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.112384    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3526caa-a8e4-4df4-bbf7-325aac03f084-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.112458 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.112419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3526caa-a8e4-4df4-bbf7-325aac03f084-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.112566 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.112480    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3526caa-a8e4-4df4-bbf7-325aac03f084-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.112566 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.112501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzdn9\" (UniqueName: \"kubernetes.io/projected/f3526caa-a8e4-4df4-bbf7-325aac03f084-kube-api-access-vzdn9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.213060 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.213021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3526caa-a8e4-4df4-bbf7-325aac03f084-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.213060 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.213057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3526caa-a8e4-4df4-bbf7-325aac03f084-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.213272 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.213088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3526caa-a8e4-4df4-bbf7-325aac03f084-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.213272 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.213126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3526caa-a8e4-4df4-bbf7-325aac03f084-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.213396 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.213288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3526caa-a8e4-4df4-bbf7-325aac03f084-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.213396 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.213353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzdn9\" (UniqueName: \"kubernetes.io/projected/f3526caa-a8e4-4df4-bbf7-325aac03f084-kube-api-access-vzdn9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.213499 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.213472    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3526caa-a8e4-4df4-bbf7-325aac03f084-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.213542 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.213526    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3526caa-a8e4-4df4-bbf7-325aac03f084-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.213627 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.213607    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3526caa-a8e4-4df4-bbf7-325aac03f084-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.215405 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.215381    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3526caa-a8e4-4df4-bbf7-325aac03f084-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.215705 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.215688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3526caa-a8e4-4df4-bbf7-325aac03f084-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.221521 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.221497    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzdn9\" (UniqueName: \"kubernetes.io/projected/f3526caa-a8e4-4df4-bbf7-325aac03f084-kube-api-access-vzdn9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk\" (UID: \"f3526caa-a8e4-4df4-bbf7-325aac03f084\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.405451 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.405400    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:11.545716 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.545597    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"]
Jul 20 22:33:11.547954 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:33:11.547923    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3526caa_a8e4_4df4_bbf7_325aac03f084.slice/crio-8d4ac910483f7f4c3128b08469fbe808a9375602eb1bd090bf12e4ce52d79a4d WatchSource:0}: Error finding container 8d4ac910483f7f4c3128b08469fbe808a9375602eb1bd090bf12e4ce52d79a4d: Status 404 returned error can't find the container with id 8d4ac910483f7f4c3128b08469fbe808a9375602eb1bd090bf12e4ce52d79a4d
Jul 20 22:33:11.549231 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:11.549215    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:33:12.524166 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:12.524127    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk" event={"ID":"f3526caa-a8e4-4df4-bbf7-325aac03f084","Type":"ContainerStarted","Data":"c5903cf3ad4cd4a2127d10ea1ce7190562616596af340b4c717feccd80b9ef84"}
Jul 20 22:33:12.524573 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:12.524182    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk" event={"ID":"f3526caa-a8e4-4df4-bbf7-325aac03f084","Type":"ContainerStarted","Data":"8d4ac910483f7f4c3128b08469fbe808a9375602eb1bd090bf12e4ce52d79a4d"}
Jul 20 22:33:12.548971 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:12.548920    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk" podStartSLOduration=1.364398203 podStartE2EDuration="1.548904456s" totalImagesPullingTime="184.506253ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:33:12.547917665 +0000 UTC m=+622.663302294" watchObservedRunningTime="2026-07-20 22:33:12.548904456 +0000 UTC m=+622.664289081"
Jul 20 22:33:12.941315 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:12.941266    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:33:21.406090 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:21.406045    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:21.406526 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:21.406124    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:21.419115 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:21.419092    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:21.581040 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:21.581007    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk"
Jul 20 22:33:28.745255 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:28.745216    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:33:45.227589 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:33:45.227552    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:34:47.438604 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:34:47.438521    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:34:59.331723 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:34:59.331671    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:35:08.517325 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:35:08.517269    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:36:08.669064 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:08.669009    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85679cb5b4-58bg5"]
Jul 20 22:36:08.672552 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:08.672531    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85679cb5b4-58bg5"
Jul 20 22:36:08.675753 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:08.675732    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vcxp2\""
Jul 20 22:36:08.675903 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:08.675732    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 22:36:08.675903 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:08.675764    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 22:36:08.683394 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:08.683357    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85679cb5b4-58bg5"]
Jul 20 22:36:08.844836 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:08.844788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlvbg\" (UniqueName: \"kubernetes.io/projected/9940ae63-a07d-4311-9476-554ca7805f19-kube-api-access-nlvbg\") pod \"maas-controller-85679cb5b4-58bg5\" (UID: \"9940ae63-a07d-4311-9476-554ca7805f19\") " pod="opendatahub/maas-controller-85679cb5b4-58bg5"
Jul 20 22:36:08.845035 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:08.844904    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9940ae63-a07d-4311-9476-554ca7805f19-webhook-cert\") pod \"maas-controller-85679cb5b4-58bg5\" (UID: \"9940ae63-a07d-4311-9476-554ca7805f19\") " pod="opendatahub/maas-controller-85679cb5b4-58bg5"
Jul 20 22:36:08.945842 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:08.945746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9940ae63-a07d-4311-9476-554ca7805f19-webhook-cert\") pod \"maas-controller-85679cb5b4-58bg5\" (UID: \"9940ae63-a07d-4311-9476-554ca7805f19\") " pod="opendatahub/maas-controller-85679cb5b4-58bg5"
Jul 20 22:36:08.945842 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:08.945827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlvbg\" (UniqueName: \"kubernetes.io/projected/9940ae63-a07d-4311-9476-554ca7805f19-kube-api-access-nlvbg\") pod \"maas-controller-85679cb5b4-58bg5\" (UID: \"9940ae63-a07d-4311-9476-554ca7805f19\") " pod="opendatahub/maas-controller-85679cb5b4-58bg5"
Jul 20 22:36:08.948366 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:08.948329    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9940ae63-a07d-4311-9476-554ca7805f19-webhook-cert\") pod \"maas-controller-85679cb5b4-58bg5\" (UID: \"9940ae63-a07d-4311-9476-554ca7805f19\") " pod="opendatahub/maas-controller-85679cb5b4-58bg5"
Jul 20 22:36:08.954727 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:08.954698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlvbg\" (UniqueName: \"kubernetes.io/projected/9940ae63-a07d-4311-9476-554ca7805f19-kube-api-access-nlvbg\") pod \"maas-controller-85679cb5b4-58bg5\" (UID: \"9940ae63-a07d-4311-9476-554ca7805f19\") " pod="opendatahub/maas-controller-85679cb5b4-58bg5"
Jul 20 22:36:08.984389 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:08.984357    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85679cb5b4-58bg5"
Jul 20 22:36:09.123834 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:09.123803    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85679cb5b4-58bg5"]
Jul 20 22:36:09.126124 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:36:09.126100    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9940ae63_a07d_4311_9476_554ca7805f19.slice/crio-79d5136182d8c7942b434f07565314d7a9e29bbea37252f87ac360a897c6710b WatchSource:0}: Error finding container 79d5136182d8c7942b434f07565314d7a9e29bbea37252f87ac360a897c6710b: Status 404 returned error can't find the container with id 79d5136182d8c7942b434f07565314d7a9e29bbea37252f87ac360a897c6710b
Jul 20 22:36:09.393530 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:09.393497    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85679cb5b4-58bg5" event={"ID":"9940ae63-a07d-4311-9476-554ca7805f19","Type":"ContainerStarted","Data":"79d5136182d8c7942b434f07565314d7a9e29bbea37252f87ac360a897c6710b"}
Jul 20 22:36:10.400057 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:10.400018    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85679cb5b4-58bg5" event={"ID":"9940ae63-a07d-4311-9476-554ca7805f19","Type":"ContainerStarted","Data":"0571cc310964dc07f5ce121f5779b566c344bfa09f09a88336dffde179c85f73"}
Jul 20 22:36:10.400462 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:10.400145    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85679cb5b4-58bg5"
Jul 20 22:36:10.419174 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:10.419121    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85679cb5b4-58bg5" podStartSLOduration=1.98106461 podStartE2EDuration="2.419103273s" totalImagesPullingTime="438.038663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:36:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:36:10.417976723 +0000 UTC m=+800.533361349" watchObservedRunningTime="2026-07-20 22:36:10.419103273 +0000 UTC m=+800.534487899"
Jul 20 22:36:21.408043 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:21.407955    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85679cb5b4-58bg5"
Jul 20 22:36:26.046766 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.046726    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85679cb5b4-58bg5"]
Jul 20 22:36:26.047230 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.046972    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85679cb5b4-58bg5" podUID="9940ae63-a07d-4311-9476-554ca7805f19" containerName="manager" containerID="cri-o://0571cc310964dc07f5ce121f5779b566c344bfa09f09a88336dffde179c85f73" gracePeriod=30
Jul 20 22:36:26.300111 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.300033    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85679cb5b4-58bg5"
Jul 20 22:36:26.407552 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.407518    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9940ae63-a07d-4311-9476-554ca7805f19-webhook-cert\") pod \"9940ae63-a07d-4311-9476-554ca7805f19\" (UID: \"9940ae63-a07d-4311-9476-554ca7805f19\") "
Jul 20 22:36:26.407745 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.407610    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlvbg\" (UniqueName: \"kubernetes.io/projected/9940ae63-a07d-4311-9476-554ca7805f19-kube-api-access-nlvbg\") pod \"9940ae63-a07d-4311-9476-554ca7805f19\" (UID: \"9940ae63-a07d-4311-9476-554ca7805f19\") "
Jul 20 22:36:26.409779 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.409751    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9940ae63-a07d-4311-9476-554ca7805f19-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9940ae63-a07d-4311-9476-554ca7805f19" (UID: "9940ae63-a07d-4311-9476-554ca7805f19"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 22:36:26.409914 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.409840    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9940ae63-a07d-4311-9476-554ca7805f19-kube-api-access-nlvbg" (OuterVolumeSpecName: "kube-api-access-nlvbg") pod "9940ae63-a07d-4311-9476-554ca7805f19" (UID: "9940ae63-a07d-4311-9476-554ca7805f19"). InnerVolumeSpecName "kube-api-access-nlvbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 22:36:26.480387 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.480348    2579 generic.go:356] "Generic (PLEG): container finished" podID="9940ae63-a07d-4311-9476-554ca7805f19" containerID="0571cc310964dc07f5ce121f5779b566c344bfa09f09a88336dffde179c85f73" exitCode=0
Jul 20 22:36:26.480590 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.480405    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85679cb5b4-58bg5"
Jul 20 22:36:26.480590 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.480430    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85679cb5b4-58bg5" event={"ID":"9940ae63-a07d-4311-9476-554ca7805f19","Type":"ContainerDied","Data":"0571cc310964dc07f5ce121f5779b566c344bfa09f09a88336dffde179c85f73"}
Jul 20 22:36:26.480590 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.480485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85679cb5b4-58bg5" event={"ID":"9940ae63-a07d-4311-9476-554ca7805f19","Type":"ContainerDied","Data":"79d5136182d8c7942b434f07565314d7a9e29bbea37252f87ac360a897c6710b"}
Jul 20 22:36:26.480590 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.480509    2579 scope.go:117] "RemoveContainer" containerID="0571cc310964dc07f5ce121f5779b566c344bfa09f09a88336dffde179c85f73"
Jul 20 22:36:26.489836 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.489810    2579 scope.go:117] "RemoveContainer" containerID="0571cc310964dc07f5ce121f5779b566c344bfa09f09a88336dffde179c85f73"
Jul 20 22:36:26.490118 ip-10-0-128-108 kubenswrapper[2579]: E0720 22:36:26.490101    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0571cc310964dc07f5ce121f5779b566c344bfa09f09a88336dffde179c85f73\": container with ID starting with 0571cc310964dc07f5ce121f5779b566c344bfa09f09a88336dffde179c85f73 not found: ID does not exist" containerID="0571cc310964dc07f5ce121f5779b566c344bfa09f09a88336dffde179c85f73"
Jul 20 22:36:26.490186 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.490125    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0571cc310964dc07f5ce121f5779b566c344bfa09f09a88336dffde179c85f73"} err="failed to get container status \"0571cc310964dc07f5ce121f5779b566c344bfa09f09a88336dffde179c85f73\": rpc error: code = NotFound desc = could not find container \"0571cc310964dc07f5ce121f5779b566c344bfa09f09a88336dffde179c85f73\": container with ID starting with 0571cc310964dc07f5ce121f5779b566c344bfa09f09a88336dffde179c85f73 not found: ID does not exist"
Jul 20 22:36:26.499483 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.499446    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85679cb5b4-58bg5"]
Jul 20 22:36:26.502061 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.502040    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85679cb5b4-58bg5"]
Jul 20 22:36:26.509139 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.509121    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9940ae63-a07d-4311-9476-554ca7805f19-webhook-cert\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:36:26.509207 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:26.509142    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlvbg\" (UniqueName: \"kubernetes.io/projected/9940ae63-a07d-4311-9476-554ca7805f19-kube-api-access-nlvbg\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:36:27.268152 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.268118    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85679cb5b4-bgznw"]
Jul 20 22:36:27.268585 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.268536    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9940ae63-a07d-4311-9476-554ca7805f19" containerName="manager"
Jul 20 22:36:27.268585 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.268548    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9940ae63-a07d-4311-9476-554ca7805f19" containerName="manager"
Jul 20 22:36:27.268674 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.268614    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9940ae63-a07d-4311-9476-554ca7805f19" containerName="manager"
Jul 20 22:36:27.273007 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.272984    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85679cb5b4-bgznw"
Jul 20 22:36:27.276060 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.276039    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 20 22:36:27.276154 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.276039    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vcxp2\""
Jul 20 22:36:27.276154 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.276041    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 20 22:36:27.280206 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.280180    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85679cb5b4-bgznw"]
Jul 20 22:36:27.316200 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.316166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e6cc3bb-4961-40db-baab-2f06605c6e9c-webhook-cert\") pod \"maas-controller-85679cb5b4-bgznw\" (UID: \"4e6cc3bb-4961-40db-baab-2f06605c6e9c\") " pod="opendatahub/maas-controller-85679cb5b4-bgznw"
Jul 20 22:36:27.316430 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.316357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g52wz\" (UniqueName: \"kubernetes.io/projected/4e6cc3bb-4961-40db-baab-2f06605c6e9c-kube-api-access-g52wz\") pod \"maas-controller-85679cb5b4-bgznw\" (UID: \"4e6cc3bb-4961-40db-baab-2f06605c6e9c\") " pod="opendatahub/maas-controller-85679cb5b4-bgznw"
Jul 20 22:36:27.417365 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.417322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e6cc3bb-4961-40db-baab-2f06605c6e9c-webhook-cert\") pod \"maas-controller-85679cb5b4-bgznw\" (UID: \"4e6cc3bb-4961-40db-baab-2f06605c6e9c\") " pod="opendatahub/maas-controller-85679cb5b4-bgznw"
Jul 20 22:36:27.417563 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.417450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g52wz\" (UniqueName: \"kubernetes.io/projected/4e6cc3bb-4961-40db-baab-2f06605c6e9c-kube-api-access-g52wz\") pod \"maas-controller-85679cb5b4-bgznw\" (UID: \"4e6cc3bb-4961-40db-baab-2f06605c6e9c\") " pod="opendatahub/maas-controller-85679cb5b4-bgznw"
Jul 20 22:36:27.419833 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.419813    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e6cc3bb-4961-40db-baab-2f06605c6e9c-webhook-cert\") pod \"maas-controller-85679cb5b4-bgznw\" (UID: \"4e6cc3bb-4961-40db-baab-2f06605c6e9c\") " pod="opendatahub/maas-controller-85679cb5b4-bgznw"
Jul 20 22:36:27.435314 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.435274    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g52wz\" (UniqueName: \"kubernetes.io/projected/4e6cc3bb-4961-40db-baab-2f06605c6e9c-kube-api-access-g52wz\") pod \"maas-controller-85679cb5b4-bgznw\" (UID: \"4e6cc3bb-4961-40db-baab-2f06605c6e9c\") " pod="opendatahub/maas-controller-85679cb5b4-bgznw"
Jul 20 22:36:27.584835 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.584726    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85679cb5b4-bgznw"
Jul 20 22:36:27.723973 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:27.723943    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85679cb5b4-bgznw"]
Jul 20 22:36:27.727251 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:36:27.727220    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6cc3bb_4961_40db_baab_2f06605c6e9c.slice/crio-c8a30ed39955281e89a3845e37df1a66790359d24879059123e9ee8ec569fc75 WatchSource:0}: Error finding container c8a30ed39955281e89a3845e37df1a66790359d24879059123e9ee8ec569fc75: Status 404 returned error can't find the container with id c8a30ed39955281e89a3845e37df1a66790359d24879059123e9ee8ec569fc75
Jul 20 22:36:28.369203 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:28.369168    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9940ae63-a07d-4311-9476-554ca7805f19" path="/var/lib/kubelet/pods/9940ae63-a07d-4311-9476-554ca7805f19/volumes"
Jul 20 22:36:28.492783 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:28.492679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85679cb5b4-bgznw" event={"ID":"4e6cc3bb-4961-40db-baab-2f06605c6e9c","Type":"ContainerStarted","Data":"99073f3accc5dc4dce2703af50751b2c3b00af1b99fae6ce6509031de6109c85"}
Jul 20 22:36:28.492783 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:28.492750    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85679cb5b4-bgznw" event={"ID":"4e6cc3bb-4961-40db-baab-2f06605c6e9c","Type":"ContainerStarted","Data":"c8a30ed39955281e89a3845e37df1a66790359d24879059123e9ee8ec569fc75"}
Jul 20 22:36:28.492967 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:28.492864    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85679cb5b4-bgznw"
Jul 20 22:36:28.507919 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:28.507872    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85679cb5b4-bgznw" podStartSLOduration=1.090582644 podStartE2EDuration="1.507857574s" totalImagesPullingTime="417.27493ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:36:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:36:28.507666534 +0000 UTC m=+818.623051163" watchObservedRunningTime="2026-07-20 22:36:28.507857574 +0000 UTC m=+818.623242200"
Jul 20 22:36:39.501073 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:39.501044    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85679cb5b4-bgznw"
Jul 20 22:36:51.528395 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:36:51.528362    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:37:00.855371 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:37:00.855328    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:37:29.440320 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:37:29.440271    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:37:39.532280 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:37:39.532245    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:37:50.223943 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:37:50.223850    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:37:56.027780 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:37:56.027741    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:38:07.528702 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:38:07.528663    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:38:17.060726 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:38:17.060690    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:38:27.964489 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:38:27.964450    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:38:37.521279 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:38:37.521245    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:38:59.912044 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:38:59.912004    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:39:10.332986 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:39:10.332948    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:39:34.369507 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:39:34.369471    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:39:46.527776 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:39:46.527736    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:40:02.033776 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:40:02.033729    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:40:10.925691 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:40:10.925652    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:40:20.328995 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:40:20.328959    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:40:29.228389 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:40:29.228350    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:40:37.632359 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:40:37.632318    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:42:29.235925 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:42:29.235886    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:42:40.430114 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:42:40.430079    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:42:49.019991 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:42:49.019939    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:43:00.528955 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:43:00.528915    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:43:11.232347 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:43:11.232293    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:43:21.923434 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:43:21.923392    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:43:32.427965 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:43:32.427926    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:43:42.853025 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:43:42.852942    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:43:53.887604 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:43:53.887568    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:44:02.724506 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:44:02.724469    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:44:13.126659 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:44:13.126625    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:44:34.632157 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:44:34.632118    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:44:44.642438 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:44:44.642399    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:45:07.030417 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:45:07.030381    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:45:21.581580 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:45:21.581493    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:45:43.334118 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:45:43.334083    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:45:56.334867 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:45:56.334830    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:46:04.931814 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:46:04.931773    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:46:15.548882 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:46:15.548842    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:46:26.237393 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:46:26.237358    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:46:35.541551 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:46:35.541515    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:46:46.845554 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:46:46.845464    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:46:55.752067 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:46:55.752025    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:47:05.340682 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:47:05.340642    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:47:18.574875 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:47:18.574839    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:47:28.436394 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:47:28.436354    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:47:37.534093 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:47:37.534060    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:47:47.041157 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:47:47.041118    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:47:59.232075 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:47:59.232034    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:48:07.241585 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:48:07.241550    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:48:19.639834 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:48:19.639754    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:48:31.640624 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:48:31.640589    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:48:42.032738 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:48:42.032704    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:48:53.235421 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:48:53.235385    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:49:09.824409 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:49:09.824376    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:49:26.024919 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:49:26.024885    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:49:57.425839 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:49:57.425752    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:50:09.925501 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:09.925457    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:50:31.028339 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:31.028287    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv"]
Jul 20 22:50:31.036833 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:31.033446    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv"
Jul 20 22:50:31.036833 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:31.036549    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mtrv\""
Jul 20 22:50:31.036833 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:31.036667    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 22:50:31.041542 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:31.041512    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv"]
Jul 20 22:50:31.132501 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:31.132466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d91cbb86-5748-4112-ba1b-93887751ddff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv\" (UID: \"d91cbb86-5748-4112-ba1b-93887751ddff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv"
Jul 20 22:50:31.233254 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:31.233219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d91cbb86-5748-4112-ba1b-93887751ddff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv\" (UID: \"d91cbb86-5748-4112-ba1b-93887751ddff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv"
Jul 20 22:50:31.233953 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:31.233932    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d91cbb86-5748-4112-ba1b-93887751ddff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv\" (UID: \"d91cbb86-5748-4112-ba1b-93887751ddff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv"
Jul 20 22:50:31.347865 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:31.347775    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv"
Jul 20 22:50:31.491988 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:31.491960    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv"]
Jul 20 22:50:31.493901 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:50:31.493874    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91cbb86_5748_4112_ba1b_93887751ddff.slice/crio-615cf88e421c3990254ac06fd7cca7ce7e808172e55df77a91f3d1e5969b43ab WatchSource:0}: Error finding container 615cf88e421c3990254ac06fd7cca7ce7e808172e55df77a91f3d1e5969b43ab: Status 404 returned error can't find the container with id 615cf88e421c3990254ac06fd7cca7ce7e808172e55df77a91f3d1e5969b43ab
Jul 20 22:50:31.495771 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:31.495755    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 22:50:31.698678 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:31.698645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv" event={"ID":"d91cbb86-5748-4112-ba1b-93887751ddff","Type":"ContainerStarted","Data":"615cf88e421c3990254ac06fd7cca7ce7e808172e55df77a91f3d1e5969b43ab"}
Jul 20 22:50:34.715673 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:34.715637    2579 generic.go:356] "Generic (PLEG): container finished" podID="d91cbb86-5748-4112-ba1b-93887751ddff" containerID="b054c6093719996468eec79e66a2721c03788ec592b9b87a736c1e4826b473dd" exitCode=0
Jul 20 22:50:34.716120 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:34.715704    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv" event={"ID":"d91cbb86-5748-4112-ba1b-93887751ddff","Type":"ContainerDied","Data":"b054c6093719996468eec79e66a2721c03788ec592b9b87a736c1e4826b473dd"}
Jul 20 22:50:35.860526 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:35.860498    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv"
Jul 20 22:50:35.977808 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:35.977720    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d91cbb86-5748-4112-ba1b-93887751ddff-maas-api-service-ca\") pod \"d91cbb86-5748-4112-ba1b-93887751ddff\" (UID: \"d91cbb86-5748-4112-ba1b-93887751ddff\") "
Jul 20 22:50:35.978128 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:35.978107    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d91cbb86-5748-4112-ba1b-93887751ddff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d91cbb86-5748-4112-ba1b-93887751ddff" (UID: "d91cbb86-5748-4112-ba1b-93887751ddff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:50:36.078739 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:36.078697    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d91cbb86-5748-4112-ba1b-93887751ddff-maas-api-service-ca\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:50:36.727089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:36.726999    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv" event={"ID":"d91cbb86-5748-4112-ba1b-93887751ddff","Type":"ContainerDied","Data":"615cf88e421c3990254ac06fd7cca7ce7e808172e55df77a91f3d1e5969b43ab"}
Jul 20 22:50:36.727089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:36.727052    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="615cf88e421c3990254ac06fd7cca7ce7e808172e55df77a91f3d1e5969b43ab"
Jul 20 22:50:36.727089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:36.727011    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv"
Jul 20 22:50:44.434779 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:44.434740    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:50:46.156610 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:46.156570    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv"]
Jul 20 22:50:46.161491 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:46.161465    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-efdde4dc-bnvtv"]
Jul 20 22:50:46.368647 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:46.368609    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d91cbb86-5748-4112-ba1b-93887751ddff" path="/var/lib/kubelet/pods/d91cbb86-5748-4112-ba1b-93887751ddff/volumes"
Jul 20 22:50:54.831355 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:50:54.831296    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:51:28.618807 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:28.618767    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:51:37.132597 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:37.132545    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:51:59.181461 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:59.181424    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5"]
Jul 20 22:51:59.182080 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:59.181904    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d91cbb86-5748-4112-ba1b-93887751ddff" containerName="revoke-keys"
Jul 20 22:51:59.182080 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:59.181923    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d91cbb86-5748-4112-ba1b-93887751ddff" containerName="revoke-keys"
Jul 20 22:51:59.182080 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:59.182031    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d91cbb86-5748-4112-ba1b-93887751ddff" containerName="revoke-keys"
Jul 20 22:51:59.185244 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:59.185222    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5"
Jul 20 22:51:59.187644 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:59.187620    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 22:51:59.187644 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:59.187638    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mtrv\""
Jul 20 22:51:59.193162 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:59.193135    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5"]
Jul 20 22:51:59.323793 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:59.323759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1abf00d2-5813-473e-b415-44ce4e7903a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5\" (UID: \"1abf00d2-5813-473e-b415-44ce4e7903a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5"
Jul 20 22:51:59.424284 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:59.424242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1abf00d2-5813-473e-b415-44ce4e7903a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5\" (UID: \"1abf00d2-5813-473e-b415-44ce4e7903a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5"
Jul 20 22:51:59.424950 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:59.424928    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1abf00d2-5813-473e-b415-44ce4e7903a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5\" (UID: \"1abf00d2-5813-473e-b415-44ce4e7903a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5"
Jul 20 22:51:59.498116 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:59.498025    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5"
Jul 20 22:51:59.850079 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:51:59.850054    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5"]
Jul 20 22:51:59.852128 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:51:59.852098    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1abf00d2_5813_473e_b415_44ce4e7903a9.slice/crio-ac8eea7d8fccea5541a5e158d2732a526824bd8c067a46af43cd16303d7d0041 WatchSource:0}: Error finding container ac8eea7d8fccea5541a5e158d2732a526824bd8c067a46af43cd16303d7d0041: Status 404 returned error can't find the container with id ac8eea7d8fccea5541a5e158d2732a526824bd8c067a46af43cd16303d7d0041
Jul 20 22:52:00.148822 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:00.148793    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5" event={"ID":"1abf00d2-5813-473e-b415-44ce4e7903a9","Type":"ContainerStarted","Data":"1457cacfa8302baa6d7c95509c2203425f6fd4ba95118fa2111df049cafc3523"}
Jul 20 22:52:00.148979 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:00.148845    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5" event={"ID":"1abf00d2-5813-473e-b415-44ce4e7903a9","Type":"ContainerStarted","Data":"ac8eea7d8fccea5541a5e158d2732a526824bd8c067a46af43cd16303d7d0041"}
Jul 20 22:52:00.163903 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:00.163846    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5" podStartSLOduration=1.163828805 podStartE2EDuration="1.163828805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 22:51:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 22:52:00.162540068 +0000 UTC m=+1750.277924721" watchObservedRunningTime="2026-07-20 22:52:00.163828805 +0000 UTC m=+1750.279213467"
Jul 20 22:52:01.155530 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:01.155492    2579 generic.go:356] "Generic (PLEG): container finished" podID="1abf00d2-5813-473e-b415-44ce4e7903a9" containerID="1457cacfa8302baa6d7c95509c2203425f6fd4ba95118fa2111df049cafc3523" exitCode=0
Jul 20 22:52:01.156195 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:01.155590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5" event={"ID":"1abf00d2-5813-473e-b415-44ce4e7903a9","Type":"ContainerDied","Data":"1457cacfa8302baa6d7c95509c2203425f6fd4ba95118fa2111df049cafc3523"}
Jul 20 22:52:02.302001 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:02.301969    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5"
Jul 20 22:52:02.351114 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:02.351080    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1abf00d2-5813-473e-b415-44ce4e7903a9-maas-api-service-ca\") pod \"1abf00d2-5813-473e-b415-44ce4e7903a9\" (UID: \"1abf00d2-5813-473e-b415-44ce4e7903a9\") "
Jul 20 22:52:02.351498 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:02.351476    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1abf00d2-5813-473e-b415-44ce4e7903a9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1abf00d2-5813-473e-b415-44ce4e7903a9" (UID: "1abf00d2-5813-473e-b415-44ce4e7903a9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:52:02.452701 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:02.452612    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1abf00d2-5813-473e-b415-44ce4e7903a9-maas-api-service-ca\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:52:03.166283 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:03.166251    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5"
Jul 20 22:52:03.166498 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:03.166291    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5" event={"ID":"1abf00d2-5813-473e-b415-44ce4e7903a9","Type":"ContainerDied","Data":"ac8eea7d8fccea5541a5e158d2732a526824bd8c067a46af43cd16303d7d0041"}
Jul 20 22:52:03.166498 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:03.166366    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac8eea7d8fccea5541a5e158d2732a526824bd8c067a46af43cd16303d7d0041"
Jul 20 22:52:12.833706 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:12.833670    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:52:14.270722 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:14.270682    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5"]
Jul 20 22:52:14.280089 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:14.280044    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-258bd95d-wlgp5"]
Jul 20 22:52:14.369742 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:52:14.369708    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1abf00d2-5813-473e-b415-44ce4e7903a9" path="/var/lib/kubelet/pods/1abf00d2-5813-473e-b415-44ce4e7903a9/volumes"
Jul 20 22:53:40.339793 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:53:40.339752    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:53:50.330102 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:53:50.330062    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:54:01.320912 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:54:01.320872    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:54:22.924439 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:54:22.924351    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:54:57.930172 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:54:57.930137    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:55:08.831048 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:55:08.831006    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:55:18.835431 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:55:18.835394    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:55:35.622938 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:55:35.622902    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:55:45.023562 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:55:45.023473    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:56:50.049886 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:56:50.049846    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:56:50.498736 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:56:50.498699    2579 scope.go:117] "RemoveContainer" containerID="b054c6093719996468eec79e66a2721c03788ec592b9b87a736c1e4826b473dd"
Jul 20 22:56:59.833570 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:56:59.833530    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:57:50.425495 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:57:50.425460    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:58:05.717143 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:58:05.717100    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:58:22.724672 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:58:22.724627    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:58:45.817577 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:58:45.817491    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:58:50.527785 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:58:50.527753    2579 scope.go:117] "RemoveContainer" containerID="1457cacfa8302baa6d7c95509c2203425f6fd4ba95118fa2111df049cafc3523"
Jul 20 22:58:59.030925 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:58:59.030881    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:59:34.138134 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:34.138097    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf"]
Jul 20 22:59:34.138809 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:34.138786    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1abf00d2-5813-473e-b415-44ce4e7903a9" containerName="revoke-keys"
Jul 20 22:59:34.138892 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:34.138811    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1abf00d2-5813-473e-b415-44ce4e7903a9" containerName="revoke-keys"
Jul 20 22:59:34.139007 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:34.138923    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1abf00d2-5813-473e-b415-44ce4e7903a9" containerName="revoke-keys"
Jul 20 22:59:34.142149 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:34.142129    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf"
Jul 20 22:59:34.144552 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:34.144525    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mtrv\""
Jul 20 22:59:34.144668 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:34.144621    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 22:59:34.148738 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:34.148715    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf"]
Jul 20 22:59:34.180894 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:34.180843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/066213f1-1219-422b-9c7d-db2f9198dae4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf\" (UID: \"066213f1-1219-422b-9c7d-db2f9198dae4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf"
Jul 20 22:59:34.282011 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:34.281968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/066213f1-1219-422b-9c7d-db2f9198dae4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf\" (UID: \"066213f1-1219-422b-9c7d-db2f9198dae4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf"
Jul 20 22:59:34.282657 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:34.282635    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/066213f1-1219-422b-9c7d-db2f9198dae4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf\" (UID: \"066213f1-1219-422b-9c7d-db2f9198dae4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf"
Jul 20 22:59:34.454695 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:34.454599    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf"
Jul 20 22:59:34.603084 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:34.603058    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf"]
Jul 20 22:59:34.605616 ip-10-0-128-108 kubenswrapper[2579]: W0720 22:59:34.605583    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066213f1_1219_422b_9c7d_db2f9198dae4.slice/crio-1280ce46a075981999f382d6ab168e4c8e14360271d97f494942dd57ce2283f9 WatchSource:0}: Error finding container 1280ce46a075981999f382d6ab168e4c8e14360271d97f494942dd57ce2283f9: Status 404 returned error can't find the container with id 1280ce46a075981999f382d6ab168e4c8e14360271d97f494942dd57ce2283f9
Jul 20 22:59:35.478880 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:35.478842    2579 generic.go:356] "Generic (PLEG): container finished" podID="066213f1-1219-422b-9c7d-db2f9198dae4" containerID="3a81553daef0b8e036f06572fb10f9e00bff12452dc16b2a52ddea942c14b167" exitCode=0
Jul 20 22:59:35.479357 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:35.478942    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf" event={"ID":"066213f1-1219-422b-9c7d-db2f9198dae4","Type":"ContainerDied","Data":"3a81553daef0b8e036f06572fb10f9e00bff12452dc16b2a52ddea942c14b167"}
Jul 20 22:59:35.479357 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:35.479022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf" event={"ID":"066213f1-1219-422b-9c7d-db2f9198dae4","Type":"ContainerStarted","Data":"1280ce46a075981999f382d6ab168e4c8e14360271d97f494942dd57ce2283f9"}
Jul 20 22:59:36.629400 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:36.629365    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf"
Jul 20 22:59:36.707163 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:36.707125    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/066213f1-1219-422b-9c7d-db2f9198dae4-maas-api-service-ca\") pod \"066213f1-1219-422b-9c7d-db2f9198dae4\" (UID: \"066213f1-1219-422b-9c7d-db2f9198dae4\") "
Jul 20 22:59:36.707575 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:36.707550    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/066213f1-1219-422b-9c7d-db2f9198dae4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "066213f1-1219-422b-9c7d-db2f9198dae4" (UID: "066213f1-1219-422b-9c7d-db2f9198dae4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:59:36.808523 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:36.808420    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/066213f1-1219-422b-9c7d-db2f9198dae4-maas-api-service-ca\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:59:37.490698 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:37.490666    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf"
Jul 20 22:59:37.490891 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:37.490671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf" event={"ID":"066213f1-1219-422b-9c7d-db2f9198dae4","Type":"ContainerDied","Data":"1280ce46a075981999f382d6ab168e4c8e14360271d97f494942dd57ce2283f9"}
Jul 20 22:59:37.490891 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:37.490820    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1280ce46a075981999f382d6ab168e4c8e14360271d97f494942dd57ce2283f9"
Jul 20 22:59:38.017442 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:38.017408    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:59:49.218964 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:49.218899    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf"]
Jul 20 22:59:49.221254 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:49.221228    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a2ebf0-n74bf"]
Jul 20 22:59:50.368679 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:50.368646    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="066213f1-1219-422b-9c7d-db2f9198dae4" path="/var/lib/kubelet/pods/066213f1-1219-422b-9c7d-db2f9198dae4/volumes"
Jul 20 22:59:52.622516 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:52.622478    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 22:59:56.036342 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.036293    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm"]
Jul 20 22:59:56.036818 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.036740    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066213f1-1219-422b-9c7d-db2f9198dae4" containerName="revoke-keys"
Jul 20 22:59:56.036818 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.036751    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="066213f1-1219-422b-9c7d-db2f9198dae4" containerName="revoke-keys"
Jul 20 22:59:56.036890 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.036829    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="066213f1-1219-422b-9c7d-db2f9198dae4" containerName="revoke-keys"
Jul 20 22:59:56.039875 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.039856    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm"
Jul 20 22:59:56.042386 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.042358    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 22:59:56.042506 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.042369    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mtrv\""
Jul 20 22:59:56.048900 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.048868    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm"]
Jul 20 22:59:56.190488 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.190444    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af3af58-428e-426a-8b45-c550c143750d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm\" (UID: \"2af3af58-428e-426a-8b45-c550c143750d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm"
Jul 20 22:59:56.291358 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.291226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af3af58-428e-426a-8b45-c550c143750d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm\" (UID: \"2af3af58-428e-426a-8b45-c550c143750d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm"
Jul 20 22:59:56.291923 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.291902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af3af58-428e-426a-8b45-c550c143750d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm\" (UID: \"2af3af58-428e-426a-8b45-c550c143750d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm"
Jul 20 22:59:56.352293 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.352260    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm"
Jul 20 22:59:56.494579 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.494543    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm"]
Jul 20 22:59:56.587324 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:56.587204    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm" event={"ID":"2af3af58-428e-426a-8b45-c550c143750d","Type":"ContainerStarted","Data":"6e0ebeb8d3004bbc87a6429210378357c7d665854644f453bfca4af7012d4adc"}
Jul 20 22:59:57.594570 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:57.594483    2579 generic.go:356] "Generic (PLEG): container finished" podID="2af3af58-428e-426a-8b45-c550c143750d" containerID="81e3250cf3ec66f3eeb8f863e484d492e61883b6849543d9d0f874a3a00cbf2b" exitCode=0
Jul 20 22:59:57.594947 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:57.594568    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm" event={"ID":"2af3af58-428e-426a-8b45-c550c143750d","Type":"ContainerDied","Data":"81e3250cf3ec66f3eeb8f863e484d492e61883b6849543d9d0f874a3a00cbf2b"}
Jul 20 22:59:58.740885 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:58.740857    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm"
Jul 20 22:59:58.916152 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:58.916118    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af3af58-428e-426a-8b45-c550c143750d-maas-api-service-ca\") pod \"2af3af58-428e-426a-8b45-c550c143750d\" (UID: \"2af3af58-428e-426a-8b45-c550c143750d\") "
Jul 20 22:59:58.916513 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:58.916489    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af3af58-428e-426a-8b45-c550c143750d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2af3af58-428e-426a-8b45-c550c143750d" (UID: "2af3af58-428e-426a-8b45-c550c143750d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 22:59:59.017749 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:59.017716    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af3af58-428e-426a-8b45-c550c143750d-maas-api-service-ca\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 22:59:59.606260 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:59.606216    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm" event={"ID":"2af3af58-428e-426a-8b45-c550c143750d","Type":"ContainerDied","Data":"6e0ebeb8d3004bbc87a6429210378357c7d665854644f453bfca4af7012d4adc"}
Jul 20 22:59:59.606433 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:59.606276    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e0ebeb8d3004bbc87a6429210378357c7d665854644f453bfca4af7012d4adc"
Jul 20 22:59:59.606433 ip-10-0-128-108 kubenswrapper[2579]: I0720 22:59:59.606239    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm"
Jul 20 23:00:00.142628 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:00.142592    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743140-vt22k"]
Jul 20 23:00:00.143046 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:00.143021    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2af3af58-428e-426a-8b45-c550c143750d" containerName="revoke-keys"
Jul 20 23:00:00.143046 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:00.143033    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2af3af58-428e-426a-8b45-c550c143750d" containerName="revoke-keys"
Jul 20 23:00:00.143127 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:00.143104    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2af3af58-428e-426a-8b45-c550c143750d" containerName="revoke-keys"
Jul 20 23:00:00.146098 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:00.146080    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743140-vt22k"
Jul 20 23:00:00.148503 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:00.148482    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mtrv\""
Jul 20 23:00:00.154627 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:00.154602    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743140-vt22k"]
Jul 20 23:00:00.157000 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:00.156978    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743140-vt22k"
Jul 20 23:00:00.299948 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:00.299917    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743140-vt22k"]
Jul 20 23:00:00.301669 ip-10-0-128-108 kubenswrapper[2579]: W0720 23:00:00.301636    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b58c50_9166_4ecf_819a_57160472ee0d.slice/crio-894a3e14f9b1c481570bc0214969ecac9181ad72131450dad828f5c57fc31507 WatchSource:0}: Error finding container 894a3e14f9b1c481570bc0214969ecac9181ad72131450dad828f5c57fc31507: Status 404 returned error can't find the container with id 894a3e14f9b1c481570bc0214969ecac9181ad72131450dad828f5c57fc31507
Jul 20 23:00:00.612371 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:00.612330    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743140-vt22k" event={"ID":"40b58c50-9166-4ecf-819a-57160472ee0d","Type":"ContainerStarted","Data":"894a3e14f9b1c481570bc0214969ecac9181ad72131450dad828f5c57fc31507"}
Jul 20 23:00:01.619135 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:01.619105    2579 generic.go:356] "Generic (PLEG): container finished" podID="40b58c50-9166-4ecf-819a-57160472ee0d" containerID="947e19be3686655ea89c3a70d130785f8f7c4bb0943f72ac4887e886934097a1" exitCode=0
Jul 20 23:00:01.619640 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:01.619197    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743140-vt22k" event={"ID":"40b58c50-9166-4ecf-819a-57160472ee0d","Type":"ContainerDied","Data":"947e19be3686655ea89c3a70d130785f8f7c4bb0943f72ac4887e886934097a1"}
Jul 20 23:00:02.764378 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:02.764351    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743140-vt22k"
Jul 20 23:00:03.630821 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:03.630790    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743140-vt22k"
Jul 20 23:00:03.630821 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:03.630805    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743140-vt22k" event={"ID":"40b58c50-9166-4ecf-819a-57160472ee0d","Type":"ContainerDied","Data":"894a3e14f9b1c481570bc0214969ecac9181ad72131450dad828f5c57fc31507"}
Jul 20 23:00:03.631045 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:03.630853    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="894a3e14f9b1c481570bc0214969ecac9181ad72131450dad828f5c57fc31507"
Jul 20 23:00:09.527912 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:09.527875    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:00:11.111094 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:11.111045    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm"]
Jul 20 23:00:11.112858 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:11.112833    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-32e2ed-pnjfm"]
Jul 20 23:00:12.369094 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:12.369057    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2af3af58-428e-426a-8b45-c550c143750d" path="/var/lib/kubelet/pods/2af3af58-428e-426a-8b45-c550c143750d/volumes"
Jul 20 23:00:29.226481 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:29.226437    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:00:42.554820 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:42.554782    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf"]
Jul 20 23:00:42.555389 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:42.555369    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b58c50-9166-4ecf-819a-57160472ee0d" containerName="cleanup"
Jul 20 23:00:42.555457 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:42.555393    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b58c50-9166-4ecf-819a-57160472ee0d" containerName="cleanup"
Jul 20 23:00:42.555518 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:42.555507    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="40b58c50-9166-4ecf-819a-57160472ee0d" containerName="cleanup"
Jul 20 23:00:42.559025 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:42.559009    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf"
Jul 20 23:00:42.561109 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:42.561068    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 23:00:42.561280 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:42.561163    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mtrv\""
Jul 20 23:00:42.565931 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:42.565903    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf"]
Jul 20 23:00:42.729183 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:42.729147    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a040c8e-1bd8-4b53-bf55-45966d1cc844-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf\" (UID: \"4a040c8e-1bd8-4b53-bf55-45966d1cc844\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf"
Jul 20 23:00:42.837377 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:42.831440    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a040c8e-1bd8-4b53-bf55-45966d1cc844-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf\" (UID: \"4a040c8e-1bd8-4b53-bf55-45966d1cc844\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf"
Jul 20 23:00:42.837377 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:42.832481    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a040c8e-1bd8-4b53-bf55-45966d1cc844-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf\" (UID: \"4a040c8e-1bd8-4b53-bf55-45966d1cc844\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf"
Jul 20 23:00:42.872281 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:42.872240    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf"
Jul 20 23:00:43.217823 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:43.217796    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf"]
Jul 20 23:00:43.219808 ip-10-0-128-108 kubenswrapper[2579]: W0720 23:00:43.219782    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a040c8e_1bd8_4b53_bf55_45966d1cc844.slice/crio-4365aa6c90b0e8138335c04b8efa03733aef9c3984d5680ed5e0a5ecf959e6af WatchSource:0}: Error finding container 4365aa6c90b0e8138335c04b8efa03733aef9c3984d5680ed5e0a5ecf959e6af: Status 404 returned error can't find the container with id 4365aa6c90b0e8138335c04b8efa03733aef9c3984d5680ed5e0a5ecf959e6af
Jul 20 23:00:43.849290 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:43.849192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf" event={"ID":"4a040c8e-1bd8-4b53-bf55-45966d1cc844","Type":"ContainerStarted","Data":"4c162e8b7e6457783753d1e44438ba12e9f7173031bce1e6030535b17a388c15"}
Jul 20 23:00:43.849290 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:43.849249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf" event={"ID":"4a040c8e-1bd8-4b53-bf55-45966d1cc844","Type":"ContainerStarted","Data":"4365aa6c90b0e8138335c04b8efa03733aef9c3984d5680ed5e0a5ecf959e6af"}
Jul 20 23:00:43.865110 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:43.865047    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf" podStartSLOduration=1.865032805 podStartE2EDuration="1.865032805s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:00:43.862984794 +0000 UTC m=+2273.978369421" watchObservedRunningTime="2026-07-20 23:00:43.865032805 +0000 UTC m=+2273.980417431"
Jul 20 23:00:44.856512 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:44.856474    2579 generic.go:356] "Generic (PLEG): container finished" podID="4a040c8e-1bd8-4b53-bf55-45966d1cc844" containerID="4c162e8b7e6457783753d1e44438ba12e9f7173031bce1e6030535b17a388c15" exitCode=0
Jul 20 23:00:44.856977 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:44.856571    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf" event={"ID":"4a040c8e-1bd8-4b53-bf55-45966d1cc844","Type":"ContainerDied","Data":"4c162e8b7e6457783753d1e44438ba12e9f7173031bce1e6030535b17a388c15"}
Jul 20 23:00:45.625257 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:45.625216    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:00:46.000106 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:46.000080    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf"
Jul 20 23:00:46.060396 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:46.060335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a040c8e-1bd8-4b53-bf55-45966d1cc844-maas-api-service-ca\") pod \"4a040c8e-1bd8-4b53-bf55-45966d1cc844\" (UID: \"4a040c8e-1bd8-4b53-bf55-45966d1cc844\") "
Jul 20 23:00:46.060721 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:46.060701    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a040c8e-1bd8-4b53-bf55-45966d1cc844-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4a040c8e-1bd8-4b53-bf55-45966d1cc844" (UID: "4a040c8e-1bd8-4b53-bf55-45966d1cc844"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:00:46.161644 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:46.161604    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a040c8e-1bd8-4b53-bf55-45966d1cc844-maas-api-service-ca\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:00:46.868503 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:46.868466    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf" event={"ID":"4a040c8e-1bd8-4b53-bf55-45966d1cc844","Type":"ContainerDied","Data":"4365aa6c90b0e8138335c04b8efa03733aef9c3984d5680ed5e0a5ecf959e6af"}
Jul 20 23:00:46.868503 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:46.868500    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf"
Jul 20 23:00:46.868722 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:00:46.868521    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4365aa6c90b0e8138335c04b8efa03733aef9c3984d5680ed5e0a5ecf959e6af"
Jul 20 23:01:01.628592 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:01.628555    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:01:02.656082 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:02.656038    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf"]
Jul 20 23:01:02.659187 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:02.659155    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-402b6b-rvdzf"]
Jul 20 23:01:04.368752 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:04.368713    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a040c8e-1bd8-4b53-bf55-45966d1cc844" path="/var/lib/kubelet/pods/4a040c8e-1bd8-4b53-bf55-45966d1cc844/volumes"
Jul 20 23:01:09.532724 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:09.532689    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p"]
Jul 20 23:01:09.533213 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:09.533095    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a040c8e-1bd8-4b53-bf55-45966d1cc844" containerName="revoke-keys"
Jul 20 23:01:09.533213 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:09.533106    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a040c8e-1bd8-4b53-bf55-45966d1cc844" containerName="revoke-keys"
Jul 20 23:01:09.533213 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:09.533165    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a040c8e-1bd8-4b53-bf55-45966d1cc844" containerName="revoke-keys"
Jul 20 23:01:09.536576 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:09.536554    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p"
Jul 20 23:01:09.539116 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:09.539094    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mtrv\""
Jul 20 23:01:09.539251 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:09.539122    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 23:01:09.544694 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:09.544138    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p"]
Jul 20 23:01:09.685565 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:09.685529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c98f5a-9291-4fc3-b911-3145dc74f541-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p\" (UID: \"c4c98f5a-9291-4fc3-b911-3145dc74f541\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p"
Jul 20 23:01:09.786771 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:09.786679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c98f5a-9291-4fc3-b911-3145dc74f541-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p\" (UID: \"c4c98f5a-9291-4fc3-b911-3145dc74f541\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p"
Jul 20 23:01:09.787398 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:09.787378    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c98f5a-9291-4fc3-b911-3145dc74f541-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p\" (UID: \"c4c98f5a-9291-4fc3-b911-3145dc74f541\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p"
Jul 20 23:01:09.849391 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:09.849355    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p"
Jul 20 23:01:09.990368 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:09.990343    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p"]
Jul 20 23:01:09.992594 ip-10-0-128-108 kubenswrapper[2579]: W0720 23:01:09.992561    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c98f5a_9291_4fc3_b911_3145dc74f541.slice/crio-6320a766f7d1c8a7627bdc41a4bfcae21496e515640f4ccb6d4158ff621cc3cc WatchSource:0}: Error finding container 6320a766f7d1c8a7627bdc41a4bfcae21496e515640f4ccb6d4158ff621cc3cc: Status 404 returned error can't find the container with id 6320a766f7d1c8a7627bdc41a4bfcae21496e515640f4ccb6d4158ff621cc3cc
Jul 20 23:01:10.993420 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:10.993333    2579 generic.go:356] "Generic (PLEG): container finished" podID="c4c98f5a-9291-4fc3-b911-3145dc74f541" containerID="b1adfb6c29289e1d6bcbcca2a41187010bcf7e6a441ff5ca928b9eee929bc3d6" exitCode=0
Jul 20 23:01:10.993803 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:10.993473    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p" event={"ID":"c4c98f5a-9291-4fc3-b911-3145dc74f541","Type":"ContainerDied","Data":"b1adfb6c29289e1d6bcbcca2a41187010bcf7e6a441ff5ca928b9eee929bc3d6"}
Jul 20 23:01:10.993803 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:10.993526    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p" event={"ID":"c4c98f5a-9291-4fc3-b911-3145dc74f541","Type":"ContainerStarted","Data":"6320a766f7d1c8a7627bdc41a4bfcae21496e515640f4ccb6d4158ff621cc3cc"}
Jul 20 23:01:12.135860 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:12.135826    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p"
Jul 20 23:01:12.207713 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:12.207667    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c98f5a-9291-4fc3-b911-3145dc74f541-maas-api-service-ca\") pod \"c4c98f5a-9291-4fc3-b911-3145dc74f541\" (UID: \"c4c98f5a-9291-4fc3-b911-3145dc74f541\") "
Jul 20 23:01:12.208077 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:12.208053    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4c98f5a-9291-4fc3-b911-3145dc74f541-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c4c98f5a-9291-4fc3-b911-3145dc74f541" (UID: "c4c98f5a-9291-4fc3-b911-3145dc74f541"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:01:12.308817 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:12.308727    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c98f5a-9291-4fc3-b911-3145dc74f541-maas-api-service-ca\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:01:13.004678 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:13.004643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p" event={"ID":"c4c98f5a-9291-4fc3-b911-3145dc74f541","Type":"ContainerDied","Data":"6320a766f7d1c8a7627bdc41a4bfcae21496e515640f4ccb6d4158ff621cc3cc"}
Jul 20 23:01:13.004678 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:13.004681    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p"
Jul 20 23:01:13.004916 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:13.004693    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6320a766f7d1c8a7627bdc41a4bfcae21496e515640f4ccb6d4158ff621cc3cc"
Jul 20 23:01:29.616258 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:29.616221    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p"]
Jul 20 23:01:29.618311 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:29.618276    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-d1c09f-9lf4p"]
Jul 20 23:01:29.621590 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:29.621565    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:01:30.369208 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:30.369170    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4c98f5a-9291-4fc3-b911-3145dc74f541" path="/var/lib/kubelet/pods/c4c98f5a-9291-4fc3-b911-3145dc74f541/volumes"
Jul 20 23:01:44.648519 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:44.648430    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:01:54.433115 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:01:54.433076    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:02:04.927321 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:02:04.927264    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:02:23.216412 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:02:23.216371    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:02:40.521358 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:02:40.521319    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:02:55.020929 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:02:55.020888    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:03:14.727618 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:03:14.727526    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:03:30.220664 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:03:30.220626    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:03:49.329892 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:03:49.329852    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:04:08.928130 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:08.928090    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:04:26.122396 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:26.122352    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:04:36.519212 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:36.519171    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:04:40.304231 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.304196    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"]
Jul 20 23:04:40.304915 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.304893    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4c98f5a-9291-4fc3-b911-3145dc74f541" containerName="revoke-keys"
Jul 20 23:04:40.304960 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.304920    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4c98f5a-9291-4fc3-b911-3145dc74f541" containerName="revoke-keys"
Jul 20 23:04:40.305026 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.305015    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4c98f5a-9291-4fc3-b911-3145dc74f541" containerName="revoke-keys"
Jul 20 23:04:40.308611 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.308591    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.311086 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.311064    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bd5746\"/\"kube-root-ca.crt\""
Jul 20 23:04:40.311333 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.311296    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bd5746\"/\"default-dockercfg-g78bq\""
Jul 20 23:04:40.311432 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.311348    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-bd5746\"/\"openshift-service-ca.crt\""
Jul 20 23:04:40.311432 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.311348    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bd5746\"/\"sub-test-model-bd5746-kserve-self-signed-certs\""
Jul 20 23:04:40.316665 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.316643    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"]
Jul 20 23:04:40.388651 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.388621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-model-cache\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.388822 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.388756    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-home\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.388822 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.388807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-dshm\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.388912 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.388824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-tmp-dir\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.388912 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.388884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb82bb20-2d70-4cda-b4c0-438bd93d4128-tls-certs\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.388912 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.388907    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmdds\" (UniqueName: \"kubernetes.io/projected/fb82bb20-2d70-4cda-b4c0-438bd93d4128-kube-api-access-kmdds\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.490036 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.489993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-dshm\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.490036 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.490035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-tmp-dir\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.490274 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.490073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb82bb20-2d70-4cda-b4c0-438bd93d4128-tls-certs\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.490274 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.490096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmdds\" (UniqueName: \"kubernetes.io/projected/fb82bb20-2d70-4cda-b4c0-438bd93d4128-kube-api-access-kmdds\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.490274 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.490115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-model-cache\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.490274 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.490229    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-home\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.490562 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.490539    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-tmp-dir\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.490626 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.490596    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-home\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.490687 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.490642    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-model-cache\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.492982 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.492954    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-dshm\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.493128 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.493111    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb82bb20-2d70-4cda-b4c0-438bd93d4128-tls-certs\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.499081 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.499056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmdds\" (UniqueName: \"kubernetes.io/projected/fb82bb20-2d70-4cda-b4c0-438bd93d4128-kube-api-access-kmdds\") pod \"sub-test-model-bd5746-kserve-74f8df55d7-sksvp\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") " pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.619517 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.619474    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:40.762339 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:40.762288    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"]
Jul 20 23:04:40.764909 ip-10-0-128-108 kubenswrapper[2579]: W0720 23:04:40.764881    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb82bb20_2d70_4cda_b4c0_438bd93d4128.slice/crio-5b9e2b2327cdfe5f27bb643cd943fc81044084aed6204be018aaa2c9befa2304 WatchSource:0}: Error finding container 5b9e2b2327cdfe5f27bb643cd943fc81044084aed6204be018aaa2c9befa2304: Status 404 returned error can't find the container with id 5b9e2b2327cdfe5f27bb643cd943fc81044084aed6204be018aaa2c9befa2304
Jul 20 23:04:41.107631 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:41.107593    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp" event={"ID":"fb82bb20-2d70-4cda-b4c0-438bd93d4128","Type":"ContainerStarted","Data":"08a00794ea4fec0d5999d9de2682f0f245ee06e2a264a36df47594050d959291"}
Jul 20 23:04:41.107828 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:41.107643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp" event={"ID":"fb82bb20-2d70-4cda-b4c0-438bd93d4128","Type":"ContainerStarted","Data":"5b9e2b2327cdfe5f27bb643cd943fc81044084aed6204be018aaa2c9befa2304"}
Jul 20 23:04:41.127794 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:41.127737    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp" podStartSLOduration=1.127720636 podStartE2EDuration="1.127720636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:04:41.125610058 +0000 UTC m=+2511.240994686" watchObservedRunningTime="2026-07-20 23:04:41.127720636 +0000 UTC m=+2511.243105263"
Jul 20 23:04:43.819457 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:43.819423    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:04:50.620076 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:50.620038    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:50.620527 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:50.620094    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:50.632848 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:50.632820    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:04:51.175277 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:04:51.175249    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:05:18.028180 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:05:18.028143    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:05:36.024710 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:05:36.024676    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:05:50.219958 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:05:50.219920    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:05:50.599324 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:05:50.599215    2579 scope.go:117] "RemoveContainer" containerID="3a81553daef0b8e036f06572fb10f9e00bff12452dc16b2a52ddea942c14b167"
Jul 20 23:05:55.900859 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:05:55.900817    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"]
Jul 20 23:06:06.960088 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:06.960046    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:06:08.700040 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.700000    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"]
Jul 20 23:06:08.703787 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.703760    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.706215 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.706192    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-bd5746\"/\"rate-test-model-bd5746-kserve-self-signed-certs\""
Jul 20 23:06:08.722016 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.721891    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"]
Jul 20 23:06:08.788725 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.788678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-home\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.788725 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.788731    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b65ffa7-f58b-4b41-9151-7f2c701352e6-tls-certs\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.788992 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.788807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-model-cache\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.788992 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.788847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-tmp-dir\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.788992 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.788869    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-dshm\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.788992 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.788929    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mngdw\" (UniqueName: \"kubernetes.io/projected/7b65ffa7-f58b-4b41-9151-7f2c701352e6-kube-api-access-mngdw\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.890456 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.890419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-home\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.890456 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.890466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b65ffa7-f58b-4b41-9151-7f2c701352e6-tls-certs\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.890755 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.890494    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-model-cache\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.890755 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.890519    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-tmp-dir\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.890755 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.890550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-dshm\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.890755 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.890632    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mngdw\" (UniqueName: \"kubernetes.io/projected/7b65ffa7-f58b-4b41-9151-7f2c701352e6-kube-api-access-mngdw\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.890976 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.890912    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-home\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.890976 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.890962    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-model-cache\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.891057 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.891007    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-tmp-dir\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.892952 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.892923    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-dshm\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.893070 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.893047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b65ffa7-f58b-4b41-9151-7f2c701352e6-tls-certs\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:08.899215 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:08.899187    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mngdw\" (UniqueName: \"kubernetes.io/projected/7b65ffa7-f58b-4b41-9151-7f2c701352e6-kube-api-access-mngdw\") pod \"rate-test-model-bd5746-kserve-86f76b664c-vg6q4\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") " pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:09.026024 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:09.025928    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:09.169023 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:09.168994    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"]
Jul 20 23:06:09.171102 ip-10-0-128-108 kubenswrapper[2579]: W0720 23:06:09.171067    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b65ffa7_f58b_4b41_9151_7f2c701352e6.slice/crio-28b086050dc26a548949e492a677d214c0280dc6bd4805c03a31126b66cadbdd WatchSource:0}: Error finding container 28b086050dc26a548949e492a677d214c0280dc6bd4805c03a31126b66cadbdd: Status 404 returned error can't find the container with id 28b086050dc26a548949e492a677d214c0280dc6bd4805c03a31126b66cadbdd
Jul 20 23:06:09.576273 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:09.576231    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4" event={"ID":"7b65ffa7-f58b-4b41-9151-7f2c701352e6","Type":"ContainerStarted","Data":"a5547c75b29348cc0c7e9feda97b76358ba1c5f8d2fb6184bb0064049b5ef46f"}
Jul 20 23:06:09.576475 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:09.576282    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4" event={"ID":"7b65ffa7-f58b-4b41-9151-7f2c701352e6","Type":"ContainerStarted","Data":"28b086050dc26a548949e492a677d214c0280dc6bd4805c03a31126b66cadbdd"}
Jul 20 23:06:09.594942 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:09.594888    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4" podStartSLOduration=1.594871669 podStartE2EDuration="1.594871669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 23:06:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:06:09.593358566 +0000 UTC m=+2599.708743192" watchObservedRunningTime="2026-07-20 23:06:09.594871669 +0000 UTC m=+2599.710256310"
Jul 20 23:06:10.925389 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:10.925341    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp" podUID="fb82bb20-2d70-4cda-b4c0-438bd93d4128" containerName="main" containerID="cri-o://08a00794ea4fec0d5999d9de2682f0f245ee06e2a264a36df47594050d959291" gracePeriod=45
Jul 20 23:06:11.194235 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.194204    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:06:11.312552 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.312518    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmdds\" (UniqueName: \"kubernetes.io/projected/fb82bb20-2d70-4cda-b4c0-438bd93d4128-kube-api-access-kmdds\") pod \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") "
Jul 20 23:06:11.312758 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.312605    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb82bb20-2d70-4cda-b4c0-438bd93d4128-tls-certs\") pod \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") "
Jul 20 23:06:11.312758 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.312644    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-dshm\") pod \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") "
Jul 20 23:06:11.312758 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.312735    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-home\") pod \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") "
Jul 20 23:06:11.312943 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.312781    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-model-cache\") pod \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") "
Jul 20 23:06:11.312943 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.312808    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-tmp-dir\") pod \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\" (UID: \"fb82bb20-2d70-4cda-b4c0-438bd93d4128\") "
Jul 20 23:06:11.313076 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.313035    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb82bb20-2d70-4cda-b4c0-438bd93d4128" (UID: "fb82bb20-2d70-4cda-b4c0-438bd93d4128"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:06:11.313136 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.313073    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-home" (OuterVolumeSpecName: "home") pod "fb82bb20-2d70-4cda-b4c0-438bd93d4128" (UID: "fb82bb20-2d70-4cda-b4c0-438bd93d4128"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:06:11.313136 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.313112    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb82bb20-2d70-4cda-b4c0-438bd93d4128" (UID: "fb82bb20-2d70-4cda-b4c0-438bd93d4128"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:06:11.313234 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.313157    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-model-cache\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:06:11.315004 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.314973    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-dshm" (OuterVolumeSpecName: "dshm") pod "fb82bb20-2d70-4cda-b4c0-438bd93d4128" (UID: "fb82bb20-2d70-4cda-b4c0-438bd93d4128"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:06:11.315125 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.315024    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb82bb20-2d70-4cda-b4c0-438bd93d4128-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb82bb20-2d70-4cda-b4c0-438bd93d4128" (UID: "fb82bb20-2d70-4cda-b4c0-438bd93d4128"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:06:11.315125 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.315035    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb82bb20-2d70-4cda-b4c0-438bd93d4128-kube-api-access-kmdds" (OuterVolumeSpecName: "kube-api-access-kmdds") pod "fb82bb20-2d70-4cda-b4c0-438bd93d4128" (UID: "fb82bb20-2d70-4cda-b4c0-438bd93d4128"). InnerVolumeSpecName "kube-api-access-kmdds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:06:11.413726 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.413687    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-home\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:06:11.413726 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.413715    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-tmp-dir\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:06:11.413726 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.413725    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmdds\" (UniqueName: \"kubernetes.io/projected/fb82bb20-2d70-4cda-b4c0-438bd93d4128-kube-api-access-kmdds\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:06:11.413726 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.413736    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb82bb20-2d70-4cda-b4c0-438bd93d4128-tls-certs\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:06:11.414085 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.413745    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb82bb20-2d70-4cda-b4c0-438bd93d4128-dshm\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:06:11.587588 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.587469    2579 generic.go:356] "Generic (PLEG): container finished" podID="fb82bb20-2d70-4cda-b4c0-438bd93d4128" containerID="08a00794ea4fec0d5999d9de2682f0f245ee06e2a264a36df47594050d959291" exitCode=0
Jul 20 23:06:11.587588 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.587509    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"
Jul 20 23:06:11.587588 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.587546    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp" event={"ID":"fb82bb20-2d70-4cda-b4c0-438bd93d4128","Type":"ContainerDied","Data":"08a00794ea4fec0d5999d9de2682f0f245ee06e2a264a36df47594050d959291"}
Jul 20 23:06:11.587588 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.587588    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp" event={"ID":"fb82bb20-2d70-4cda-b4c0-438bd93d4128","Type":"ContainerDied","Data":"5b9e2b2327cdfe5f27bb643cd943fc81044084aed6204be018aaa2c9befa2304"}
Jul 20 23:06:11.587868 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.587608    2579 scope.go:117] "RemoveContainer" containerID="08a00794ea4fec0d5999d9de2682f0f245ee06e2a264a36df47594050d959291"
Jul 20 23:06:11.597136 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.597114    2579 scope.go:117] "RemoveContainer" containerID="08a00794ea4fec0d5999d9de2682f0f245ee06e2a264a36df47594050d959291"
Jul 20 23:06:11.597449 ip-10-0-128-108 kubenswrapper[2579]: E0720 23:06:11.597429    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08a00794ea4fec0d5999d9de2682f0f245ee06e2a264a36df47594050d959291\": container with ID starting with 08a00794ea4fec0d5999d9de2682f0f245ee06e2a264a36df47594050d959291 not found: ID does not exist" containerID="08a00794ea4fec0d5999d9de2682f0f245ee06e2a264a36df47594050d959291"
Jul 20 23:06:11.597505 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.597457    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08a00794ea4fec0d5999d9de2682f0f245ee06e2a264a36df47594050d959291"} err="failed to get container status \"08a00794ea4fec0d5999d9de2682f0f245ee06e2a264a36df47594050d959291\": rpc error: code = NotFound desc = could not find container \"08a00794ea4fec0d5999d9de2682f0f245ee06e2a264a36df47594050d959291\": container with ID starting with 08a00794ea4fec0d5999d9de2682f0f245ee06e2a264a36df47594050d959291 not found: ID does not exist"
Jul 20 23:06:11.608350 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.608317    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"]
Jul 20 23:06:11.614645 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:11.614609    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp"]
Jul 20 23:06:12.368733 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:12.368701    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb82bb20-2d70-4cda-b4c0-438bd93d4128" path="/var/lib/kubelet/pods/fb82bb20-2d70-4cda-b4c0-438bd93d4128/volumes"
Jul 20 23:06:16.164557 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:16.164501    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-bd5746/sub-test-model-bd5746-kserve-74f8df55d7-sksvp" podUID="fb82bb20-2d70-4cda-b4c0-438bd93d4128" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 20 23:06:16.615153 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:16.615119    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:06:19.026630 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:19.026588    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:19.027044 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:19.026647    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:19.039320 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:19.039266    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:19.643365 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:19.643335    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:06:38.325273 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:38.325230    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:06:50.618965 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:50.618930    2579 scope.go:117] "RemoveContainer" containerID="4c162e8b7e6457783753d1e44438ba12e9f7173031bce1e6030535b17a388c15"
Jul 20 23:06:50.627562 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:50.627535    2579 scope.go:117] "RemoveContainer" containerID="81e3250cf3ec66f3eeb8f863e484d492e61883b6849543d9d0f874a3a00cbf2b"
Jul 20 23:06:56.218013 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:06:56.217968    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:07:11.718700 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:11.718657    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:07:20.501888 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:20.501852    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"]
Jul 20 23:07:22.559609 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:22.559572    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7410-140008228619824"]
Jul 20 23:07:22.559988 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:22.559972    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb82bb20-2d70-4cda-b4c0-438bd93d4128" containerName="main"
Jul 20 23:07:22.559988 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:22.559985    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb82bb20-2d70-4cda-b4c0-438bd93d4128" containerName="main"
Jul 20 23:07:22.560065 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:22.560058    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb82bb20-2d70-4cda-b4c0-438bd93d4128" containerName="main"
Jul 20 23:07:22.563361 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:22.563342    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228619824"
Jul 20 23:07:22.565687 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:22.565658    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-grsb4\""
Jul 20 23:07:22.567152 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:22.567128    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7410-140008228619824"]
Jul 20 23:07:22.687528 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:22.687489    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t29p7\" (UniqueName: \"kubernetes.io/projected/d7cec1d7-ea21-4909-81fa-1a391b27178d-kube-api-access-t29p7\") pod \"test-curl-7410-140008228619824\" (UID: \"d7cec1d7-ea21-4909-81fa-1a391b27178d\") " pod="opendatahub/test-curl-7410-140008228619824"
Jul 20 23:07:22.789264 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:22.789226    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t29p7\" (UniqueName: \"kubernetes.io/projected/d7cec1d7-ea21-4909-81fa-1a391b27178d-kube-api-access-t29p7\") pod \"test-curl-7410-140008228619824\" (UID: \"d7cec1d7-ea21-4909-81fa-1a391b27178d\") " pod="opendatahub/test-curl-7410-140008228619824"
Jul 20 23:07:22.798966 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:22.798931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t29p7\" (UniqueName: \"kubernetes.io/projected/d7cec1d7-ea21-4909-81fa-1a391b27178d-kube-api-access-t29p7\") pod \"test-curl-7410-140008228619824\" (UID: \"d7cec1d7-ea21-4909-81fa-1a391b27178d\") " pod="opendatahub/test-curl-7410-140008228619824"
Jul 20 23:07:22.873489 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:22.873448    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228619824"
Jul 20 23:07:23.009937 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:23.009907    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7410-140008228619824"]
Jul 20 23:07:23.012104 ip-10-0-128-108 kubenswrapper[2579]: W0720 23:07:23.012074    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7cec1d7_ea21_4909_81fa_1a391b27178d.slice/crio-b615c391f71b01b2eee197f0e0461265b81dcb2068999b0431a17169ac1755b4 WatchSource:0}: Error finding container b615c391f71b01b2eee197f0e0461265b81dcb2068999b0431a17169ac1755b4: Status 404 returned error can't find the container with id b615c391f71b01b2eee197f0e0461265b81dcb2068999b0431a17169ac1755b4
Jul 20 23:07:23.013424 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:23.013406    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 23:07:23.967781 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:23.967685    2579 generic.go:356] "Generic (PLEG): container finished" podID="d7cec1d7-ea21-4909-81fa-1a391b27178d" containerID="47fd95ba2ba2bd05191ead806d8e68dd6ff89b1cd514e54d53fe4711de1f2cec" exitCode=0
Jul 20 23:07:23.968181 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:23.967781    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7410-140008228619824" event={"ID":"d7cec1d7-ea21-4909-81fa-1a391b27178d","Type":"ContainerDied","Data":"47fd95ba2ba2bd05191ead806d8e68dd6ff89b1cd514e54d53fe4711de1f2cec"}
Jul 20 23:07:23.968181 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:23.967838    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7410-140008228619824" event={"ID":"d7cec1d7-ea21-4909-81fa-1a391b27178d","Type":"ContainerStarted","Data":"b615c391f71b01b2eee197f0e0461265b81dcb2068999b0431a17169ac1755b4"}
Jul 20 23:07:25.114942 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:25.114901    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228619824"
Jul 20 23:07:25.149943 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:25.149911    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7410-140008228619824_d7cec1d7-ea21-4909-81fa-1a391b27178d/test-curl-7410-140008228619824/0.log"
Jul 20 23:07:25.173495 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:25.173454    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7410-140008228619824"]
Jul 20 23:07:25.176985 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:25.176950    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7410-140008228619824"]
Jul 20 23:07:25.212667 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:25.212637    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t29p7\" (UniqueName: \"kubernetes.io/projected/d7cec1d7-ea21-4909-81fa-1a391b27178d-kube-api-access-t29p7\") pod \"d7cec1d7-ea21-4909-81fa-1a391b27178d\" (UID: \"d7cec1d7-ea21-4909-81fa-1a391b27178d\") "
Jul 20 23:07:25.214783 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:25.214758    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7cec1d7-ea21-4909-81fa-1a391b27178d-kube-api-access-t29p7" (OuterVolumeSpecName: "kube-api-access-t29p7") pod "d7cec1d7-ea21-4909-81fa-1a391b27178d" (UID: "d7cec1d7-ea21-4909-81fa-1a391b27178d"). InnerVolumeSpecName "kube-api-access-t29p7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:07:25.313448 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:25.313362    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t29p7\" (UniqueName: \"kubernetes.io/projected/d7cec1d7-ea21-4909-81fa-1a391b27178d-kube-api-access-t29p7\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:07:25.979644 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:25.979617    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228619824"
Jul 20 23:07:25.979644 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:25.979635    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b615c391f71b01b2eee197f0e0461265b81dcb2068999b0431a17169ac1755b4"
Jul 20 23:07:25.989427 ip-10-0-128-108 kubenswrapper[2579]: E0720 23:07:25.989391    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7410-140008228619824\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="d7cec1d7-ea21-4909-81fa-1a391b27178d" pod="opendatahub/test-curl-7410-140008228619824"
Jul 20 23:07:26.374198 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:26.374162    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7cec1d7-ea21-4909-81fa-1a391b27178d" path="/var/lib/kubelet/pods/d7cec1d7-ea21-4909-81fa-1a391b27178d/volumes"
Jul 20 23:07:27.632577 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:27.632543    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:07:35.522780 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.522735    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4" podUID="7b65ffa7-f58b-4b41-9151-7f2c701352e6" containerName="main" containerID="cri-o://a5547c75b29348cc0c7e9feda97b76358ba1c5f8d2fb6184bb0064049b5ef46f" gracePeriod=45
Jul 20 23:07:35.778859 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.778788    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:07:35.806654 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.806620    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-tmp-dir\") pod \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") "
Jul 20 23:07:35.806851 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.806670    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-model-cache\") pod \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") "
Jul 20 23:07:35.806851 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.806711    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-dshm\") pod \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") "
Jul 20 23:07:35.806851 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.806750    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mngdw\" (UniqueName: \"kubernetes.io/projected/7b65ffa7-f58b-4b41-9151-7f2c701352e6-kube-api-access-mngdw\") pod \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") "
Jul 20 23:07:35.806851 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.806782    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-home\") pod \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") "
Jul 20 23:07:35.807080 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.806885    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7b65ffa7-f58b-4b41-9151-7f2c701352e6" (UID: "7b65ffa7-f58b-4b41-9151-7f2c701352e6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:07:35.807080 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.806900    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b65ffa7-f58b-4b41-9151-7f2c701352e6-tls-certs\") pod \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\" (UID: \"7b65ffa7-f58b-4b41-9151-7f2c701352e6\") "
Jul 20 23:07:35.807080 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.806948    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-model-cache" (OuterVolumeSpecName: "model-cache") pod "7b65ffa7-f58b-4b41-9151-7f2c701352e6" (UID: "7b65ffa7-f58b-4b41-9151-7f2c701352e6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:07:35.807242 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.807104    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-home" (OuterVolumeSpecName: "home") pod "7b65ffa7-f58b-4b41-9151-7f2c701352e6" (UID: "7b65ffa7-f58b-4b41-9151-7f2c701352e6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:07:35.807283 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.807258    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-home\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:07:35.807283 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.807275    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-tmp-dir\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:07:35.807388 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.807289    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-model-cache\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:07:35.808850 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.808821    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-dshm" (OuterVolumeSpecName: "dshm") pod "7b65ffa7-f58b-4b41-9151-7f2c701352e6" (UID: "7b65ffa7-f58b-4b41-9151-7f2c701352e6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 23:07:35.808957 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.808926    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b65ffa7-f58b-4b41-9151-7f2c701352e6-kube-api-access-mngdw" (OuterVolumeSpecName: "kube-api-access-mngdw") pod "7b65ffa7-f58b-4b41-9151-7f2c701352e6" (UID: "7b65ffa7-f58b-4b41-9151-7f2c701352e6"). InnerVolumeSpecName "kube-api-access-mngdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:07:35.809278 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.809263    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b65ffa7-f58b-4b41-9151-7f2c701352e6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7b65ffa7-f58b-4b41-9151-7f2c701352e6" (UID: "7b65ffa7-f58b-4b41-9151-7f2c701352e6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 23:07:35.908472 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.908424    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mngdw\" (UniqueName: \"kubernetes.io/projected/7b65ffa7-f58b-4b41-9151-7f2c701352e6-kube-api-access-mngdw\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:07:35.908472 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.908466    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b65ffa7-f58b-4b41-9151-7f2c701352e6-tls-certs\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:07:35.908472 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:35.908476    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b65ffa7-f58b-4b41-9151-7f2c701352e6-dshm\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:07:36.031442 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.031341    2579 generic.go:356] "Generic (PLEG): container finished" podID="7b65ffa7-f58b-4b41-9151-7f2c701352e6" containerID="a5547c75b29348cc0c7e9feda97b76358ba1c5f8d2fb6184bb0064049b5ef46f" exitCode=0
Jul 20 23:07:36.031442 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.031389    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"
Jul 20 23:07:36.031649 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.031430    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4" event={"ID":"7b65ffa7-f58b-4b41-9151-7f2c701352e6","Type":"ContainerDied","Data":"a5547c75b29348cc0c7e9feda97b76358ba1c5f8d2fb6184bb0064049b5ef46f"}
Jul 20 23:07:36.031649 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.031480    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4" event={"ID":"7b65ffa7-f58b-4b41-9151-7f2c701352e6","Type":"ContainerDied","Data":"28b086050dc26a548949e492a677d214c0280dc6bd4805c03a31126b66cadbdd"}
Jul 20 23:07:36.031649 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.031501    2579 scope.go:117] "RemoveContainer" containerID="a5547c75b29348cc0c7e9feda97b76358ba1c5f8d2fb6184bb0064049b5ef46f"
Jul 20 23:07:36.040660 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.040641    2579 scope.go:117] "RemoveContainer" containerID="a5547c75b29348cc0c7e9feda97b76358ba1c5f8d2fb6184bb0064049b5ef46f"
Jul 20 23:07:36.040949 ip-10-0-128-108 kubenswrapper[2579]: E0720 23:07:36.040931    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5547c75b29348cc0c7e9feda97b76358ba1c5f8d2fb6184bb0064049b5ef46f\": container with ID starting with a5547c75b29348cc0c7e9feda97b76358ba1c5f8d2fb6184bb0064049b5ef46f not found: ID does not exist" containerID="a5547c75b29348cc0c7e9feda97b76358ba1c5f8d2fb6184bb0064049b5ef46f"
Jul 20 23:07:36.041000 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.040956    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5547c75b29348cc0c7e9feda97b76358ba1c5f8d2fb6184bb0064049b5ef46f"} err="failed to get container status \"a5547c75b29348cc0c7e9feda97b76358ba1c5f8d2fb6184bb0064049b5ef46f\": rpc error: code = NotFound desc = could not find container \"a5547c75b29348cc0c7e9feda97b76358ba1c5f8d2fb6184bb0064049b5ef46f\": container with ID starting with a5547c75b29348cc0c7e9feda97b76358ba1c5f8d2fb6184bb0064049b5ef46f not found: ID does not exist"
Jul 20 23:07:36.053627 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.053596    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"]
Jul 20 23:07:36.061621 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.061590    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-bd5746/rate-test-model-bd5746-kserve-86f76b664c-vg6q4"]
Jul 20 23:07:36.368726 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.368689    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b65ffa7-f58b-4b41-9151-7f2c701352e6" path="/var/lib/kubelet/pods/7b65ffa7-f58b-4b41-9151-7f2c701352e6/volumes"
Jul 20 23:07:36.442448 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.442409    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7410-140008228717600"]
Jul 20 23:07:36.442813 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.442801    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b65ffa7-f58b-4b41-9151-7f2c701352e6" containerName="main"
Jul 20 23:07:36.442857 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.442815    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b65ffa7-f58b-4b41-9151-7f2c701352e6" containerName="main"
Jul 20 23:07:36.442857 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.442833    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7cec1d7-ea21-4909-81fa-1a391b27178d" containerName="test-curl-7410-140008228619824"
Jul 20 23:07:36.442857 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.442840    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7cec1d7-ea21-4909-81fa-1a391b27178d" containerName="test-curl-7410-140008228619824"
Jul 20 23:07:36.442955 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.442907    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b65ffa7-f58b-4b41-9151-7f2c701352e6" containerName="main"
Jul 20 23:07:36.442955 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.442916    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7cec1d7-ea21-4909-81fa-1a391b27178d" containerName="test-curl-7410-140008228619824"
Jul 20 23:07:36.447151 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.447133    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:36.449617 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.449598    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-grsb4\""
Jul 20 23:07:36.452696 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.452672    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7410-140008228717600"]
Jul 20 23:07:36.514668 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.514623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t7z7\" (UniqueName: \"kubernetes.io/projected/d272a502-de2b-4f48-916d-eb21d35d50cc-kube-api-access-8t7z7\") pod \"test-curl-7410-140008228717600\" (UID: \"d272a502-de2b-4f48-916d-eb21d35d50cc\") " pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:36.615315 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.615266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t7z7\" (UniqueName: \"kubernetes.io/projected/d272a502-de2b-4f48-916d-eb21d35d50cc-kube-api-access-8t7z7\") pod \"test-curl-7410-140008228717600\" (UID: \"d272a502-de2b-4f48-916d-eb21d35d50cc\") " pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:36.625327 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.625237    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t7z7\" (UniqueName: \"kubernetes.io/projected/d272a502-de2b-4f48-916d-eb21d35d50cc-kube-api-access-8t7z7\") pod \"test-curl-7410-140008228717600\" (UID: \"d272a502-de2b-4f48-916d-eb21d35d50cc\") " pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:36.758543 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.758506    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:36.897291 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:36.897265    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7410-140008228717600"]
Jul 20 23:07:36.899659 ip-10-0-128-108 kubenswrapper[2579]: W0720 23:07:36.899631    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd272a502_de2b_4f48_916d_eb21d35d50cc.slice/crio-4d133967c378f62ee833b99be5a5931a247303a8799b4931f9f20698772752c1 WatchSource:0}: Error finding container 4d133967c378f62ee833b99be5a5931a247303a8799b4931f9f20698772752c1: Status 404 returned error can't find the container with id 4d133967c378f62ee833b99be5a5931a247303a8799b4931f9f20698772752c1
Jul 20 23:07:37.039103 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:37.039069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7410-140008228717600" event={"ID":"d272a502-de2b-4f48-916d-eb21d35d50cc","Type":"ContainerStarted","Data":"4d133967c378f62ee833b99be5a5931a247303a8799b4931f9f20698772752c1"}
Jul 20 23:07:38.045591 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:38.045507    2579 generic.go:356] "Generic (PLEG): container finished" podID="d272a502-de2b-4f48-916d-eb21d35d50cc" containerID="106ee0dfaf78b9585053cf39c9d43b489e991bad39177ea259fa7766ad12b009" exitCode=0
Jul 20 23:07:38.046039 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:38.045590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7410-140008228717600" event={"ID":"d272a502-de2b-4f48-916d-eb21d35d50cc","Type":"ContainerDied","Data":"106ee0dfaf78b9585053cf39c9d43b489e991bad39177ea259fa7766ad12b009"}
Jul 20 23:07:39.189559 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.189526    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:39.210614 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.210584    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7410-140008228717600_d272a502-de2b-4f48-916d-eb21d35d50cc/test-curl-7410-140008228717600/0.log"
Jul 20 23:07:39.236705 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.236669    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7410-140008228717600"]
Jul 20 23:07:39.238512 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.238485    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7410-140008228717600"]
Jul 20 23:07:39.240275 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.240253    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t7z7\" (UniqueName: \"kubernetes.io/projected/d272a502-de2b-4f48-916d-eb21d35d50cc-kube-api-access-8t7z7\") pod \"d272a502-de2b-4f48-916d-eb21d35d50cc\" (UID: \"d272a502-de2b-4f48-916d-eb21d35d50cc\") "
Jul 20 23:07:39.242361 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.242326    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d272a502-de2b-4f48-916d-eb21d35d50cc-kube-api-access-8t7z7" (OuterVolumeSpecName: "kube-api-access-8t7z7") pod "d272a502-de2b-4f48-916d-eb21d35d50cc" (UID: "d272a502-de2b-4f48-916d-eb21d35d50cc"). InnerVolumeSpecName "kube-api-access-8t7z7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 23:07:39.341213 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.341124    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t7z7\" (UniqueName: \"kubernetes.io/projected/d272a502-de2b-4f48-916d-eb21d35d50cc-kube-api-access-8t7z7\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:07:39.423507 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.423465    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq"]
Jul 20 23:07:39.423987 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.423968    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d272a502-de2b-4f48-916d-eb21d35d50cc" containerName="test-curl-7410-140008228717600"
Jul 20 23:07:39.424083 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.423988    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d272a502-de2b-4f48-916d-eb21d35d50cc" containerName="test-curl-7410-140008228717600"
Jul 20 23:07:39.424145 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.424086    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d272a502-de2b-4f48-916d-eb21d35d50cc" containerName="test-curl-7410-140008228717600"
Jul 20 23:07:39.427235 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.427212    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq"
Jul 20 23:07:39.429530 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.429506    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-2mtrv\""
Jul 20 23:07:39.429634 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.429559    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 23:07:39.435024 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.434664    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq"]
Jul 20 23:07:39.442255 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.442224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08f4aed-b923-4bda-b433-41667095a0f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq\" (UID: \"b08f4aed-b923-4bda-b433-41667095a0f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq"
Jul 20 23:07:39.543019 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.542976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08f4aed-b923-4bda-b433-41667095a0f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq\" (UID: \"b08f4aed-b923-4bda-b433-41667095a0f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq"
Jul 20 23:07:39.543684 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.543662    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08f4aed-b923-4bda-b433-41667095a0f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq\" (UID: \"b08f4aed-b923-4bda-b433-41667095a0f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq"
Jul 20 23:07:39.739357 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.739284    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq"
Jul 20 23:07:39.881028 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:39.881001    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq"]
Jul 20 23:07:39.883628 ip-10-0-128-108 kubenswrapper[2579]: W0720 23:07:39.883595    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb08f4aed_b923_4bda_b433_41667095a0f4.slice/crio-6060c639eed180ec100ba7198697860f51995cf22c02f8babaf4feb5afb3a38a WatchSource:0}: Error finding container 6060c639eed180ec100ba7198697860f51995cf22c02f8babaf4feb5afb3a38a: Status 404 returned error can't find the container with id 6060c639eed180ec100ba7198697860f51995cf22c02f8babaf4feb5afb3a38a
Jul 20 23:07:40.057887 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:40.057848    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq" event={"ID":"b08f4aed-b923-4bda-b433-41667095a0f4","Type":"ContainerStarted","Data":"6060c639eed180ec100ba7198697860f51995cf22c02f8babaf4feb5afb3a38a"}
Jul 20 23:07:40.059080 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:40.059059    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:40.059193 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:40.059066    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d133967c378f62ee833b99be5a5931a247303a8799b4931f9f20698772752c1"
Jul 20 23:07:40.069067 ip-10-0-128-108 kubenswrapper[2579]: E0720 23:07:40.069035    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7410-140008228717600\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="d272a502-de2b-4f48-916d-eb21d35d50cc" pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:40.367191 ip-10-0-128-108 kubenswrapper[2579]: E0720 23:07:40.367153    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7410-140008228717600\" is forbidden: User \"system:node:ip-10-0-128-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-108.ec2.internal' and this object" podUID="d272a502-de2b-4f48-916d-eb21d35d50cc" pod="opendatahub/test-curl-7410-140008228717600"
Jul 20 23:07:40.369372 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:40.369350    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d272a502-de2b-4f48-916d-eb21d35d50cc" path="/var/lib/kubelet/pods/d272a502-de2b-4f48-916d-eb21d35d50cc/volumes"
Jul 20 23:07:41.066456 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:41.066423    2579 generic.go:356] "Generic (PLEG): container finished" podID="b08f4aed-b923-4bda-b433-41667095a0f4" containerID="9141ebcce6fb7638da2354ca7971eb3a7f4ef306cbf7fcd2da911da571fe3ae0" exitCode=0
Jul 20 23:07:41.066632 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:41.066474    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq" event={"ID":"b08f4aed-b923-4bda-b433-41667095a0f4","Type":"ContainerDied","Data":"9141ebcce6fb7638da2354ca7971eb3a7f4ef306cbf7fcd2da911da571fe3ae0"}
Jul 20 23:07:42.211114 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:42.211088    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq"
Jul 20 23:07:42.269037 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:42.268998    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08f4aed-b923-4bda-b433-41667095a0f4-maas-api-service-ca\") pod \"b08f4aed-b923-4bda-b433-41667095a0f4\" (UID: \"b08f4aed-b923-4bda-b433-41667095a0f4\") "
Jul 20 23:07:42.269470 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:42.269449    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b08f4aed-b923-4bda-b433-41667095a0f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b08f4aed-b923-4bda-b433-41667095a0f4" (UID: "b08f4aed-b923-4bda-b433-41667095a0f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 23:07:42.369929 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:42.369897    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b08f4aed-b923-4bda-b433-41667095a0f4-maas-api-service-ca\") on node \"ip-10-0-128-108.ec2.internal\" DevicePath \"\""
Jul 20 23:07:43.077950 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:43.077912    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq"
Jul 20 23:07:43.078134 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:43.077948    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq" event={"ID":"b08f4aed-b923-4bda-b433-41667095a0f4","Type":"ContainerDied","Data":"6060c639eed180ec100ba7198697860f51995cf22c02f8babaf4feb5afb3a38a"}
Jul 20 23:07:43.078134 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:43.078002    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6060c639eed180ec100ba7198697860f51995cf22c02f8babaf4feb5afb3a38a"
Jul 20 23:07:50.654602 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:50.654567    2579 scope.go:117] "RemoveContainer" containerID="b1adfb6c29289e1d6bcbcca2a41187010bcf7e6a441ff5ca928b9eee929bc3d6"
Jul 20 23:07:52.721673 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:52.721626    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:07:54.516602 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:54.516563    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq"]
Jul 20 23:07:54.519112 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:54.519090    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-bd5746-sghqq"]
Jul 20 23:07:56.369206 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:07:56.369170    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b08f4aed-b923-4bda-b433-41667095a0f4" path="/var/lib/kubelet/pods/b08f4aed-b923-4bda-b433-41667095a0f4/volumes"
Jul 20 23:08:14.921193 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:14.921149    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-n25z2"]
Jul 20 23:08:29.924814 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:29.924780    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fm2m9_12660b54-505b-41be-8c58-8b5467f28ace/manager/0.log"
Jul 20 23:08:30.041647 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:30.041617    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85679cb5b4-bgznw_4e6cc3bb-4961-40db-baab-2f06605c6e9c/manager/0.log"
Jul 20 23:08:30.155058 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:30.155031    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5rf4f_a70b5f3a-7c00-41f2-8dab-3ec7c0f36879/server/0.log"
Jul 20 23:08:30.275419 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:30.275337    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xn9sf_f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0/manager/0.log"
Jul 20 23:08:30.510046 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:30.510016    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6795f5f468-cwj52_a9bb1c24-b396-409b-9a03-9a84691b3d93/copy-manifests/0.log"
Jul 20 23:08:30.522503 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:30.522480    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6795f5f468-cwj52_a9bb1c24-b396-409b-9a03-9a84691b3d93/manager/0.log"
Jul 20 23:08:31.233126 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:31.233091    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743140-vt22k_40b58c50-9166-4ecf-819a-57160472ee0d/cleanup/0.log"
Jul 20 23:08:33.383535 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:33.383505    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n25z2_f1ebe177-fca6-4472-bc14-7320c1de9131/limitador/0.log"
Jul 20 23:08:33.499466 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:33.499435    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pjrhj_56878563-9b56-44bd-85fc-8881aefe0f3e/manager/0.log"
Jul 20 23:08:33.981479 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:33.981448    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kmrcw_f11ba961-c943-44d3-b272-793934fbd890/discovery/0.log"
Jul 20 23:08:34.211496 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:34.211464    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5957d7d59-g2p4f_662561cb-4db4-4a66-b4b3-86597bc326b8/kube-auth-proxy/0.log"
Jul 20 23:08:34.453434 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:34.453402    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fvcq6_e34c1737-1f4c-447b-ba48-b8a219d8b77a/payload-pre-processing/0.log"
Jul 20 23:08:34.567795 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:34.567763    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-mjdbx_cf483c8c-2cf9-4272-ab49-26e0e8c7161f/payload-processing/0.log"
Jul 20 23:08:35.033666 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:35.033639    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-swpwl_98ef76bc-9d56-4450-9a7b-d9f73c675b83/main/0.log"
Jul 20 23:08:35.380821 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:35.380793    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fc7flk_f3526caa-a8e4-4df4-bbf7-325aac03f084/main/0.log"
Jul 20 23:08:44.032480 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:44.032443    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bzj9t_7f7845cf-8b8f-4a86-8818-0a22d53cfd9a/global-pull-secret-syncer/0.log"
Jul 20 23:08:44.242652 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:44.242621    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-stlkx_34bb54ec-e7a3-4b44-aca9-dd95fb23fbd5/konnectivity-agent/0.log"
Jul 20 23:08:44.265563 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:44.265528    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-108.ec2.internal_d4ee785b208346b7bd74e56028abfd5a/haproxy/0.log"
Jul 20 23:08:49.540340 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:49.540284    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-n25z2_f1ebe177-fca6-4472-bc14-7320c1de9131/limitador/0.log"
Jul 20 23:08:49.605853 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:49.605819    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-pjrhj_56878563-9b56-44bd-85fc-8881aefe0f3e/manager/0.log"
Jul 20 23:08:51.053316 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:51.053276    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d26a2ca7-bb34-4355-8d5a-ae7d7f30e567/alertmanager/0.log"
Jul 20 23:08:51.080007 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:51.079983    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d26a2ca7-bb34-4355-8d5a-ae7d7f30e567/config-reloader/0.log"
Jul 20 23:08:51.101225 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:51.101200    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d26a2ca7-bb34-4355-8d5a-ae7d7f30e567/kube-rbac-proxy-web/0.log"
Jul 20 23:08:51.123133 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:51.123100    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d26a2ca7-bb34-4355-8d5a-ae7d7f30e567/kube-rbac-proxy/0.log"
Jul 20 23:08:51.144018 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:51.143994    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d26a2ca7-bb34-4355-8d5a-ae7d7f30e567/kube-rbac-proxy-metric/0.log"
Jul 20 23:08:51.184919 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:51.184891    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d26a2ca7-bb34-4355-8d5a-ae7d7f30e567/prom-label-proxy/0.log"
Jul 20 23:08:51.210510 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:51.210475    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d26a2ca7-bb34-4355-8d5a-ae7d7f30e567/init-config-reloader/0.log"
Jul 20 23:08:51.445904 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:51.445874    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bhmkx_23f2f526-b010-410a-a41e-73f9403a386e/node-exporter/0.log"
Jul 20 23:08:51.468219 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:51.468191    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bhmkx_23f2f526-b010-410a-a41e-73f9403a386e/kube-rbac-proxy/0.log"
Jul 20 23:08:51.495677 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:51.495652    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bhmkx_23f2f526-b010-410a-a41e-73f9403a386e/init-textfile/0.log"
Jul 20 23:08:51.942742 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:51.942716    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-nnvvs_973b0173-f06b-447b-843b-6e9c83d936b3/prometheus-operator/0.log"
Jul 20 23:08:51.973278 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:51.973244    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-nnvvs_973b0173-f06b-447b-843b-6e9c83d936b3/kube-rbac-proxy/0.log"
Jul 20 23:08:52.055513 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:52.055483    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7787949944-q8kq7_10eb4fd1-c451-491e-bd56-dab94fe124c6/telemeter-client/0.log"
Jul 20 23:08:52.077509 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:52.077483    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7787949944-q8kq7_10eb4fd1-c451-491e-bd56-dab94fe124c6/reload/0.log"
Jul 20 23:08:52.099772 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:52.099739    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7787949944-q8kq7_10eb4fd1-c451-491e-bd56-dab94fe124c6/kube-rbac-proxy/0.log"
Jul 20 23:08:52.136621 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:52.136581    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455dd967b-4wc2v_21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01/thanos-query/0.log"
Jul 20 23:08:52.157799 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:52.157771    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455dd967b-4wc2v_21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01/kube-rbac-proxy-web/0.log"
Jul 20 23:08:52.177463 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:52.177432    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455dd967b-4wc2v_21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01/kube-rbac-proxy/0.log"
Jul 20 23:08:52.197515 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:52.197447    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455dd967b-4wc2v_21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01/prom-label-proxy/0.log"
Jul 20 23:08:52.217596 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:52.217570    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455dd967b-4wc2v_21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01/kube-rbac-proxy-rules/0.log"
Jul 20 23:08:52.241633 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:52.241605    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5455dd967b-4wc2v_21a78d7c-1bd0-4f8a-8bcb-51f289ab6a01/kube-rbac-proxy-metrics/0.log"
Jul 20 23:08:53.499256 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:53.499224    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-zjgkp_43b7b7fb-df23-498e-b7c4-3bef917dcbc0/networking-console-plugin/0.log"
Jul 20 23:08:54.130166 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.130125    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"]
Jul 20 23:08:54.130591 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.130577    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b08f4aed-b923-4bda-b433-41667095a0f4" containerName="revoke-keys"
Jul 20 23:08:54.130591 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.130592    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b08f4aed-b923-4bda-b433-41667095a0f4" containerName="revoke-keys"
Jul 20 23:08:54.130682 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.130652    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b08f4aed-b923-4bda-b433-41667095a0f4" containerName="revoke-keys"
Jul 20 23:08:54.133956 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.133938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.136121 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.136097    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fl6rb\"/\"openshift-service-ca.crt\""
Jul 20 23:08:54.136248 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.136101    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fl6rb\"/\"default-dockercfg-q7vsn\""
Jul 20 23:08:54.136248 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.136140    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fl6rb\"/\"kube-root-ca.crt\""
Jul 20 23:08:54.141383 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.140835    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"]
Jul 20 23:08:54.225847 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.225810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-podres\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.226054 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.225875    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8wgv\" (UniqueName: \"kubernetes.io/projected/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-kube-api-access-p8wgv\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.226054 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.225966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-sys\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.226054 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.225996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-proc\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.226179 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.226066    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-lib-modules\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.327136 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.327096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-lib-modules\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.327352 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.327145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-podres\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.327352 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.327192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8wgv\" (UniqueName: \"kubernetes.io/projected/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-kube-api-access-p8wgv\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.327352 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.327227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-sys\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.327352 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.327243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-proc\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.327352 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.327294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-lib-modules\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.327352 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.327347    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-proc\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.327601 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.327347    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-sys\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.327601 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.327361    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-podres\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.335489 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.335458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8wgv\" (UniqueName: \"kubernetes.io/projected/19a407a8-cbc4-44b5-a05f-d7a944f0fbd2-kube-api-access-p8wgv\") pod \"perf-node-gather-daemonset-v6lq7\" (UID: \"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2\") " pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.444389 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.444287    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:54.583473 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.583447    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"]
Jul 20 23:08:54.585332 ip-10-0-128-108 kubenswrapper[2579]: W0720 23:08:54.585292    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod19a407a8_cbc4_44b5_a05f_d7a944f0fbd2.slice/crio-b7681bf35d277997216d60079d3e3b6768c12fbb8bec5aa1d567951137043080 WatchSource:0}: Error finding container b7681bf35d277997216d60079d3e3b6768c12fbb8bec5aa1d567951137043080: Status 404 returned error can't find the container with id b7681bf35d277997216d60079d3e3b6768c12fbb8bec5aa1d567951137043080
Jul 20 23:08:54.723732 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.723650    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cff776d94-ssllk_7ec85c2c-5482-40dc-914d-65165f0e50df/console/0.log"
Jul 20 23:08:54.752287 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:54.752258    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-z8fbc_2fb0f170-2c9e-4b05-8eb4-a93a4cc598f6/download-server/0.log"
Jul 20 23:08:55.452116 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:55.452080    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7" event={"ID":"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2","Type":"ContainerStarted","Data":"c8475c5586c2d5fc8c997b2968ec25a5c40a7ab41d8a66bfac06921c033e317b"}
Jul 20 23:08:55.452342 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:55.452129    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7" event={"ID":"19a407a8-cbc4-44b5-a05f-d7a944f0fbd2","Type":"ContainerStarted","Data":"b7681bf35d277997216d60079d3e3b6768c12fbb8bec5aa1d567951137043080"}
Jul 20 23:08:55.452342 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:55.452210    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:08:55.467780 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:55.467703    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7" podStartSLOduration=1.467684619 podStartE2EDuration="1.467684619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 23:08:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 23:08:55.467370838 +0000 UTC m=+2765.582755466" watchObservedRunningTime="2026-07-20 23:08:55.467684619 +0000 UTC m=+2765.583069246"
Jul 20 23:08:56.347676 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:56.347643    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2xhxc_d0eb750c-4154-4579-a580-b9f045a13f2d/dns/0.log"
Jul 20 23:08:56.366589 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:56.366562    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2xhxc_d0eb750c-4154-4579-a580-b9f045a13f2d/kube-rbac-proxy/0.log"
Jul 20 23:08:56.491514 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:56.491485    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6v4z2_c8ba7ac0-dac8-4650-874f-71fbae35f562/dns-node-resolver/0.log"
Jul 20 23:08:57.027481 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:57.027450    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55d5d8fd47-lrx9f_a9869e93-8ba5-4240-a1ca-3bf6582f56a3/registry/0.log"
Jul 20 23:08:57.072973 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:57.072921    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gltrx_a48f5e91-5229-4b8c-bca2-cf6a0a146f1d/node-ca/0.log"
Jul 20 23:08:58.138370 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:58.138341    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kmrcw_f11ba961-c943-44d3-b272-793934fbd890/discovery/0.log"
Jul 20 23:08:58.180641 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:58.180614    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5957d7d59-g2p4f_662561cb-4db4-4a66-b4b3-86597bc326b8/kube-auth-proxy/0.log"
Jul 20 23:08:58.288413 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:58.288384    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fvcq6_e34c1737-1f4c-447b-ba48-b8a219d8b77a/payload-pre-processing/0.log"
Jul 20 23:08:58.314952 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:58.314920    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-mjdbx_cf483c8c-2cf9-4272-ab49-26e0e8c7161f/payload-processing/0.log"
Jul 20 23:08:59.078953 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:59.078918    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q6hnr_7495b474-3e57-4d01-8b10-5498d4384943/serve-healthcheck-canary/0.log"
Jul 20 23:08:59.619906 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:59.619867    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nsjv5_01045907-aeb2-4610-b86b-d212c0e3782d/kube-rbac-proxy/0.log"
Jul 20 23:08:59.639059 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:59.639030    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nsjv5_01045907-aeb2-4610-b86b-d212c0e3782d/exporter/0.log"
Jul 20 23:08:59.660662 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:08:59.660631    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nsjv5_01045907-aeb2-4610-b86b-d212c0e3782d/extractor/0.log"
Jul 20 23:09:01.467603 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:01.467573    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fl6rb/perf-node-gather-daemonset-v6lq7"
Jul 20 23:09:01.992584 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:01.992548    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fm2m9_12660b54-505b-41be-8c58-8b5467f28ace/manager/0.log"
Jul 20 23:09:02.104667 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:02.104626    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85679cb5b4-bgznw_4e6cc3bb-4961-40db-baab-2f06605c6e9c/manager/0.log"
Jul 20 23:09:02.127679 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:02.127648    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5rf4f_a70b5f3a-7c00-41f2-8dab-3ec7c0f36879/server/0.log"
Jul 20 23:09:02.197980 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:02.197945    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xn9sf_f6503ac6-c63f-4c79-bc3f-8bab7e7d27d0/manager/0.log"
Jul 20 23:09:02.319283 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:02.319192    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6795f5f468-cwj52_a9bb1c24-b396-409b-9a03-9a84691b3d93/manager/0.log"
Jul 20 23:09:02.340428 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:02.340398    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6795f5f468-cwj52_a9bb1c24-b396-409b-9a03-9a84691b3d93/copy-manifests/0.log"
Jul 20 23:09:03.806826 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:03.806727    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-f8r76_74170034-6c55-4469-bb0c-7b12435b8ae2/openshift-lws-operator/0.log"
Jul 20 23:09:04.600060 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:04.599962    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kmrcw_f11ba961-c943-44d3-b272-793934fbd890/discovery/0.log"
Jul 20 23:09:04.622459 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:04.622430    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5957d7d59-g2p4f_662561cb-4db4-4a66-b4b3-86597bc326b8/kube-auth-proxy/0.log"
Jul 20 23:09:04.713163 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:04.713132    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fvcq6_e34c1737-1f4c-447b-ba48-b8a219d8b77a/payload-pre-processing/0.log"
Jul 20 23:09:04.736443 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:04.736411    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-mjdbx_cf483c8c-2cf9-4272-ab49-26e0e8c7161f/payload-processing/0.log"
Jul 20 23:09:06.123081 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:06.123042    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-kmrcw_f11ba961-c943-44d3-b272-793934fbd890/discovery/0.log"
Jul 20 23:09:06.154425 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:06.154356    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5957d7d59-g2p4f_662561cb-4db4-4a66-b4b3-86597bc326b8/kube-auth-proxy/0.log"
Jul 20 23:09:06.251481 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:06.251372    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-fvcq6_e34c1737-1f4c-447b-ba48-b8a219d8b77a/payload-pre-processing/0.log"
Jul 20 23:09:06.271861 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:06.271833    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-mjdbx_cf483c8c-2cf9-4272-ab49-26e0e8c7161f/payload-processing/0.log"
Jul 20 23:09:10.523682 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:10.523605    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdr7h_ca5f562e-8121-4b81-b5f5-58c5ebda891e/kube-multus-additional-cni-plugins/0.log"
Jul 20 23:09:10.543156 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:10.543133    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdr7h_ca5f562e-8121-4b81-b5f5-58c5ebda891e/egress-router-binary-copy/0.log"
Jul 20 23:09:10.560890 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:10.560860    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdr7h_ca5f562e-8121-4b81-b5f5-58c5ebda891e/cni-plugins/0.log"
Jul 20 23:09:10.578877 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:10.578852    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdr7h_ca5f562e-8121-4b81-b5f5-58c5ebda891e/bond-cni-plugin/0.log"
Jul 20 23:09:10.596217 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:10.596189    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdr7h_ca5f562e-8121-4b81-b5f5-58c5ebda891e/routeoverride-cni/0.log"
Jul 20 23:09:10.613783 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:10.613758    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdr7h_ca5f562e-8121-4b81-b5f5-58c5ebda891e/whereabouts-cni-bincopy/0.log"
Jul 20 23:09:10.632314 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:10.632278    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qdr7h_ca5f562e-8121-4b81-b5f5-58c5ebda891e/whereabouts-cni/0.log"
Jul 20 23:09:10.740187 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:10.740135    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kgkph_ce976b70-1114-40c2-bb36-70023b6bd7ae/kube-multus/0.log"
Jul 20 23:09:10.845603 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:10.845524    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xph8z_e6638ee0-589b-4efa-a8f7-23574ca64eb2/network-metrics-daemon/0.log"
Jul 20 23:09:10.862949 ip-10-0-128-108 kubenswrapper[2579]: I0720 23:09:10.862898    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xph8z_e6638ee0-589b-4efa-a8f7-23574ca64eb2/kube-rbac-proxy/0.log"