Jul 07 22:12:38.938470 ip-10-0-128-229 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 22:12:38.938482 ip-10-0-128-229 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 22:12:38.938489 ip-10-0-128-229 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 22:12:38.938730 ip-10-0-128-229 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 22:12:48.965105 ip-10-0-128-229 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 22:12:48.965121 ip-10-0-128-229 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c34f8d48ba8f4f4b88e89b318addfef3 --
Jul 07 22:14:20.547536 ip-10-0-128-229 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.022562    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027233    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027246    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027251    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027255    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027258    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027261    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027264    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 22:14:21.170353 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027267    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027269    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027272    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027275    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027278    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027280    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027291    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027294    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027299    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027303    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027306    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027309    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027312    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027316    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027319    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027322    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027325    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027328    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027331    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 22:14:21.182045 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027333    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 22:14:21.178137 ip-10-0-128-229 systemd[1]: Started Kubernetes Kubelet.
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027337    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027340    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027342    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027345    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027348    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027352    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027355    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027358    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027360    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027363    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027366    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027369    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027372    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027374    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027377    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027380    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027382    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027385    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027387    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 22:14:21.183103 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027392    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027395    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027397    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027400    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027402    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027405    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027408    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027411    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027415    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027417    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027420    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027423    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027425    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027429    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027433    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027435    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027438    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027441    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027444    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 22:14:21.185465 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027446    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027449    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027451    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027454    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027456    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027459    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027461    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027464    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027467    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027469    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027472    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027475    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027477    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027481    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027484    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027487    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027489    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027492    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027494    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 22:14:21.186675 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027497    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027499    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027501    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027504    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027507    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027510    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027512    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027516    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027519    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027522    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027526    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027529    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027532    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027534    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.027537    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028248    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028255    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028258    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028261    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028264    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 22:14:21.189348 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028267    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028270    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028273    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028275    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028280    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028284    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028287    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028290    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028293    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028296    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028298    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028302    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028305    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028307    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028310    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028313    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028315    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028318    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028320    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 22:14:21.190842 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028323    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028325    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028328    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028331    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028333    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028336    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028338    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028341    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028343    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028345    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028348    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028351    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028354    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028357    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028360    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028362    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028365    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028368    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028371    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 22:14:21.191902 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028373    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028376    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028379    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028383    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028385    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028389    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028391    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028394    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028396    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028399    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028401    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028404    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028407    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028410    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028412    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028415    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028417    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028420    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028422    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028427    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 22:14:21.192892 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028430    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028433    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028436    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028438    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028441    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028444    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028446    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028448    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028451    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028453    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028456    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028459    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028461    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028464    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028467    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028470    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028473    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028475    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028478    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028481    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 22:14:21.193917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028483    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028486    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028488    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028491    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028494    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028496    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028500    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028503    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028506    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028509    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028511    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028515    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028518    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028520    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028523    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.028526    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030720    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030732    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030736    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 22:14:21.195024 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030739    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030742    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030745    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030748    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030750    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030754    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030756    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030759    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030761    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030764    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030767    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030770    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030772    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030775    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030778    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030780    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030783    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030787    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030791    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 22:14:21.195961 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030795    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030799    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030810    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030814    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030818    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030821    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030825    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030828    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030830    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030833    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030836    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030838    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030841    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030843    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030846    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030849    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030851    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030854    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030856    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030859    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 22:14:21.196901 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030862    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030865    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030867    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030870    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030872    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030875    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030877    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030880    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030882    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030884    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030887    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030889    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030892    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030894    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030897    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030900    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030903    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030908    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030912    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 22:14:21.197959 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030915    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030918    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030921    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030924    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030927    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030929    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030932    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030935    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030938    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030941    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030944    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030946    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030949    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030952    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030954    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030957    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030960    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030963    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030966    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030969    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 22:14:21.198985 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030971    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030974    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030978    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030981    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030983    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030986    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030988    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030991    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030993    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030997    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.030999    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031006    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031008    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031011    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031013    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031016    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031018    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031021    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031097    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031105    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031112    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 22:14:21.200891 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031117    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031121    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031125    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031129    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031134    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031137    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031140    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031143    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031146    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031150    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031153    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031157    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031162    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031166    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031172    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031179    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031184    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031187    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031190    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031207    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031213    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031216    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031221    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 22:14:21.202363 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031225    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031228    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031231    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031234    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031237    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031239    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031244    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031247    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031250    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031253    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031256    2561 flags.go:64] FLAG: --enable-server="true"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031259    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031263    2561 flags.go:64] FLAG: --event-burst="100"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031266    2561 flags.go:64] FLAG: --event-qps="50"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031269    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031272    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031275    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031279    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031282    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031285    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031288    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031291    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031294    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031297    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031300    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 22:14:21.207563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031303    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031306    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031309    2561 flags.go:64] FLAG: --feature-gates=""
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031312    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031317    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031320    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031324    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031328    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031331    2561 flags.go:64] FLAG: --help="false"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031334    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-128-229.ec2.internal"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031337    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031340    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031343    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031347    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031350    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031353    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031356    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031359    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031362    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031365    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031368    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031371    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031374    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031376    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 22:14:21.209026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031380    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031382    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031385    2561 flags.go:64] FLAG: --lock-file=""
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031388    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031391    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031393    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031399    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031402    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031405    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031409    2561 flags.go:64] FLAG: --logging-format="text"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031411    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031415    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031419    2561 flags.go:64] FLAG: --manifest-url=""
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031422    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031428    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031431    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031435    2561 flags.go:64] FLAG: --max-pods="110"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031438    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031441    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031444    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031447    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031450    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031453    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031456    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031464    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 22:14:21.213429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031467    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031470    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031473    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031475    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031481    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031484    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031487    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031490    2561 flags.go:64] FLAG: --port="10250"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031493    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031496    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08b58f0254aaabccc"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031500    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031502    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031505    2561 flags.go:64] FLAG: --register-node="true"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031508    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031512    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031514    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031518    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031521    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031524    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031529    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031532    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031534    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031538    2561 flags.go:64] FLAG: --runonce="false"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031541    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031544    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 22:14:21.214914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031547    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031550    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031553    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031556    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031559    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031562    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031565    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031568    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031571    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031574    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031577    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031580    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031583    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031588    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031591    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031593    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031598    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031601    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031603    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031606    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031609    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031612    2561 flags.go:64] FLAG: --v="2"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031616    2561 flags.go:64] FLAG: --version="false"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031620    2561 flags.go:64] FLAG: --vmodule=""
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031626    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 22:14:21.216873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.031629    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031745    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031749    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031752    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031756    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031759    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031762    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031764    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031767    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031769    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031772    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031774    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031776    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031779    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031781    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031784    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031786    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031789    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031791    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 22:14:21.218380 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031794    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031796    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031799    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031801    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031804    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031806    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031810    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031813    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031817    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031820    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031823    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031825    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031828    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031831    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031835    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031837    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031840    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031843    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031846    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031848    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 22:14:21.219427 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031851    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031854    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031856    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031859    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031861    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031864    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031866    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031869    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031871    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031874    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031876    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031879    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031881    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031884    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031886    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031889    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031892    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031894    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031896    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031899    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 22:14:21.220429 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031902    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031904    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031907    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031910    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031913    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031917    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031921    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031924    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031927    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031931    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031934    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031938    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031942    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031945    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031947    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031950    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031953    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031955    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031958    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 22:14:21.221461 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031960    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031963    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031965    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031968    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031970    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031972    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031975    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031978    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031980    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031982    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031985    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031987    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031989    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031992    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031995    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.031997    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.032000    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.032002    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.032005    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 22:14:21.223844 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.032008    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.032011    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.032013    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.032897    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.039999    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.040015    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.040851    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.040862    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040926    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040931    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040935    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040938    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040941    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040944    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040946    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 22:14:21.224862 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040949    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040952    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040954    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040957    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040959    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040962    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040965    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040967    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040970    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040973    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040975    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040978    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040981    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040984    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040986    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040989    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040992    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040995    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.040998    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041001    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 22:14:21.225858 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041003    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041006    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041008    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041011    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041014    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041016    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041019    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041021    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041024    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041026    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041029    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041031    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041034    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041036    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041039    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041041    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041044    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041046    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041050    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 22:14:21.226899 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041054    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041057    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041060    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041063    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041066    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041068    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041071    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041074    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041077    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041079    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041082    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041085    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041089    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041091    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041094    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041096    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041099    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041101    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041104    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041106    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041109    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 22:14:21.228813 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041111    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041114    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041117    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041119    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041122    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041124    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041127    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041129    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041132    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041135    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041137    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041140    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041142    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041147    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041151    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041154    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041157    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041160    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041162    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 22:14:21.229808 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041165    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041168    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041170    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041174    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041177    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041181    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041184    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041187    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041190    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041208    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041212    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041215    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041218    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.041224    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 22:14:21.231712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041336    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041340    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041343    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041346    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041349    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041351    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041354    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041356    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041359    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041362    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041365    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041368    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041371    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041374    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041376    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041379    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041381    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041384    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041387    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 22:14:21.232727 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041391    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041398    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041401    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041404    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041407    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041411    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041414    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041417    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041420    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041422    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041425    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041428    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041430    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041433    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041436    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041438    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041441    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041443    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041446    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041448    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 22:14:21.234628 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041451    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041453    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041456    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041460    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041463    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041465    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041468    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041470    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041473    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041475    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041478    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041481    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041483    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041490    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041492    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041495    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041497    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041500    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041503    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041505    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 22:14:21.235645 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041508    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041511    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041513    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041516    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041519    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041521    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041524    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041526    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041529    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041531    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041534    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041536    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041539    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041542    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041545    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041548    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041551    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041553    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041556    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041559    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 22:14:21.237539 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041561    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041564    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041566    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041568    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041571    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041575    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041578    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041580    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041583    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041585    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041588    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041591    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041593    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041596    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041598    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041601    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041603    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041607    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041610    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 22:14:21.238554 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:21.041613    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 22:14:21.240500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.041618    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 22:14:21.240500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.041730    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 22:14:21.240500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.045804    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 22:14:21.240500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.047362    2561 server.go:1019] "Starting client certificate rotation"
Jul 07 22:14:21.240500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.047463    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 22:14:21.240500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.047501    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 22:14:21.240500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.050323    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 22:14:21.240500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.051456    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 22:14:21.240500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.062775    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 07 22:14:21.240500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.065649    2561 log.go:25] "Validated CRI v1 image API"
Jul 07 22:14:21.240500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.068780    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 22:14:21.240500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.071382    2561 fs.go:135] Filesystem UUIDs: map[41e59744-0fff-47fc-99a9-a0f903d98dad:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f47ddc44-bef3-4cb6-94b3-88967176bbe0:/dev/nvme0n1p3]
Jul 07 22:14:21.241477 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.071400    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 22:14:21.340723 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.076440    2561 manager.go:216] Machine: {Timestamp:2026-07-07 22:14:21.075059923 +0000 UTC m=+0.391197340 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101449 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c47df3497f65ac3643d8ba1b69aa1 SystemUUID:ec2c47df-3497-f65a-c364-3d8ba1b69aa1 BootID:c34f8d48-ba8f-4f4b-88e8-9b318addfef3 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1f:ab:eb:63:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1f:ab:eb:63:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:88:3b:bc:b5:70 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 22:14:21.340723 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.076543    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 22:14:21.340723 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.076624    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 22:14:21.340723 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.079473    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 22:14:21.340723 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.081923    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 22:14:21.340723 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.081949    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-229.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 22:14:21.340723 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.082719    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.082730    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.082737    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.083651    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.085091    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.091061    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.091180    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.091222    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.091240    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.091262    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.091275    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.091308    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.091661    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.091675    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.094315    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:21.103012    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:21.103020    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-229.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.127482    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-chl2w"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.135559    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-chl2w"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.171150    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.171182    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.172605    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.172618    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.172624    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.172630    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.172639    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.172644    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.172652    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.172657    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.172664    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.172669    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.172684    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.172689    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.174218    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.174225    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.177286    2561 server.go:1268] "Started kubelet"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.177373    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.177461    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.177533    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.178898    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 22:14:21.341234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.180103    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 22:14:21.343223 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:21.183600    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 22:14:21.343223 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.191368    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-229.ec2.internal" not found
Jul 07 22:14:21.343223 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.196794    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 22:14:21.343223 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.197049    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 22:14:21.343223 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.197933    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 22:14:21.343223 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.197995    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 22:14:21.343223 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.198029    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 22:14:21.343223 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.198153    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 22:14:21.343223 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.198162    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 22:14:21.463467 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:21.197095    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 07 22:14:21.463467 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.414995    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 22:14:21.463467 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:21.417753    2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-229.ec2.internal\" not found" node="ip-10-0-128-229.ec2.internal"
Jul 07 22:14:21.463467 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.419847    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-229.ec2.internal" not found
Jul 07 22:14:21.480758 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.479310    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-229.ec2.internal" not found
Jul 07 22:14:21.594306 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:21.515651    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 07 22:14:21.724602 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:21.616375    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 07 22:14:21.724602 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:21.716946    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 07 22:14:21.745451 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.744814    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-229.ec2.internal" not found
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:21.817329    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.834993    2561 factory.go:55] Registering systemd factory
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.835017    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:21.835033    2561 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-128-229.ec2.internal" not found
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.835599    2561 factory.go:153] Registering CRI-O factory
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.835613    2561 factory.go:223] Registration of the crio container factory successfully
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.835684    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.835713    2561 factory.go:103] Registering Raw factory
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.835728    2561 manager.go:1196] Started watching for new ooms in manager
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.836140    2561 manager.go:349] Starting recovery of all containers
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.846780    2561 manager.go:354] Recovery completed
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.851361    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.859722    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.859747    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.859757    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.860383    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.860392    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.860410    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.861746    2561 policy_none.go:49] "None policy: Start"
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.861759    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.861769    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.862899    2561 policy_none.go:47] "Start"
Jul 07 22:14:21.866849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.863647    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:14:21.882167 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.879980    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:14:21.882167 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.880005    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:14:21.882167 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.880020    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:14:22.002620 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.884823    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-229.ec2.internal" not found
Jul 07 22:14:22.002620 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.901087    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-229.ec2.internal" not found
Jul 07 22:14:22.002620 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:21.960020    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-229.ec2.internal" not found
Jul 07 22:14:22.126074 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.013106    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 22:14:22.140730 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.140689    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 22:09:21 +0000 UTC" deadline="2028-01-16 02:04:16.207418847 +0000 UTC"
Jul 07 22:14:22.140815 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.140730    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13371h49m54.066692536s"
Jul 07 22:14:22.179932 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.179905    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 22:14:22.180398 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:22.179905    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 07 22:14:22.180398 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.180106    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 22:14:22.180398 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.180106    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 22:14:22.226122 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.225914    2561 manager.go:337] "Starting Device Plugin manager"
Jul 07 22:14:22.246034 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:22.226151    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 22:14:22.246034 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.226170    2561 server.go:87] "Starting device plugin registration server"
Jul 07 22:14:22.246034 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.226518    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 22:14:22.246034 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.226534    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 22:14:22.246034 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.226665    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 22:14:22.246034 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.226771    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 22:14:22.246034 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.226780    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 22:14:22.246034 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:22.227420    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 22:14:22.246034 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:22.227481    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 07 22:14:22.250316 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.250298    2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-229.ec2.internal" not found
Jul 07 22:14:22.250424 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:22.250322    2561 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-128-229.ec2.internal" not found
Jul 07 22:14:22.285189 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.285121    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 22:14:22.286400 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.286383    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 22:14:22.286481 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.286425    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 22:14:22.286481 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.286448    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 22:14:22.286586 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:22.286489    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 22:14:22.289187 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.289168    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 22:14:22.326804 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.326759    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:14:22.327871 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.327849    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:14:22.327982 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.327892    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:14:22.327982 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.327909    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:14:22.327982 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.327941    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.338252 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.338232    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.338310 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:22.338259    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-229.ec2.internal\": node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 07 22:14:22.364087 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:22.364055    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-229.ec2.internal\" not found"
Jul 07 22:14:22.386876 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.386802    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"]
Jul 07 22:14:22.386971 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.386926    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:14:22.387914 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.387892    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:14:22.388007 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.387927    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:14:22.388007 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.387940    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:14:22.389315 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.389302    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:14:22.389442 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.389427    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.389483 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.389458    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:14:22.390093 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.390074    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:14:22.390176 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.390114    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:14:22.390176 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.390134    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:14:22.390176 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.390145    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:14:22.390381 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.390115    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:14:22.390381 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.390231    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:14:22.391460 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.391446    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.391516 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.391473    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 22:14:22.392131 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.392113    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 22:14:22.392200 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.392143    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 22:14:22.392200 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.392155    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeHasSufficientPID"
Jul 07 22:14:22.416691 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.416667    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 22:14:22.419360 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.419340    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.420258 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.420242    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c498ee23fe81a2779731e4b1b636e573-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"c498ee23fe81a2779731e4b1b636e573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.420349 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.420280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c498ee23fe81a2779731e4b1b636e573-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"c498ee23fe81a2779731e4b1b636e573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.420349 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.420306    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/651afb1b5549eafbdf78c97ea2bcc023-config\") pod \"kube-apiserver-proxy-ip-10-0-128-229.ec2.internal\" (UID: \"651afb1b5549eafbdf78c97ea2bcc023\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.424214 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.424199    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.471132 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.471105    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 22:14:22.480700 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.480681    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 22:14:22.497340 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.497315    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.509874 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.509854    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 22:14:22.509940 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:22.509892    2561 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-128-229.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.509940 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.509905    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.521482 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.521461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c498ee23fe81a2779731e4b1b636e573-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"c498ee23fe81a2779731e4b1b636e573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.521537 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.521488    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c498ee23fe81a2779731e4b1b636e573-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"c498ee23fe81a2779731e4b1b636e573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.521537 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.521506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/651afb1b5549eafbdf78c97ea2bcc023-config\") pod \"kube-apiserver-proxy-ip-10-0-128-229.ec2.internal\" (UID: \"651afb1b5549eafbdf78c97ea2bcc023\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.521606 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.521547    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/651afb1b5549eafbdf78c97ea2bcc023-config\") pod \"kube-apiserver-proxy-ip-10-0-128-229.ec2.internal\" (UID: \"651afb1b5549eafbdf78c97ea2bcc023\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.521606 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.521572    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c498ee23fe81a2779731e4b1b636e573-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"c498ee23fe81a2779731e4b1b636e573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.521606 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.521582    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c498ee23fe81a2779731e4b1b636e573-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" (UID: \"c498ee23fe81a2779731e4b1b636e573\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.524086 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.524069    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 22:14:22.524126 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:22.524108    2561 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.775280 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.775178    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:22.784566 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:22.784546    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal"
Jul 07 22:14:23.079073 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.078989    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 22:14:23.183638 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.183601    2561 apiserver.go:52] "Watching apiserver"
Jul 07 22:14:23.192762 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.192734    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 22:14:23.193985 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.193961    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-r4qhq","openshift-multus/multus-v67vf","openshift-network-diagnostics/network-check-target-92k2m","kube-system/konnectivity-agent-ltjqr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6","openshift-cluster-node-tuning-operator/tuned-72lms","openshift-image-registry/node-ca-gqdwk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal","openshift-multus/network-metrics-daemon-m7pwq","openshift-network-operator/iptables-alerter-z8vw5","openshift-ovn-kubernetes/ovnkube-node-hjkqk","kube-system/global-pull-secret-syncer-7rp6t","kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal","openshift-dns/node-resolver-z9j2z"]
Jul 07 22:14:23.195455 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.195432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gqdwk"
Jul 07 22:14:23.196514 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.196498    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z9j2z"
Jul 07 22:14:23.197493 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.197477    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 22:14:23.197611 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.197594    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ltjqr"
Jul 07 22:14:23.198316 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.198292    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 22:14:23.198417 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.198343    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qx8hv\""
Jul 07 22:14:23.198486 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.198455    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 22:14:23.198533 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.198517    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 22:14:23.198854 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.198838    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.199262 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.199242    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 22:14:23.199350 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.199292    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 22:14:23.199528 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.199512    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9rfnl\""
Jul 07 22:14:23.200487 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.200458    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.200722 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.200703    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f9vtg\""
Jul 07 22:14:23.200785 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.200741    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 22:14:23.201830 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.201809    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 22:14:23.201917 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.201829    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 22:14:23.202012 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.201993    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 22:14:23.202410 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.202391    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7pzzc\""
Jul 07 22:14:23.202601 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.202583    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 22:14:23.202663 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.202587    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:23.202765 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.202738    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:23.203922 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.203900    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:14:23.204386 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.204368    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.204689 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.204663    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4zltn\""
Jul 07 22:14:23.204947 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.204930    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 22:14:23.206018 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.205999    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z8vw5"
Jul 07 22:14:23.206766 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.206745    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 22:14:23.207358 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.207129    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 22:14:23.207440 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.207360    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2zj2b\""
Jul 07 22:14:23.207588 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.207561    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 22:14:23.207661 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.207625    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 22:14:23.207845 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.207826    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 22:14:23.208111 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.208094    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.208657 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.208635    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:14:23.208817 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.208714    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 22:14:23.208924 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.208907    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 22:14:23.208998 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.208923    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vg877\""
Jul 07 22:14:23.209651 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.209638    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:23.209718 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.209702    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:23.211120 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.211101    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.212604 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.212586    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:23.212660 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.212643    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:23.215037 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.215013    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 22:14:23.216465 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.216451    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 22:14:23.217412 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.217353    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6xm7k\""
Jul 07 22:14:23.217529 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.217434    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 22:14:23.217529 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.217445    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 22:14:23.217529 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.217452    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 22:14:23.217719 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.217444    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 22:14:23.217719 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.217534    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 22:14:23.217719 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.217625    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lbq4q\""
Jul 07 22:14:23.223203 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.223184    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 22:14:23.228825 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.228803    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-registration-dir\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.228905 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.228840    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-device-dir\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.228905 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.228872    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cb3a312-1e9b-4d3d-899c-732658e9719e-hosts-file\") pod \"node-resolver-z9j2z\" (UID: \"6cb3a312-1e9b-4d3d-899c-732658e9719e\") " pod="openshift-dns/node-resolver-z9j2z"
Jul 07 22:14:23.228905 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.228898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cb3a312-1e9b-4d3d-899c-732658e9719e-tmp-dir\") pod \"node-resolver-z9j2z\" (UID: \"6cb3a312-1e9b-4d3d-899c-732658e9719e\") " pod="openshift-dns/node-resolver-z9j2z"
Jul 07 22:14:23.229047 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.228925    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.229047 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.228969    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-socket-dir\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.229047 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.229023    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f07fbbf-a565-4d75-8c14-0231b9d78467-host\") pod \"node-ca-gqdwk\" (UID: \"9f07fbbf-a565-4d75-8c14-0231b9d78467\") " pod="openshift-image-registry/node-ca-gqdwk"
Jul 07 22:14:23.229191 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.229051    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptvm9\" (UniqueName: \"kubernetes.io/projected/9f07fbbf-a565-4d75-8c14-0231b9d78467-kube-api-access-ptvm9\") pod \"node-ca-gqdwk\" (UID: \"9f07fbbf-a565-4d75-8c14-0231b9d78467\") " pod="openshift-image-registry/node-ca-gqdwk"
Jul 07 22:14:23.229191 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.229074    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e35cf280-f6da-4851-821d-84c40d15a85f-agent-certs\") pod \"konnectivity-agent-ltjqr\" (UID: \"e35cf280-f6da-4851-821d-84c40d15a85f\") " pod="kube-system/konnectivity-agent-ltjqr"
Jul 07 22:14:23.229191 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.229115    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.229191 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.229153    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-sys-fs\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.229191 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.229180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57gwd\" (UniqueName: \"kubernetes.io/projected/64485fd3-8ab7-40b0-a303-93138502f494-kube-api-access-57gwd\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.229408 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.229205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f07fbbf-a565-4d75-8c14-0231b9d78467-serviceca\") pod \"node-ca-gqdwk\" (UID: \"9f07fbbf-a565-4d75-8c14-0231b9d78467\") " pod="openshift-image-registry/node-ca-gqdwk"
Jul 07 22:14:23.229408 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.229247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rltvt\" (UniqueName: \"kubernetes.io/projected/6cb3a312-1e9b-4d3d-899c-732658e9719e-kube-api-access-rltvt\") pod \"node-resolver-z9j2z\" (UID: \"6cb3a312-1e9b-4d3d-899c-732658e9719e\") " pod="openshift-dns/node-resolver-z9j2z"
Jul 07 22:14:23.229408 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.229271    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e35cf280-f6da-4851-821d-84c40d15a85f-konnectivity-ca\") pod \"konnectivity-agent-ltjqr\" (UID: \"e35cf280-f6da-4851-821d-84c40d15a85f\") " pod="kube-system/konnectivity-agent-ltjqr"
Jul 07 22:14:23.243940 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.243910    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pcwpg"
Jul 07 22:14:23.252673 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.252649    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pcwpg"
Jul 07 22:14:23.301442 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.300527    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 22:14:23.329661 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329594    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e23add91-9559-44af-8220-1a3b0956e7ef-ovnkube-config\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.329661 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329628    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-multus-socket-dir-parent\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.329661 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329648    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7626485b-4b41-4706-8663-12bd5ef5bffd-multus-daemon-config\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.329854 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329666    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g2rc\" (UniqueName: \"kubernetes.io/projected/7626485b-4b41-4706-8663-12bd5ef5bffd-kube-api-access-9g2rc\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.329854 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0b88798-8527-4a73-a88f-df113df09d6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.329854 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329701    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/68ad71af-9e0f-4867-9981-8283f848b625-iptables-alerter-script\") pod \"iptables-alerter-z8vw5\" (UID: \"68ad71af-9e0f-4867-9981-8283f848b625\") " pod="openshift-network-operator/iptables-alerter-z8vw5"
Jul 07 22:14:23.329854 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.329854 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329739    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-systemd-units\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.329854 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-run-k8s-cni-cncf-io\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.329854 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-modprobe-d\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.329854 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329789    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0b88798-8527-4a73-a88f-df113df09d6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.329854 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e35cf280-f6da-4851-821d-84c40d15a85f-konnectivity-ca\") pod \"konnectivity-agent-ltjqr\" (UID: \"e35cf280-f6da-4851-821d-84c40d15a85f\") " pod="kube-system/konnectivity-agent-ltjqr"
Jul 07 22:14:23.329854 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-registration-dir\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-device-dir\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329887    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-etc-selinux\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329915    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e23add91-9559-44af-8220-1a3b0956e7ef-ovnkube-script-lib\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329925    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-registration-dir\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329939    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-device-dir\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-cnibin\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.329986    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-etc-kubernetes\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330047    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-socket-dir\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330075    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-os-release\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330082    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330103    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-var-lib-kubelet\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330134    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:23.330333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330139    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-socket-dir\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330192    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0b88798-8527-4a73-a88f-df113df09d6a-cnibin\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330259    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0b88798-8527-4a73-a88f-df113df09d6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330289    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68ad71af-9e0f-4867-9981-8283f848b625-host-slash\") pod \"iptables-alerter-z8vw5\" (UID: \"68ad71af-9e0f-4867-9981-8283f848b625\") " pod="openshift-network-operator/iptables-alerter-z8vw5"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330315    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-run-systemd\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330342    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7626485b-4b41-4706-8663-12bd5ef5bffd-cni-binary-copy\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330382    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e35cf280-f6da-4851-821d-84c40d15a85f-konnectivity-ca\") pod \"konnectivity-agent-ltjqr\" (UID: \"e35cf280-f6da-4851-821d-84c40d15a85f\") " pod="kube-system/konnectivity-agent-ltjqr"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330393    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-hostroot\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clfwr\" (UniqueName: \"kubernetes.io/projected/49442a39-eb53-419a-a05d-209c81bba22e-kube-api-access-clfwr\") pod \"network-metrics-daemon-m7pwq\" (UID: \"49442a39-eb53-419a-a05d-209c81bba22e\") " pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330442    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0b88798-8527-4a73-a88f-df113df09d6a-os-release\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330467    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e35cf280-f6da-4851-821d-84c40d15a85f-agent-certs\") pod \"konnectivity-agent-ltjqr\" (UID: \"e35cf280-f6da-4851-821d-84c40d15a85f\") " pod="kube-system/konnectivity-agent-ltjqr"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330483    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e23add91-9559-44af-8220-1a3b0956e7ef-env-overrides\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330499    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-multus-conf-dir\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.330841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330517    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-dbus\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330540    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcq9r\" (UniqueName: \"kubernetes.io/projected/68ad71af-9e0f-4867-9981-8283f848b625-kube-api-access-mcq9r\") pod \"iptables-alerter-z8vw5\" (UID: \"68ad71af-9e0f-4867-9981-8283f848b625\") " pod="openshift-network-operator/iptables-alerter-z8vw5"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-kubelet\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330594    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-sysctl-d\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-host\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cb3a312-1e9b-4d3d-899c-732658e9719e-hosts-file\") pod \"node-resolver-z9j2z\" (UID: \"6cb3a312-1e9b-4d3d-899c-732658e9719e\") " pod="openshift-dns/node-resolver-z9j2z"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-node-log\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e23add91-9559-44af-8220-1a3b0956e7ef-ovn-node-metrics-cert\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330700    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-system-cni-dir\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330730    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-run\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330753    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cb3a312-1e9b-4d3d-899c-732658e9719e-hosts-file\") pod \"node-resolver-z9j2z\" (UID: \"6cb3a312-1e9b-4d3d-899c-732658e9719e\") " pod="openshift-dns/node-resolver-z9j2z"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330760    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330793    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-tmp\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330812    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-kubelet-config\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:23.331428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330829    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-run-ovn\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-log-socket\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330869    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-cni-netd\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.330903    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptvm9\" (UniqueName: \"kubernetes.io/projected/9f07fbbf-a565-4d75-8c14-0231b9d78467-kube-api-access-ptvm9\") pod \"node-ca-gqdwk\" (UID: \"9f07fbbf-a565-4d75-8c14-0231b9d78467\") " pod="openshift-image-registry/node-ca-gqdwk"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331067    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-sys-fs\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331096    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57gwd\" (UniqueName: \"kubernetes.io/projected/64485fd3-8ab7-40b0-a303-93138502f494-kube-api-access-57gwd\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331119    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs\") pod \"network-metrics-daemon-m7pwq\" (UID: \"49442a39-eb53-419a-a05d-209c81bba22e\") " pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f07fbbf-a565-4d75-8c14-0231b9d78467-serviceca\") pod \"node-ca-gqdwk\" (UID: \"9f07fbbf-a565-4d75-8c14-0231b9d78467\") " pod="openshift-image-registry/node-ca-gqdwk"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331145    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/64485fd3-8ab7-40b0-a303-93138502f494-sys-fs\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rltvt\" (UniqueName: \"kubernetes.io/projected/6cb3a312-1e9b-4d3d-899c-732658e9719e-kube-api-access-rltvt\") pod \"node-resolver-z9j2z\" (UID: \"6cb3a312-1e9b-4d3d-899c-732658e9719e\") " pod="openshift-dns/node-resolver-z9j2z"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331213    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-tuned\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331250    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-run-openvswitch\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zk98\" (UniqueName: \"kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98\") pod \"network-check-target-92k2m\" (UID: \"a48a3e6e-45b3-48b6-92ee-d350937c8c46\") " pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-lib-modules\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.331970 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331318    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h5dp\" (UniqueName: \"kubernetes.io/projected/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-kube-api-access-8h5dp\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331339    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n4gw\" (UniqueName: \"kubernetes.io/projected/d0b88798-8527-4a73-a88f-df113df09d6a-kube-api-access-6n4gw\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331363    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f07fbbf-a565-4d75-8c14-0231b9d78467-host\") pod \"node-ca-gqdwk\" (UID: \"9f07fbbf-a565-4d75-8c14-0231b9d78467\") " pod="openshift-image-registry/node-ca-gqdwk"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-run-netns\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331413    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9x9b\" (UniqueName: \"kubernetes.io/projected/e23add91-9559-44af-8220-1a3b0956e7ef-kube-api-access-z9x9b\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-run-netns\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331434    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f07fbbf-a565-4d75-8c14-0231b9d78467-host\") pod \"node-ca-gqdwk\" (UID: \"9f07fbbf-a565-4d75-8c14-0231b9d78467\") " pod="openshift-image-registry/node-ca-gqdwk"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331458    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-sysctl-conf\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-systemd\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-var-lib-kubelet\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331551    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0b88798-8527-4a73-a88f-df113df09d6a-system-cni-dir\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331589    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-var-lib-cni-bin\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331597    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f07fbbf-a565-4d75-8c14-0231b9d78467-serviceca\") pod \"node-ca-gqdwk\" (UID: \"9f07fbbf-a565-4d75-8c14-0231b9d78467\") " pod="openshift-image-registry/node-ca-gqdwk"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331642    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0b88798-8527-4a73-a88f-df113df09d6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.332501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331669    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-var-lib-openvswitch\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.332961 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331684    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-etc-openvswitch\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.332961 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331700    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-var-lib-cni-multus\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.332961 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-sysconfig\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.332961 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-kubernetes\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.332961 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331754    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-sys\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.332961 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331779    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cb3a312-1e9b-4d3d-899c-732658e9719e-tmp-dir\") pod \"node-resolver-z9j2z\" (UID: \"6cb3a312-1e9b-4d3d-899c-732658e9719e\") " pod="openshift-dns/node-resolver-z9j2z"
Jul 07 22:14:23.332961 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331804    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-slash\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.332961 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331827    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-multus-cni-dir\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.332961 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331860    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-run-multus-certs\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.332961 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331884    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.332961 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.331908    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-cni-bin\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.332961 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.332044    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cb3a312-1e9b-4d3d-899c-732658e9719e-tmp-dir\") pod \"node-resolver-z9j2z\" (UID: \"6cb3a312-1e9b-4d3d-899c-732658e9719e\") " pod="openshift-dns/node-resolver-z9j2z"
Jul 07 22:14:23.334356 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.334340    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e35cf280-f6da-4851-821d-84c40d15a85f-agent-certs\") pod \"konnectivity-agent-ltjqr\" (UID: \"e35cf280-f6da-4851-821d-84c40d15a85f\") " pod="kube-system/konnectivity-agent-ltjqr"
Jul 07 22:14:23.339988 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.339961    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rltvt\" (UniqueName: \"kubernetes.io/projected/6cb3a312-1e9b-4d3d-899c-732658e9719e-kube-api-access-rltvt\") pod \"node-resolver-z9j2z\" (UID: \"6cb3a312-1e9b-4d3d-899c-732658e9719e\") " pod="openshift-dns/node-resolver-z9j2z"
Jul 07 22:14:23.340585 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.340562    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptvm9\" (UniqueName: \"kubernetes.io/projected/9f07fbbf-a565-4d75-8c14-0231b9d78467-kube-api-access-ptvm9\") pod \"node-ca-gqdwk\" (UID: \"9f07fbbf-a565-4d75-8c14-0231b9d78467\") " pod="openshift-image-registry/node-ca-gqdwk"
Jul 07 22:14:23.340654 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.340596    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57gwd\" (UniqueName: \"kubernetes.io/projected/64485fd3-8ab7-40b0-a303-93138502f494-kube-api-access-57gwd\") pod \"aws-ebs-csi-driver-node-s7wr6\" (UID: \"64485fd3-8ab7-40b0-a303-93138502f494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.432979 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.432933    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e23add91-9559-44af-8220-1a3b0956e7ef-env-overrides\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.432979 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.432979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-multus-conf-dir\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.432996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-dbus\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433013    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcq9r\" (UniqueName: \"kubernetes.io/projected/68ad71af-9e0f-4867-9981-8283f848b625-kube-api-access-mcq9r\") pod \"iptables-alerter-z8vw5\" (UID: \"68ad71af-9e0f-4867-9981-8283f848b625\") " pod="openshift-network-operator/iptables-alerter-z8vw5"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433033    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-kubelet\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433064    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-multus-conf-dir\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-sysctl-d\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-host\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-node-log\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433240    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e23add91-9559-44af-8220-1a3b0956e7ef-ovn-node-metrics-cert\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433291    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-kubelet\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433303    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-dbus\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433330    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-system-cni-dir\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433346    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-node-log\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433308    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-host\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433356    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-run\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.433424 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433414    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-tmp\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433380    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-sysctl-d\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433418    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-run\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433439    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-system-cni-dir\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-kubelet-config\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-run-ovn\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433510    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-kubelet-config\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-log-socket\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433542    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-cni-netd\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433549    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-run-ovn\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs\") pod \"network-metrics-daemon-m7pwq\" (UID: \"49442a39-eb53-419a-a05d-209c81bba22e\") " pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433573    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-log-socket\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433602    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-cni-netd\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433639    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e23add91-9559-44af-8220-1a3b0956e7ef-env-overrides\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.433647    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:23.434145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-tuned\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-run-openvswitch\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433720    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-run-openvswitch\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.433729    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs podName:49442a39-eb53-419a-a05d-209c81bba22e nodeName:}" failed. No retries permitted until 2026-07-07 22:14:23.93369163 +0000 UTC m=+3.249829034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs") pod "network-metrics-daemon-m7pwq" (UID: "49442a39-eb53-419a-a05d-209c81bba22e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433767    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk98\" (UniqueName: \"kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98\") pod \"network-check-target-92k2m\" (UID: \"a48a3e6e-45b3-48b6-92ee-d350937c8c46\") " pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-lib-modules\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433819    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h5dp\" (UniqueName: \"kubernetes.io/projected/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-kube-api-access-8h5dp\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.433992    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-lib-modules\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n4gw\" (UniqueName: \"kubernetes.io/projected/d0b88798-8527-4a73-a88f-df113df09d6a-kube-api-access-6n4gw\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434051    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-run-netns\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9x9b\" (UniqueName: \"kubernetes.io/projected/e23add91-9559-44af-8220-1a3b0956e7ef-kube-api-access-z9x9b\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-run-netns\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434128    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-run-netns\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434136    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-run-netns\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.435040 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-sysctl-conf\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434314    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-systemd\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434342    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-var-lib-kubelet\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434368    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0b88798-8527-4a73-a88f-df113df09d6a-system-cni-dir\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434394    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-var-lib-cni-bin\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434404    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-sysctl-conf\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434417    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-var-lib-kubelet\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434426    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-systemd\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434421    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0b88798-8527-4a73-a88f-df113df09d6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434466    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d0b88798-8527-4a73-a88f-df113df09d6a-system-cni-dir\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-var-lib-openvswitch\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-etc-openvswitch\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434526    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-var-lib-openvswitch\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434530    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-var-lib-cni-multus\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.436071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434470    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-var-lib-cni-bin\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434556    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-sysconfig\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434581    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-etc-openvswitch\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434583    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d0b88798-8527-4a73-a88f-df113df09d6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434583    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-kubernetes\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434626    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-var-lib-cni-multus\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434627    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-sys\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434627    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-kubernetes\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-slash\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434696    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-multus-cni-dir\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434707    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-sysconfig\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434671    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-sys\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434722    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-run-multus-certs\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434777    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-multus-cni-dir\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.436799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-cni-bin\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434796    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-slash\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434819    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e23add91-9559-44af-8220-1a3b0956e7ef-ovnkube-config\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434855    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-multus-socket-dir-parent\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434860    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-cni-bin\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434828    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-run-multus-certs\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7626485b-4b41-4706-8663-12bd5ef5bffd-multus-daemon-config\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434908    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g2rc\" (UniqueName: \"kubernetes.io/projected/7626485b-4b41-4706-8663-12bd5ef5bffd-kube-api-access-9g2rc\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434918    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-multus-socket-dir-parent\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434934    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0b88798-8527-4a73-a88f-df113df09d6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/68ad71af-9e0f-4867-9981-8283f848b625-iptables-alerter-script\") pod \"iptables-alerter-z8vw5\" (UID: \"68ad71af-9e0f-4867-9981-8283f848b625\") " pod="openshift-network-operator/iptables-alerter-z8vw5"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.434991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-systemd-units\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-run-k8s-cni-cncf-io\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.437389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435044    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-modprobe-d\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435071    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0b88798-8527-4a73-a88f-df113df09d6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e23add91-9559-44af-8220-1a3b0956e7ef-ovnkube-script-lib\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435147    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-cnibin\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435174    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-etc-kubernetes\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435202    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-os-release\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-var-lib-kubelet\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435271    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435296    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0b88798-8527-4a73-a88f-df113df09d6a-cnibin\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435323    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0b88798-8527-4a73-a88f-df113df09d6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435349    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68ad71af-9e0f-4867-9981-8283f848b625-host-slash\") pod \"iptables-alerter-z8vw5\" (UID: \"68ad71af-9e0f-4867-9981-8283f848b625\") " pod="openshift-network-operator/iptables-alerter-z8vw5"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435373    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-run-systemd\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435402    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435424    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e23add91-9559-44af-8220-1a3b0956e7ef-ovnkube-config\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.437872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435433    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7626485b-4b41-4706-8663-12bd5ef5bffd-cni-binary-copy\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-hostroot\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clfwr\" (UniqueName: \"kubernetes.io/projected/49442a39-eb53-419a-a05d-209c81bba22e-kube-api-access-clfwr\") pod \"network-metrics-daemon-m7pwq\" (UID: \"49442a39-eb53-419a-a05d-209c81bba22e\") " pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435511    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-os-release\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0b88798-8527-4a73-a88f-df113df09d6a-os-release\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435545    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7626485b-4b41-4706-8663-12bd5ef5bffd-multus-daemon-config\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435577    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d0b88798-8527-4a73-a88f-df113df09d6a-os-release\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435610    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/68ad71af-9e0f-4867-9981-8283f848b625-host-slash\") pod \"iptables-alerter-z8vw5\" (UID: \"68ad71af-9e0f-4867-9981-8283f848b625\") " pod="openshift-network-operator/iptables-alerter-z8vw5"
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435623    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-run-systemd\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435657    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-var-lib-kubelet\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435667    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.435734    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435760    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d0b88798-8527-4a73-a88f-df113df09d6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.435900    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d0b88798-8527-4a73-a88f-df113df09d6a-cnibin\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.438325 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.435791    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret podName:a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c nodeName:}" failed. No retries permitted until 2026-07-07 22:14:23.935775119 +0000 UTC m=+3.251912524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret") pod "global-pull-secret-syncer-7rp6t" (UID: "a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436136    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/68ad71af-9e0f-4867-9981-8283f848b625-iptables-alerter-script\") pod \"iptables-alerter-z8vw5\" (UID: \"68ad71af-9e0f-4867-9981-8283f848b625\") " pod="openshift-network-operator/iptables-alerter-z8vw5"
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436214    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-cnibin\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436225    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7626485b-4b41-4706-8663-12bd5ef5bffd-cni-binary-copy\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436256    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-etc-kubernetes\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436316    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-hostroot\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436315    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d0b88798-8527-4a73-a88f-df113df09d6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436361    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7626485b-4b41-4706-8663-12bd5ef5bffd-host-run-k8s-cni-cncf-io\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436412    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e23add91-9559-44af-8220-1a3b0956e7ef-systemd-units\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436474    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-modprobe-d\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436667    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d0b88798-8527-4a73-a88f-df113df09d6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436681    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e23add91-9559-44af-8220-1a3b0956e7ef-ovn-node-metrics-cert\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436706    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-etc-tuned\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436874    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-tmp\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.438896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.436957    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e23add91-9559-44af-8220-1a3b0956e7ef-ovnkube-script-lib\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.440847 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.440828    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:14:23.440847 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.440848    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:14:23.441021 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.440859    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5zk98 for pod openshift-network-diagnostics/network-check-target-92k2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:23.441021 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.440903    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98 podName:a48a3e6e-45b3-48b6-92ee-d350937c8c46 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:23.940890042 +0000 UTC m=+3.257027451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk98" (UniqueName: "kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98") pod "network-check-target-92k2m" (UID: "a48a3e6e-45b3-48b6-92ee-d350937c8c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:23.444498 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.443623    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h5dp\" (UniqueName: \"kubernetes.io/projected/5fdca045-4dc1-447d-9ca2-5a5ab1ffa669-kube-api-access-8h5dp\") pod \"tuned-72lms\" (UID: \"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669\") " pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.445722 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.445695    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcq9r\" (UniqueName: \"kubernetes.io/projected/68ad71af-9e0f-4867-9981-8283f848b625-kube-api-access-mcq9r\") pod \"iptables-alerter-z8vw5\" (UID: \"68ad71af-9e0f-4867-9981-8283f848b625\") " pod="openshift-network-operator/iptables-alerter-z8vw5"
Jul 07 22:14:23.445922 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.445902    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clfwr\" (UniqueName: \"kubernetes.io/projected/49442a39-eb53-419a-a05d-209c81bba22e-kube-api-access-clfwr\") pod \"network-metrics-daemon-m7pwq\" (UID: \"49442a39-eb53-419a-a05d-209c81bba22e\") " pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:23.446166 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.446143    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n4gw\" (UniqueName: \"kubernetes.io/projected/d0b88798-8527-4a73-a88f-df113df09d6a-kube-api-access-6n4gw\") pod \"multus-additional-cni-plugins-r4qhq\" (UID: \"d0b88798-8527-4a73-a88f-df113df09d6a\") " pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.446758 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.446730    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9x9b\" (UniqueName: \"kubernetes.io/projected/e23add91-9559-44af-8220-1a3b0956e7ef-kube-api-access-z9x9b\") pod \"ovnkube-node-hjkqk\" (UID: \"e23add91-9559-44af-8220-1a3b0956e7ef\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.447134 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.447112    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g2rc\" (UniqueName: \"kubernetes.io/projected/7626485b-4b41-4706-8663-12bd5ef5bffd-kube-api-access-9g2rc\") pod \"multus-v67vf\" (UID: \"7626485b-4b41-4706-8663-12bd5ef5bffd\") " pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.522638 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.522600    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-gqdwk"
Jul 07 22:14:23.529354 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.529323    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z9j2z"
Jul 07 22:14:23.535301 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.535257    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ltjqr"
Jul 07 22:14:23.545312 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:23.545259    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f07fbbf_a565_4d75_8c14_0231b9d78467.slice/crio-f6a57eed8a3f5bb90dab24b3398334d4297aa97da32490619375cc42bee54804 WatchSource:0}: Error finding container f6a57eed8a3f5bb90dab24b3398334d4297aa97da32490619375cc42bee54804: Status 404 returned error can't find the container with id f6a57eed8a3f5bb90dab24b3398334d4297aa97da32490619375cc42bee54804
Jul 07 22:14:23.545848 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:23.545823    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651afb1b5549eafbdf78c97ea2bcc023.slice/crio-d1c4b040f30509bafa4bce4f21af2c6cfc42aa569745c706d28ee41943fad5b9 WatchSource:0}: Error finding container d1c4b040f30509bafa4bce4f21af2c6cfc42aa569745c706d28ee41943fad5b9: Status 404 returned error can't find the container with id d1c4b040f30509bafa4bce4f21af2c6cfc42aa569745c706d28ee41943fad5b9
Jul 07 22:14:23.546546 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:23.546523    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc498ee23fe81a2779731e4b1b636e573.slice/crio-d0ef188e2cf036e3f66c965bb806f996af59a44812181db68dfe0cd674c6d3f9 WatchSource:0}: Error finding container d0ef188e2cf036e3f66c965bb806f996af59a44812181db68dfe0cd674c6d3f9: Status 404 returned error can't find the container with id d0ef188e2cf036e3f66c965bb806f996af59a44812181db68dfe0cd674c6d3f9
Jul 07 22:14:23.548090 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:23.548066    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb3a312_1e9b_4d3d_899c_732658e9719e.slice/crio-271a2719d42b09d4435e247f46869561e3f8fee98dee4f8083c5faff7039523f WatchSource:0}: Error finding container 271a2719d42b09d4435e247f46869561e3f8fee98dee4f8083c5faff7039523f: Status 404 returned error can't find the container with id 271a2719d42b09d4435e247f46869561e3f8fee98dee4f8083c5faff7039523f
Jul 07 22:14:23.550019 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:23.549997    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35cf280_f6da_4851_821d_84c40d15a85f.slice/crio-bd87ca29303ca0e360901f8dc5e87673ef5e8395e27839f5abb26d388758e2a6 WatchSource:0}: Error finding container bd87ca29303ca0e360901f8dc5e87673ef5e8395e27839f5abb26d388758e2a6: Status 404 returned error can't find the container with id bd87ca29303ca0e360901f8dc5e87673ef5e8395e27839f5abb26d388758e2a6
Jul 07 22:14:23.551288 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.551262    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 22:14:23.571307 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.571269    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6"
Jul 07 22:14:23.578659 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.578631    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-72lms"
Jul 07 22:14:23.582177 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:23.582146    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64485fd3_8ab7_40b0_a303_93138502f494.slice/crio-ca64cccb95046a029735e80b1df0a75fef759c202cdf1827a8e40fc4f5583e49 WatchSource:0}: Error finding container ca64cccb95046a029735e80b1df0a75fef759c202cdf1827a8e40fc4f5583e49: Status 404 returned error can't find the container with id ca64cccb95046a029735e80b1df0a75fef759c202cdf1827a8e40fc4f5583e49
Jul 07 22:14:23.587011 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:23.586986    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fdca045_4dc1_447d_9ca2_5a5ab1ffa669.slice/crio-1027aa48d711a16b3f0eab6a9a9b3535fc27316acc21c3e55e5162d692682f6a WatchSource:0}: Error finding container 1027aa48d711a16b3f0eab6a9a9b3535fc27316acc21c3e55e5162d692682f6a: Status 404 returned error can't find the container with id 1027aa48d711a16b3f0eab6a9a9b3535fc27316acc21c3e55e5162d692682f6a
Jul 07 22:14:23.602454 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.602428    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r4qhq"
Jul 07 22:14:23.610952 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:23.610929    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b88798_8527_4a73_a88f_df113df09d6a.slice/crio-a7b9ab21044612bfe52ac8a221027f0a0b00f5c72a33d00a90a513a472337ba5 WatchSource:0}: Error finding container a7b9ab21044612bfe52ac8a221027f0a0b00f5c72a33d00a90a513a472337ba5: Status 404 returned error can't find the container with id a7b9ab21044612bfe52ac8a221027f0a0b00f5c72a33d00a90a513a472337ba5
Jul 07 22:14:23.620118 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.620097    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z8vw5"
Jul 07 22:14:23.625406 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.625387    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:23.627998 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:23.627956    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ad71af_9e0f_4867_9981_8283f848b625.slice/crio-74fe7a0cbfe3d09b373d49151c7dd774456fc97eb8a463716bec9a5ab797e8d7 WatchSource:0}: Error finding container 74fe7a0cbfe3d09b373d49151c7dd774456fc97eb8a463716bec9a5ab797e8d7: Status 404 returned error can't find the container with id 74fe7a0cbfe3d09b373d49151c7dd774456fc97eb8a463716bec9a5ab797e8d7
Jul 07 22:14:23.633968 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:23.633936    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23add91_9559_44af_8220_1a3b0956e7ef.slice/crio-c1b0ca2043b23dacc0b72ab777d8162a3227b13f1e628503fbd5cc037381b21a WatchSource:0}: Error finding container c1b0ca2043b23dacc0b72ab777d8162a3227b13f1e628503fbd5cc037381b21a: Status 404 returned error can't find the container with id c1b0ca2043b23dacc0b72ab777d8162a3227b13f1e628503fbd5cc037381b21a
Jul 07 22:14:23.651305 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.651282    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v67vf"
Jul 07 22:14:23.659712 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:23.659685    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7626485b_4b41_4706_8663_12bd5ef5bffd.slice/crio-ccf7ca7335c84d539c7b43b6536563a4fbbc6d66916de5b066ec621f4b7cc657 WatchSource:0}: Error finding container ccf7ca7335c84d539c7b43b6536563a4fbbc6d66916de5b066ec621f4b7cc657: Status 404 returned error can't find the container with id ccf7ca7335c84d539c7b43b6536563a4fbbc6d66916de5b066ec621f4b7cc657
Jul 07 22:14:23.661467 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.661445    2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container kube-multus start failed in pod multus-v67vf_openshift-multus(7626485b-4b41-4706-8663-12bd5ef5bffd): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 07 22:14:23.661553 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.661481    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-multus/multus-v67vf" podUID="7626485b-4b41-4706-8663-12bd5ef5bffd"
Jul 07 22:14:23.939140 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.939046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:23.939140 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:23.939102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs\") pod \"network-metrics-daemon-m7pwq\" (UID: \"49442a39-eb53-419a-a05d-209c81bba22e\") " pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:23.939347 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.939191    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:23.939347 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.939241    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:23.939347 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.939279    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs podName:49442a39-eb53-419a-a05d-209c81bba22e nodeName:}" failed. No retries permitted until 2026-07-07 22:14:24.939260358 +0000 UTC m=+4.255397766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs") pod "network-metrics-daemon-m7pwq" (UID: "49442a39-eb53-419a-a05d-209c81bba22e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:23.939347 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:23.939297    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret podName:a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c nodeName:}" failed. No retries permitted until 2026-07-07 22:14:24.939288515 +0000 UTC m=+4.255425920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret") pod "global-pull-secret-syncer-7rp6t" (UID: "a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:24.040091 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.040052    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk98\" (UniqueName: \"kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98\") pod \"network-check-target-92k2m\" (UID: \"a48a3e6e-45b3-48b6-92ee-d350937c8c46\") " pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:24.040319 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:24.040205    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:14:24.040319 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:24.040252    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:14:24.040319 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:24.040277    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5zk98 for pod openshift-network-diagnostics/network-check-target-92k2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:24.040500 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:24.040343    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98 podName:a48a3e6e-45b3-48b6-92ee-d350937c8c46 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:25.040323549 +0000 UTC m=+4.356460956 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk98" (UniqueName: "kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98") pod "network-check-target-92k2m" (UID: "a48a3e6e-45b3-48b6-92ee-d350937c8c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:24.254829 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.254596    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 22:09:23 +0000 UTC" deadline="2028-01-09 16:29:22.656061471 +0000 UTC"
Jul 07 22:14:24.255640 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.254835    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13218h14m58.401246516s"
Jul 07 22:14:24.294938 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.294812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4qhq" event={"ID":"d0b88798-8527-4a73-a88f-df113df09d6a","Type":"ContainerStarted","Data":"a7b9ab21044612bfe52ac8a221027f0a0b00f5c72a33d00a90a513a472337ba5"}
Jul 07 22:14:24.298077 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.298046    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-72lms" event={"ID":"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669","Type":"ContainerStarted","Data":"1027aa48d711a16b3f0eab6a9a9b3535fc27316acc21c3e55e5162d692682f6a"}
Jul 07 22:14:24.301541 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.301511    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6" event={"ID":"64485fd3-8ab7-40b0-a303-93138502f494","Type":"ContainerStarted","Data":"ca64cccb95046a029735e80b1df0a75fef759c202cdf1827a8e40fc4f5583e49"}
Jul 07 22:14:24.304309 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.304280    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z9j2z" event={"ID":"6cb3a312-1e9b-4d3d-899c-732658e9719e","Type":"ContainerStarted","Data":"271a2719d42b09d4435e247f46869561e3f8fee98dee4f8083c5faff7039523f"}
Jul 07 22:14:24.307976 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.307940    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gqdwk" event={"ID":"9f07fbbf-a565-4d75-8c14-0231b9d78467","Type":"ContainerStarted","Data":"f6a57eed8a3f5bb90dab24b3398334d4297aa97da32490619375cc42bee54804"}
Jul 07 22:14:24.316736 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.316707    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" event={"ID":"c498ee23fe81a2779731e4b1b636e573","Type":"ContainerStarted","Data":"d0ef188e2cf036e3f66c965bb806f996af59a44812181db68dfe0cd674c6d3f9"}
Jul 07 22:14:24.321622 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.321592    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk" event={"ID":"e23add91-9559-44af-8220-1a3b0956e7ef","Type":"ContainerStarted","Data":"c1b0ca2043b23dacc0b72ab777d8162a3227b13f1e628503fbd5cc037381b21a"}
Jul 07 22:14:24.324843 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.324815    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ltjqr" event={"ID":"e35cf280-f6da-4851-821d-84c40d15a85f","Type":"ContainerStarted","Data":"bd87ca29303ca0e360901f8dc5e87673ef5e8395e27839f5abb26d388758e2a6"}
Jul 07 22:14:24.329147 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.329120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" event={"ID":"651afb1b5549eafbdf78c97ea2bcc023","Type":"ContainerStarted","Data":"d1c4b040f30509bafa4bce4f21af2c6cfc42aa569745c706d28ee41943fad5b9"}
Jul 07 22:14:24.339548 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.339517    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v67vf" event={"ID":"7626485b-4b41-4706-8663-12bd5ef5bffd","Type":"ContainerStarted","Data":"ccf7ca7335c84d539c7b43b6536563a4fbbc6d66916de5b066ec621f4b7cc657"}
Jul 07 22:14:24.344881 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:24.344612    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-multus\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:55ec7147f859301bbb8288966c8a21c5db729200f3c3d91db671978baef79517\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-multus/multus-v67vf" podUID="7626485b-4b41-4706-8663-12bd5ef5bffd"
Jul 07 22:14:24.350122 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.350093    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z8vw5" event={"ID":"68ad71af-9e0f-4867-9981-8283f848b625","Type":"ContainerStarted","Data":"74fe7a0cbfe3d09b373d49151c7dd774456fc97eb8a463716bec9a5ab797e8d7"}
Jul 07 22:14:24.948906 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.948038    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs\") pod \"network-metrics-daemon-m7pwq\" (UID: \"49442a39-eb53-419a-a05d-209c81bba22e\") " pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:24.948906 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:24.948140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:24.948906 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:24.948308    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:24.948906 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:24.948374    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret podName:a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c nodeName:}" failed. No retries permitted until 2026-07-07 22:14:26.948355104 +0000 UTC m=+6.264492511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret") pod "global-pull-secret-syncer-7rp6t" (UID: "a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:24.948906 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:24.948809    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:24.948906 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:24.948866    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs podName:49442a39-eb53-419a-a05d-209c81bba22e nodeName:}" failed. No retries permitted until 2026-07-07 22:14:26.948848746 +0000 UTC m=+6.264986154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs") pod "network-metrics-daemon-m7pwq" (UID: "49442a39-eb53-419a-a05d-209c81bba22e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:25.049529 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:25.048856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk98\" (UniqueName: \"kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98\") pod \"network-check-target-92k2m\" (UID: \"a48a3e6e-45b3-48b6-92ee-d350937c8c46\") " pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:25.049529 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:25.049053    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:14:25.049529 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:25.049076    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:14:25.049529 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:25.049090    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5zk98 for pod openshift-network-diagnostics/network-check-target-92k2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:25.049529 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:25.049160    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98 podName:a48a3e6e-45b3-48b6-92ee-d350937c8c46 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:27.049140319 +0000 UTC m=+6.365277727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk98" (UniqueName: "kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98") pod "network-check-target-92k2m" (UID: "a48a3e6e-45b3-48b6-92ee-d350937c8c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:25.236553 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:25.236131    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 22:14:25.255402 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:25.255334    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 22:09:23 +0000 UTC" deadline="2028-01-16 16:52:13.533594184 +0000 UTC"
Jul 07 22:14:25.255402 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:25.255399    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13386h37m48.278199396s"
Jul 07 22:14:25.287753 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:25.287720    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:25.287951 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:25.287860    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:25.288333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:25.288309    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:25.288439 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:25.288423    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:25.288512 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:25.288489    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:25.288592 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:25.288573    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:26.968505 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:26.968464    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs\") pod \"network-metrics-daemon-m7pwq\" (UID: \"49442a39-eb53-419a-a05d-209c81bba22e\") " pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:26.969028 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:26.968556    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:26.969028 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:26.968714    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:26.969028 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:26.968786    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret podName:a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c nodeName:}" failed. No retries permitted until 2026-07-07 22:14:30.968762779 +0000 UTC m=+10.284900195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret") pod "global-pull-secret-syncer-7rp6t" (UID: "a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:26.969028 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:26.968879    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:26.969028 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:26.968949    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs podName:49442a39-eb53-419a-a05d-209c81bba22e nodeName:}" failed. No retries permitted until 2026-07-07 22:14:30.968929717 +0000 UTC m=+10.285067123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs") pod "network-metrics-daemon-m7pwq" (UID: "49442a39-eb53-419a-a05d-209c81bba22e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:27.070032 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:27.069811    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk98\" (UniqueName: \"kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98\") pod \"network-check-target-92k2m\" (UID: \"a48a3e6e-45b3-48b6-92ee-d350937c8c46\") " pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:27.070032 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:27.070024    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:14:27.070320 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:27.070054    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:14:27.070320 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:27.070068    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5zk98 for pod openshift-network-diagnostics/network-check-target-92k2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:27.070320 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:27.070135    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98 podName:a48a3e6e-45b3-48b6-92ee-d350937c8c46 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:31.070120078 +0000 UTC m=+10.386257482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk98" (UniqueName: "kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98") pod "network-check-target-92k2m" (UID: "a48a3e6e-45b3-48b6-92ee-d350937c8c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:27.287461 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:27.287373    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:27.287461 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:27.287415    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:27.287660 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:27.287392    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:27.287660 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:27.287524    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:27.287778 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:27.287661    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:27.287778 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:27.287752    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:29.287381 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:29.287342    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:29.287381 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:29.287366    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:29.287381 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:29.287379    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:29.287942 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:29.287477    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:29.287942 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:29.287579    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:29.287942 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:29.287637    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:31.000786 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:31.000741    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:31.001287 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:31.000809    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs\") pod \"network-metrics-daemon-m7pwq\" (UID: \"49442a39-eb53-419a-a05d-209c81bba22e\") " pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:31.001287 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:31.000925    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:31.001287 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:31.001011    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret podName:a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c nodeName:}" failed. No retries permitted until 2026-07-07 22:14:39.000990054 +0000 UTC m=+18.317127479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret") pod "global-pull-secret-syncer-7rp6t" (UID: "a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:31.001287 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:31.000925    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:31.001287 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:31.001087    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs podName:49442a39-eb53-419a-a05d-209c81bba22e nodeName:}" failed. No retries permitted until 2026-07-07 22:14:39.001069278 +0000 UTC m=+18.317206698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs") pod "network-metrics-daemon-m7pwq" (UID: "49442a39-eb53-419a-a05d-209c81bba22e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:31.102208 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:31.102149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk98\" (UniqueName: \"kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98\") pod \"network-check-target-92k2m\" (UID: \"a48a3e6e-45b3-48b6-92ee-d350937c8c46\") " pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:31.102379 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:31.102356    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:14:31.102441 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:31.102385    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:14:31.102441 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:31.102399    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5zk98 for pod openshift-network-diagnostics/network-check-target-92k2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:31.102540 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:31.102468    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98 podName:a48a3e6e-45b3-48b6-92ee-d350937c8c46 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:39.102450378 +0000 UTC m=+18.418587787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk98" (UniqueName: "kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98") pod "network-check-target-92k2m" (UID: "a48a3e6e-45b3-48b6-92ee-d350937c8c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:31.287459 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:31.287380    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:31.287608 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:31.287380    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:31.287608 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:31.287520    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:31.287608 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:31.287541    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:31.287608 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:31.287379    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:31.287808 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:31.287614    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:33.287248 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:33.286738    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:33.287248 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:33.286746    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:33.287248 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:33.286879    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:33.287248 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:33.286746    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:33.287248 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:33.286986    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:33.287248 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:33.287097    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:34.383550 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:34.383313    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4qhq" event={"ID":"d0b88798-8527-4a73-a88f-df113df09d6a","Type":"ContainerStarted","Data":"6a0f75c9511c858c18051ec405fea97c56782625c3614ed67dbdf1fa5247bb8f"}
Jul 07 22:14:34.386887 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:34.386856    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-72lms" event={"ID":"5fdca045-4dc1-447d-9ca2-5a5ab1ffa669","Type":"ContainerStarted","Data":"c2a47d9843dfc0813b3ce82e5a5fc8331dfd132dd9b29f73852ada6d8ea939c3"}
Jul 07 22:14:34.388518 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:34.388491    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6" event={"ID":"64485fd3-8ab7-40b0-a303-93138502f494","Type":"ContainerStarted","Data":"2cf2a2c476cdeeeb248b65bb3c3e61b7d49c105347c64e2d5b3d6474cab93ad3"}
Jul 07 22:14:34.391455 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:34.391405    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z9j2z" event={"ID":"6cb3a312-1e9b-4d3d-899c-732658e9719e","Type":"ContainerStarted","Data":"32408138086ee7eb72607dd2edce25ad24b28c69bbab8ce11eca3c2972818de0"}
Jul 07 22:14:34.393492 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:34.393467    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-gqdwk" event={"ID":"9f07fbbf-a565-4d75-8c14-0231b9d78467","Type":"ContainerStarted","Data":"7ea114937e2ace0b431ccf8f767d73ac90ee3234ed9a02940371560c5a67af0b"}
Jul 07 22:14:34.396474 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:34.396450    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" event={"ID":"c498ee23fe81a2779731e4b1b636e573","Type":"ContainerStarted","Data":"7a3b2aee45e6b3e9cdf3125a784a62f85e89bb40d315f16b16632f46482a5b3f"}
Jul 07 22:14:34.398466 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:34.398443    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ltjqr" event={"ID":"e35cf280-f6da-4851-821d-84c40d15a85f","Type":"ContainerStarted","Data":"3ad9230e74afa3904c91dd88eadef4327b30488496265f1726a3fb7b48d51663"}
Jul 07 22:14:34.400547 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:34.400524    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" event={"ID":"651afb1b5549eafbdf78c97ea2bcc023","Type":"ContainerStarted","Data":"405ab7269b5e80606ef9d7ee75a992a575fda88b4e29c7db4699f5a025d083b6"}
Jul 07 22:14:34.470020 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:34.469952    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-229.ec2.internal" podStartSLOduration=12.469933338 podStartE2EDuration="12.469933338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:14:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:14:34.454291171 +0000 UTC m=+13.770428597" watchObservedRunningTime="2026-07-07 22:14:34.469933338 +0000 UTC m=+13.786070765"
Jul 07 22:14:34.470139 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:34.470059    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z9j2z" podStartSLOduration=2.068722029 podStartE2EDuration="12.470051984s" totalImagesPullingTime="10.401329955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:14:34.469872488 +0000 UTC m=+13.786009915" watchObservedRunningTime="2026-07-07 22:14:34.470051984 +0000 UTC m=+13.786189411"
Jul 07 22:14:34.485311 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:34.485255    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ltjqr" podStartSLOduration=2.050286243 podStartE2EDuration="12.48523356s" totalImagesPullingTime="10.434947317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:14:34.484710103 +0000 UTC m=+13.800847531" watchObservedRunningTime="2026-07-07 22:14:34.48523356 +0000 UTC m=+13.801370986"
Jul 07 22:14:34.501628 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:34.501572    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-gqdwk" podStartSLOduration=2.0882160770000002 podStartE2EDuration="12.501552804s" totalImagesPullingTime="10.413336727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:14:34.501284985 +0000 UTC m=+13.817422411" watchObservedRunningTime="2026-07-07 22:14:34.501552804 +0000 UTC m=+13.817690228"
Jul 07 22:14:34.517635 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:34.517592    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-72lms" podStartSLOduration=2.076835198 podStartE2EDuration="12.517576351s" totalImagesPullingTime="10.440741153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:14:34.517311612 +0000 UTC m=+13.833449038" watchObservedRunningTime="2026-07-07 22:14:34.517576351 +0000 UTC m=+13.833713777"
Jul 07 22:14:35.287143 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:35.287109    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:35.287353 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:35.287114    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:35.287353 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:35.287267    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:35.287353 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:35.287259    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:35.287494 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:35.287362    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:35.287494 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:35.287452    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:35.404210 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:35.404165    2561 generic.go:356] "Generic (PLEG): container finished" podID="d0b88798-8527-4a73-a88f-df113df09d6a" containerID="6a0f75c9511c858c18051ec405fea97c56782625c3614ed67dbdf1fa5247bb8f" exitCode=0
Jul 07 22:14:35.404662 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:35.404231    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4qhq" event={"ID":"d0b88798-8527-4a73-a88f-df113df09d6a","Type":"ContainerDied","Data":"6a0f75c9511c858c18051ec405fea97c56782625c3614ed67dbdf1fa5247bb8f"}
Jul 07 22:14:35.406645 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:35.406524    2561 generic.go:356] "Generic (PLEG): container finished" podID="c498ee23fe81a2779731e4b1b636e573" containerID="7a3b2aee45e6b3e9cdf3125a784a62f85e89bb40d315f16b16632f46482a5b3f" exitCode=0
Jul 07 22:14:35.406645 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:35.406615    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" event={"ID":"c498ee23fe81a2779731e4b1b636e573","Type":"ContainerDied","Data":"7a3b2aee45e6b3e9cdf3125a784a62f85e89bb40d315f16b16632f46482a5b3f"}
Jul 07 22:14:35.406811 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:35.406669    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" event={"ID":"c498ee23fe81a2779731e4b1b636e573","Type":"ContainerStarted","Data":"128be27edd688a76982fdcf24f58a30dd6be27b02873490a54df17868cb7379a"}
Jul 07 22:14:35.442340 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:35.442282    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-229.ec2.internal" podStartSLOduration=13.44225985 podStartE2EDuration="13.44225985s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:14:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:14:35.442259118 +0000 UTC m=+14.758396545" watchObservedRunningTime="2026-07-07 22:14:35.44225985 +0000 UTC m=+14.758397280"
Jul 07 22:14:36.255738 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:36.255496    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ltjqr"
Jul 07 22:14:36.256207 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:36.256176    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ltjqr"
Jul 07 22:14:36.412925 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:36.412884    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z8vw5" event={"ID":"68ad71af-9e0f-4867-9981-8283f848b625","Type":"ContainerStarted","Data":"e30679f50bd9bd6fb9e8fe5b4b8a3b8ca2818a09ec504a0a2352d4cfd74fb0b0"}
Jul 07 22:14:36.429210 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:36.429140    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z8vw5" podStartSLOduration=4.068457501 podStartE2EDuration="14.429122854s" totalImagesPullingTime="10.360665353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:14:36.428691816 +0000 UTC m=+15.744829241" watchObservedRunningTime="2026-07-07 22:14:36.429122854 +0000 UTC m=+15.745260276"
Jul 07 22:14:37.287626 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:37.287587    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:37.287815 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:37.287640    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:37.287815 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:37.287587    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:37.287815 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:37.287709    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:37.287977 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:37.287815    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:37.287977 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:37.287890    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:37.414792 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:37.414759    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 22:14:39.060329 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:39.060287    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:39.060959 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:39.060350    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs\") pod \"network-metrics-daemon-m7pwq\" (UID: \"49442a39-eb53-419a-a05d-209c81bba22e\") " pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:39.060959 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:39.060443    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:39.060959 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:39.060445    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:39.060959 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:39.060511    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs podName:49442a39-eb53-419a-a05d-209c81bba22e nodeName:}" failed. No retries permitted until 2026-07-07 22:14:55.060494581 +0000 UTC m=+34.376631995 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs") pod "network-metrics-daemon-m7pwq" (UID: "49442a39-eb53-419a-a05d-209c81bba22e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:39.060959 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:39.060526    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret podName:a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c nodeName:}" failed. No retries permitted until 2026-07-07 22:14:55.060520181 +0000 UTC m=+34.376657583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret") pod "global-pull-secret-syncer-7rp6t" (UID: "a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:39.160694 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:39.160657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk98\" (UniqueName: \"kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98\") pod \"network-check-target-92k2m\" (UID: \"a48a3e6e-45b3-48b6-92ee-d350937c8c46\") " pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:39.160853 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:39.160807    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:14:39.160853 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:39.160847    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:14:39.160965 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:39.160866    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5zk98 for pod openshift-network-diagnostics/network-check-target-92k2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:39.160965 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:39.160931    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98 podName:a48a3e6e-45b3-48b6-92ee-d350937c8c46 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:55.16091579 +0000 UTC m=+34.477053198 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk98" (UniqueName: "kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98") pod "network-check-target-92k2m" (UID: "a48a3e6e-45b3-48b6-92ee-d350937c8c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:39.287421 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:39.287382    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:39.287615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:39.287390    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:39.287615 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:39.287506    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:39.287615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:39.287391    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:39.287615 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:39.287584    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:39.287841 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:39.287692    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:39.638349 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:39.638041    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 22:14:40.236636 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:40.236522    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T22:14:39.638264852Z","UUID":"04b2f3d2-e764-44a6-bded-8da40d5672f8","Handler":null,"Name":"","Endpoint":""}
Jul 07 22:14:40.238626 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:40.238605    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 22:14:40.238748 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:40.238646    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 22:14:40.423349 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:40.423308    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6" event={"ID":"64485fd3-8ab7-40b0-a303-93138502f494","Type":"ContainerStarted","Data":"3be4c3f159029d1acef7e335ca1571f9c413f340ec9f14e0f1cc871c367a7c3e"}
Jul 07 22:14:40.427128 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:40.427096    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk" event={"ID":"e23add91-9559-44af-8220-1a3b0956e7ef","Type":"ContainerStarted","Data":"2dbeefaf2e4136173f07b8d7ae3ca2f6475ab57d3f0ad3199ac96c2c350ff016"}
Jul 07 22:14:40.427261 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:40.427161    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk" event={"ID":"e23add91-9559-44af-8220-1a3b0956e7ef","Type":"ContainerStarted","Data":"a7449d8836e3af76fa3ccef221082b060924e57631adc59e58bca36ded36a153"}
Jul 07 22:14:40.427261 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:40.427207    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk" event={"ID":"e23add91-9559-44af-8220-1a3b0956e7ef","Type":"ContainerStarted","Data":"9ea2b7ede788338d15552d53c1ad98c52bfbf6ed4c0f4bc5ceb02a5ef37d4039"}
Jul 07 22:14:40.427261 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:40.427236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk" event={"ID":"e23add91-9559-44af-8220-1a3b0956e7ef","Type":"ContainerStarted","Data":"8719743ed4712c6676da921240ebb60220dabd6762e887bb38fc7d4af28f3314"}
Jul 07 22:14:40.427379 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:40.427264    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk" event={"ID":"e23add91-9559-44af-8220-1a3b0956e7ef","Type":"ContainerStarted","Data":"e51ba1ff048947d474632bbb3b79b92898af115bc543cd2cb7924853bdbbe26e"}
Jul 07 22:14:40.427379 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:40.427290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk" event={"ID":"e23add91-9559-44af-8220-1a3b0956e7ef","Type":"ContainerStarted","Data":"708483fe0ea374e6c990b33a0bd3dbda5b701c0fab181a3b6c07ab63d4892e63"}
Jul 07 22:14:41.287409 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:41.287227    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:41.287897 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:41.287228    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:41.287897 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:41.287490    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:41.287897 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:41.287274    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:41.287897 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:41.287601    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:41.287897 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:41.287644    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:41.432872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:41.432700    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6" event={"ID":"64485fd3-8ab7-40b0-a303-93138502f494","Type":"ContainerStarted","Data":"0e08af8a45437a7e0a47b9ca55ca6ddb1a4bc748d9cdbef49ba3c7116d009bc9"}
Jul 07 22:14:41.452178 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:41.452130    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s7wr6" podStartSLOduration=2.915193649 podStartE2EDuration="19.452115708s" totalImagesPullingTime="16.536922059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:14:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:14:41.450620966 +0000 UTC m=+20.766758410" watchObservedRunningTime="2026-07-07 22:14:41.452115708 +0000 UTC m=+20.768253133"
Jul 07 22:14:42.439399 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:42.439360    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk" event={"ID":"e23add91-9559-44af-8220-1a3b0956e7ef","Type":"ContainerStarted","Data":"13d3f1b10e798e63cd27577c8352042b125479d1b10259aefa9633bbf454d305"}
Jul 07 22:14:43.287049 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:43.287008    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:43.287049 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:43.287050    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:43.287331 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:43.287139    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:43.287331 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:43.287147    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:43.287331 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:43.287271    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:43.287496 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:43.287366    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:45.287098 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:45.286847    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:45.287810 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:45.286869    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:45.287810 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:45.286895    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:45.287810 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:45.287217    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:45.287810 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:45.287294    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:45.287810 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:45.287373    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:45.448477 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:45.448446    2561 generic.go:356] "Generic (PLEG): container finished" podID="d0b88798-8527-4a73-a88f-df113df09d6a" containerID="266193de9dfa633bfb335641f52988e8f95815a6370be9acf11a257e95ed0667" exitCode=0
Jul 07 22:14:45.448629 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:45.448555    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4qhq" event={"ID":"d0b88798-8527-4a73-a88f-df113df09d6a","Type":"ContainerDied","Data":"266193de9dfa633bfb335641f52988e8f95815a6370be9acf11a257e95ed0667"}
Jul 07 22:14:45.453123 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:45.453095    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk" event={"ID":"e23add91-9559-44af-8220-1a3b0956e7ef","Type":"ContainerStarted","Data":"4cdc57eea05a90a29eb437fc7ba5f757f5198e9566d9920f63e20b02aeba8255"}
Jul 07 22:14:45.453489 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:45.453469    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:45.474092 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:45.474062    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:45.498058 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:45.498014    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk" podStartSLOduration=6.573322645 podStartE2EDuration="22.497995791s" totalImagesPullingTime="15.924673146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:14:45.497898382 +0000 UTC m=+24.814035808" watchObservedRunningTime="2026-07-07 22:14:45.497995791 +0000 UTC m=+24.814133217"
Jul 07 22:14:46.457628 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:46.457589    2561 generic.go:356] "Generic (PLEG): container finished" podID="d0b88798-8527-4a73-a88f-df113df09d6a" containerID="55f77d2853ef4a6cf5ab55f4803ca4f7566e9a4b416cf3cd8b6b3bdfc4957910" exitCode=0
Jul 07 22:14:46.458016 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:46.457668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4qhq" event={"ID":"d0b88798-8527-4a73-a88f-df113df09d6a","Type":"ContainerDied","Data":"55f77d2853ef4a6cf5ab55f4803ca4f7566e9a4b416cf3cd8b6b3bdfc4957910"}
Jul 07 22:14:46.458935 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:46.458416    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:46.458935 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:46.458480    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:46.476644 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:46.476618    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:14:46.840952 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:46.840917    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-92k2m"]
Jul 07 22:14:46.841118 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:46.841086    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:46.841243 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:46.841188    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:46.844428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:46.844382    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7rp6t"]
Jul 07 22:14:46.844558 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:46.844530    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:46.844661 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:46.844641    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:46.844946 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:46.844919    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m7pwq"]
Jul 07 22:14:46.845031 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:46.845020    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:46.845162 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:46.845111    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:47.463160 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:47.463130    2561 generic.go:356] "Generic (PLEG): container finished" podID="d0b88798-8527-4a73-a88f-df113df09d6a" containerID="71a137cee7b629782a4311618c31411721920cbf52f2a0df829c668bfc0929d3" exitCode=0
Jul 07 22:14:47.463609 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:47.463233    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4qhq" event={"ID":"d0b88798-8527-4a73-a88f-df113df09d6a","Type":"ContainerDied","Data":"71a137cee7b629782a4311618c31411721920cbf52f2a0df829c668bfc0929d3"}
Jul 07 22:14:48.287211 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:48.287164    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:48.287573 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:48.287545    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:48.287737 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:48.287233    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:48.287840 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:48.287815    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:48.737108 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:48.736765    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ltjqr"
Jul 07 22:14:48.737108 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:48.736917    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 22:14:48.738265 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:48.738244    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ltjqr"
Jul 07 22:14:49.286669 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:49.286640    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:49.286850 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:49.286792    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:50.287177 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:50.286976    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:50.287741 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:50.286991    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:50.287741 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:50.287272    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:50.287741 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:50.287364    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:51.286963 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:51.286929    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:51.287138 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:51.287080    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:52.287906 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:52.287876    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:52.288371 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:52.287983    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:52.288371 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:52.288020    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:52.288371 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:52.288120    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:53.287271 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:53.287233    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:53.287441 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:53.287353    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:54.287075 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:54.287036    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:54.287511 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:54.287182    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:54.287511 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:54.287237    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:54.287511 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:54.287348    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:55.077908 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:55.077876    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs\") pod \"network-metrics-daemon-m7pwq\" (UID: \"49442a39-eb53-419a-a05d-209c81bba22e\") " pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:55.078049 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:55.077946    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:55.078049 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:55.078018    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:55.078049 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:55.078045    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:55.078180 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:55.078080    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs podName:49442a39-eb53-419a-a05d-209c81bba22e nodeName:}" failed. No retries permitted until 2026-07-07 22:15:27.078063361 +0000 UTC m=+66.394200780 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs") pod "network-metrics-daemon-m7pwq" (UID: "49442a39-eb53-419a-a05d-209c81bba22e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 22:14:55.078180 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:55.078094    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret podName:a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c nodeName:}" failed. No retries permitted until 2026-07-07 22:15:27.078087667 +0000 UTC m=+66.394225070 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret") pod "global-pull-secret-syncer-7rp6t" (UID: "a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c") : object "kube-system"/"original-pull-secret" not registered
Jul 07 22:14:55.178826 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:55.178797    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk98\" (UniqueName: \"kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98\") pod \"network-check-target-92k2m\" (UID: \"a48a3e6e-45b3-48b6-92ee-d350937c8c46\") " pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:55.178944 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:55.178931    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 22:14:55.178992 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:55.178946    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 22:14:55.178992 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:55.178955    2561 projected.go:196] Error preparing data for projected volume kube-api-access-5zk98 for pod openshift-network-diagnostics/network-check-target-92k2m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:55.179054 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:55.179036    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98 podName:a48a3e6e-45b3-48b6-92ee-d350937c8c46 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:27.17902071 +0000 UTC m=+66.495158114 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5zk98" (UniqueName: "kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98") pod "network-check-target-92k2m" (UID: "a48a3e6e-45b3-48b6-92ee-d350937c8c46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 22:14:55.287374 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:55.287342    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:55.287716 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:55.287463    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-m7pwq" podUID="49442a39-eb53-419a-a05d-209c81bba22e"
Jul 07 22:14:55.482824 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:55.482787    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v67vf" event={"ID":"7626485b-4b41-4706-8663-12bd5ef5bffd","Type":"ContainerStarted","Data":"7c329d9a11bbf91dd49f3da04f4980e268b32d4738b1ebb061f39cc44773d834"}
Jul 07 22:14:55.485528 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:55.485499    2561 generic.go:356] "Generic (PLEG): container finished" podID="d0b88798-8527-4a73-a88f-df113df09d6a" containerID="9972757a087a70b59293530a1b11e92311add1ea970e71db2fb941cd4eafedde" exitCode=0
Jul 07 22:14:55.485691 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:55.485556    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4qhq" event={"ID":"d0b88798-8527-4a73-a88f-df113df09d6a","Type":"ContainerDied","Data":"9972757a087a70b59293530a1b11e92311add1ea970e71db2fb941cd4eafedde"}
Jul 07 22:14:55.499952 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:55.499911    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v67vf" podStartSLOduration=1.098607632 podStartE2EDuration="32.49989662s" totalImagesPullingTime="31.401288988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-07 22:14:55.499408609 +0000 UTC m=+34.815546037" watchObservedRunningTime="2026-07-07 22:14:55.49989662 +0000 UTC m=+34.816034045"
Jul 07 22:14:56.287214 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.287169    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:56.287456 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.287176    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:56.287456 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:56.287309    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7rp6t" podUID="a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c"
Jul 07 22:14:56.287456 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:56.287347    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-92k2m" podUID="a48a3e6e-45b3-48b6-92ee-d350937c8c46"
Jul 07 22:14:56.490244 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.490215    2561 generic.go:356] "Generic (PLEG): container finished" podID="d0b88798-8527-4a73-a88f-df113df09d6a" containerID="f2c9ea264d727c8087e8840ac6ce6d52fdf10ddebfd749bb5baa49e2c1934af3" exitCode=0
Jul 07 22:14:56.490396 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.490272    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4qhq" event={"ID":"d0b88798-8527-4a73-a88f-df113df09d6a","Type":"ContainerDied","Data":"f2c9ea264d727c8087e8840ac6ce6d52fdf10ddebfd749bb5baa49e2c1934af3"}
Jul 07 22:14:56.881374 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.881301    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-229.ec2.internal" event="NodeReady"
Jul 07 22:14:56.881554 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.881430    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 22:14:56.916462 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.916420    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-snwkk"]
Jul 07 22:14:56.934773 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.934742    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-kmn4d"]
Jul 07 22:14:56.934913 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.934858    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-snwkk"
Jul 07 22:14:56.938106 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.938083    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 07 22:14:56.938468 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.938328    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:14:56.938468 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.938347    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-g44bg\""
Jul 07 22:14:56.955758 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.955728    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"]
Jul 07 22:14:56.955926 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.955847    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-kmn4d"
Jul 07 22:14:56.958652 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.958624    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hmzbf\""
Jul 07 22:14:56.958816 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.958662    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 22:14:56.958816 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.958679    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 22:14:56.971947 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.971924    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"]
Jul 07 22:14:56.972088 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.972057    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"
Jul 07 22:14:56.974603 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.974582    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 22:14:56.974716 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.974597    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:14:56.974716 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.974644    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 22:14:56.974823 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.974775    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 22:14:56.974990 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.974972    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wpkvh\""
Jul 07 22:14:56.990043 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.990019    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f6fd7cb44-l78cx"]
Jul 07 22:14:56.990164 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.990065    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:14:56.993307 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.993284    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dh2jr\""
Jul 07 22:14:56.993418 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.993398    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 07 22:14:56.993474 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.993414    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 22:14:56.994453 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.994434    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 22:14:56.994556 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:56.994463    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 07 22:14:57.010152 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.010127    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"]
Jul 07 22:14:57.010293 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.010261    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.013047 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.013021    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rqfd9\""
Jul 07 22:14:57.013047 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.013043    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 22:14:57.013238 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.013060    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 22:14:57.013238 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.013024    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 22:14:57.017351 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.017330    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 22:14:57.028295 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.028263    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-74b8948f45-trjld"]
Jul 07 22:14:57.028415 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.028378    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"
Jul 07 22:14:57.030835 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.030817    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 22:14:57.031285 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.031270    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:14:57.031386 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.031367    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 22:14:57.031469 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.031423    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 22:14:57.031529 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.031503    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wbxqh\""
Jul 07 22:14:57.050501 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.050475    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f5859bf4c-vbt9h"]
Jul 07 22:14:57.050656 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.050499    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.052992 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.052969    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 22:14:57.053170 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.053156    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 22:14:57.053263 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.053247    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rb8g2\""
Jul 07 22:14:57.053325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.053269    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 22:14:57.053382 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.053354    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 22:14:57.053382 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.053354    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 22:14:57.053469 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.053377    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 22:14:57.074889 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.074858    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"]
Jul 07 22:14:57.075025 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.074980    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.092500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.092467    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75caa7ea-49e8-41cf-809d-0c2353fa69dd-config\") pod \"service-ca-operator-5d46d9ffd4-zzp92\" (UID: \"75caa7ea-49e8-41cf-809d-0c2353fa69dd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"
Jul 07 22:14:57.092640 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.092515    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfpfh\" (UniqueName: \"kubernetes.io/projected/75caa7ea-49e8-41cf-809d-0c2353fa69dd-kube-api-access-tfpfh\") pod \"service-ca-operator-5d46d9ffd4-zzp92\" (UID: \"75caa7ea-49e8-41cf-809d-0c2353fa69dd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"
Jul 07 22:14:57.092640 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.092542    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:14:57.092640 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.092590    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztvkp\" (UniqueName: \"kubernetes.io/projected/44656a98-ae77-4ed7-a2ee-aa6bb9af1437-kube-api-access-ztvkp\") pod \"volume-data-source-validator-5d456fdbcd-snwkk\" (UID: \"44656a98-ae77-4ed7-a2ee-aa6bb9af1437\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-snwkk"
Jul 07 22:14:57.092767 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.092637    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75caa7ea-49e8-41cf-809d-0c2353fa69dd-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-zzp92\" (UID: \"75caa7ea-49e8-41cf-809d-0c2353fa69dd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"
Jul 07 22:14:57.092767 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.092692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp8ws\" (UniqueName: \"kubernetes.io/projected/042e7349-698d-48f3-8af4-4fb44cb9352c-kube-api-access-lp8ws\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:14:57.092767 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.092739    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/042e7349-698d-48f3-8af4-4fb44cb9352c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:14:57.092882 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.092774    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dfqg\" (UniqueName: \"kubernetes.io/projected/c9511a2a-cc3f-4040-93e5-2198149b0cb5-kube-api-access-4dfqg\") pod \"network-check-source-989f8b8dc-kmn4d\" (UID: \"c9511a2a-cc3f-4040-93e5-2198149b0cb5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-kmn4d"
Jul 07 22:14:57.092882 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.092815    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xrff4"]
Jul 07 22:14:57.092969 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.092905    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"
Jul 07 22:14:57.095582 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.095563    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:14:57.095783 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.095768    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 22:14:57.095862 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.095805    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 22:14:57.095933 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.095916    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qttbj\""
Jul 07 22:14:57.117307 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.117279    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-j6ggt"]
Jul 07 22:14:57.117414 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.117398    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.120214 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.120176    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 22:14:57.120214 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.120191    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 07 22:14:57.120473 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.120457    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 22:14:57.120571 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.120459    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 07 22:14:57.120571 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.120488    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5hcwd\""
Jul 07 22:14:57.125044 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.125022    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 07 22:14:57.133382 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.133313    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-snwkk"]
Jul 07 22:14:57.133382 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.133352    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"]
Jul 07 22:14:57.133382 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.133373    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"]
Jul 07 22:14:57.133587 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.133400    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4889x"]
Jul 07 22:14:57.133587 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.133556    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.136101 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.136079    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:14:57.136227 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.136185    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-twmrq\""
Jul 07 22:14:57.136301 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.136276    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 07 22:14:57.136360 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.136332    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 07 22:14:57.136588 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.136569    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 07 22:14:57.141290 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.141273    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 07 22:14:57.147572 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.147555    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"]
Jul 07 22:14:57.147650 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.147585    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f6fd7cb44-l78cx"]
Jul 07 22:14:57.147650 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.147604    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8bg8x"]
Jul 07 22:14:57.147720 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.147671    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4889x"
Jul 07 22:14:57.150383 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.150354    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 22:14:57.150494 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.150382    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 22:14:57.150494 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.150477    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 22:14:57.150598 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.150499    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s2dph\""
Jul 07 22:14:57.165338 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.165316    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"]
Jul 07 22:14:57.165455 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.165347    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-kmn4d"]
Jul 07 22:14:57.165455 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.165361    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-j6ggt"]
Jul 07 22:14:57.165455 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.165381    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4889x"]
Jul 07 22:14:57.165455 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.165394    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xrff4"]
Jul 07 22:14:57.165455 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.165407    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74b8948f45-trjld"]
Jul 07 22:14:57.165455 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.165420    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f5859bf4c-vbt9h"]
Jul 07 22:14:57.165455 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.165433    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8bg8x"]
Jul 07 22:14:57.165772 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.165455    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:57.168103 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.168083    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dxzxn\""
Jul 07 22:14:57.168297 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.168125    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 22:14:57.168297 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.168154    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 22:14:57.193594 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.193561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp8ws\" (UniqueName: \"kubernetes.io/projected/042e7349-698d-48f3-8af4-4fb44cb9352c-kube-api-access-lp8ws\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:14:57.193594 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.193597    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-certificates\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.193826 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.193620    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/042e7349-698d-48f3-8af4-4fb44cb9352c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:14:57.193826 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.193657    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80c9ea8c-875d-42d5-bfe6-6664d34c799c-installation-pull-secrets\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.193826 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.193755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36015c76-eb45-4c10-b770-e2cba948b439-image-registry-private-configuration\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.193826 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.193774    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.193826 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.193802    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80c9ea8c-875d-42d5-bfe6-6664d34c799c-image-registry-private-configuration\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.193826 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.193826    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36015c76-eb45-4c10-b770-e2cba948b439-installation-pull-secrets\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.194129 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.193887    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mnr9\" (UniqueName: \"kubernetes.io/projected/b578bb6c-1572-4342-be6c-d10f04301077-kube-api-access-5mnr9\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.194129 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.193917    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42aea693-6e1b-4430-85b7-7f93340ca882-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-hfw45\" (UID: \"42aea693-6e1b-4430-85b7-7f93340ca882\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"
Jul 07 22:14:57.194129 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.193951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfpfh\" (UniqueName: \"kubernetes.io/projected/75caa7ea-49e8-41cf-809d-0c2353fa69dd-kube-api-access-tfpfh\") pod \"service-ca-operator-5d46d9ffd4-zzp92\" (UID: \"75caa7ea-49e8-41cf-809d-0c2353fa69dd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"
Jul 07 22:14:57.194129 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.193985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbmlv\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-kube-api-access-bbmlv\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.194129 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194028    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.194129 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194056    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-56drh\" (UID: \"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"
Jul 07 22:14:57.194129 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75caa7ea-49e8-41cf-809d-0c2353fa69dd-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-zzp92\" (UID: \"75caa7ea-49e8-41cf-809d-0c2353fa69dd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"
Jul 07 22:14:57.194511 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36015c76-eb45-4c10-b770-e2cba948b439-ca-trust-extracted\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.194511 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194259    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36015c76-eb45-4c10-b770-e2cba948b439-registry-certificates\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.194511 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42hrn\" (UniqueName: \"kubernetes.io/projected/42aea693-6e1b-4430-85b7-7f93340ca882-kube-api-access-42hrn\") pod \"kube-storage-version-migrator-operator-846bf668f7-hfw45\" (UID: \"42aea693-6e1b-4430-85b7-7f93340ca882\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"
Jul 07 22:14:57.194511 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc65q\" (UniqueName: \"kubernetes.io/projected/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-kube-api-access-tc65q\") pod \"cluster-samples-operator-56fcf86bf-56drh\" (UID: \"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"
Jul 07 22:14:57.194511 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.194511 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194390    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-default-certificate\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.194511 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194431    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dfqg\" (UniqueName: \"kubernetes.io/projected/c9511a2a-cc3f-4040-93e5-2198149b0cb5-kube-api-access-4dfqg\") pod \"network-check-source-989f8b8dc-kmn4d\" (UID: \"c9511a2a-cc3f-4040-93e5-2198149b0cb5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-kmn4d"
Jul 07 22:14:57.194511 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80c9ea8c-875d-42d5-bfe6-6664d34c799c-trusted-ca\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.194511 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194464    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/042e7349-698d-48f3-8af4-4fb44cb9352c-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:14:57.194964 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75caa7ea-49e8-41cf-809d-0c2353fa69dd-config\") pod \"service-ca-operator-5d46d9ffd4-zzp92\" (UID: \"75caa7ea-49e8-41cf-809d-0c2353fa69dd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"
Jul 07 22:14:57.195020 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.194979    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-bound-sa-token\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.195020 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.195012    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpdf6\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-kube-api-access-rpdf6\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.195116 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.195045    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-stats-auth\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.195161 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.195112    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.195161 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.195148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80c9ea8c-875d-42d5-bfe6-6664d34c799c-ca-trust-extracted\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.195244 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.195175    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-bound-sa-token\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.195244 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.195229    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:14:57.195331 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.195240    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75caa7ea-49e8-41cf-809d-0c2353fa69dd-config\") pod \"service-ca-operator-5d46d9ffd4-zzp92\" (UID: \"75caa7ea-49e8-41cf-809d-0c2353fa69dd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"
Jul 07 22:14:57.195331 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.195254    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36015c76-eb45-4c10-b770-e2cba948b439-trusted-ca\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.195331 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.195295    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42aea693-6e1b-4430-85b7-7f93340ca882-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-hfw45\" (UID: \"42aea693-6e1b-4430-85b7-7f93340ca882\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"
Jul 07 22:14:57.195331 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.195323    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 22:14:57.195478 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.195379    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls podName:042e7349-698d-48f3-8af4-4fb44cb9352c nodeName:}" failed. No retries permitted until 2026-07-07 22:14:57.695365673 +0000 UTC m=+37.011503076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4mk9h" (UID: "042e7349-698d-48f3-8af4-4fb44cb9352c") : secret "cluster-monitoring-operator-tls" not found
Jul 07 22:14:57.195478 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.195324    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztvkp\" (UniqueName: \"kubernetes.io/projected/44656a98-ae77-4ed7-a2ee-aa6bb9af1437-kube-api-access-ztvkp\") pod \"volume-data-source-validator-5d456fdbcd-snwkk\" (UID: \"44656a98-ae77-4ed7-a2ee-aa6bb9af1437\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-snwkk"
Jul 07 22:14:57.198303 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.198286    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75caa7ea-49e8-41cf-809d-0c2353fa69dd-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-zzp92\" (UID: \"75caa7ea-49e8-41cf-809d-0c2353fa69dd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"
Jul 07 22:14:57.202946 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.202916    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfpfh\" (UniqueName: \"kubernetes.io/projected/75caa7ea-49e8-41cf-809d-0c2353fa69dd-kube-api-access-tfpfh\") pod \"service-ca-operator-5d46d9ffd4-zzp92\" (UID: \"75caa7ea-49e8-41cf-809d-0c2353fa69dd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"
Jul 07 22:14:57.203621 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.203599    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp8ws\" (UniqueName: \"kubernetes.io/projected/042e7349-698d-48f3-8af4-4fb44cb9352c-kube-api-access-lp8ws\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:14:57.204095 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.204067    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztvkp\" (UniqueName: \"kubernetes.io/projected/44656a98-ae77-4ed7-a2ee-aa6bb9af1437-kube-api-access-ztvkp\") pod \"volume-data-source-validator-5d456fdbcd-snwkk\" (UID: \"44656a98-ae77-4ed7-a2ee-aa6bb9af1437\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-snwkk"
Jul 07 22:14:57.208410 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.208381    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dfqg\" (UniqueName: \"kubernetes.io/projected/c9511a2a-cc3f-4040-93e5-2198149b0cb5-kube-api-access-4dfqg\") pod \"network-check-source-989f8b8dc-kmn4d\" (UID: \"c9511a2a-cc3f-4040-93e5-2198149b0cb5\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-kmn4d"
Jul 07 22:14:57.246841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.246805    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-snwkk"
Jul 07 22:14:57.269026 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.268999    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-kmn4d"
Jul 07 22:14:57.280552 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.280524    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"
Jul 07 22:14:57.287284 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.287262    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:14:57.290074 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.290050    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 22:14:57.290450 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.290137    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkskh\""
Jul 07 22:14:57.295877 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.295843    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80c9ea8c-875d-42d5-bfe6-6664d34c799c-installation-pull-secrets\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.295877 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.295875    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36015c76-eb45-4c10-b770-e2cba948b439-image-registry-private-configuration\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.296002 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.295892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.296002 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.295922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80c9ea8c-875d-42d5-bfe6-6664d34c799c-image-registry-private-configuration\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.296002 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.295953    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36015c76-eb45-4c10-b770-e2cba948b439-installation-pull-secrets\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.296002 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.295984    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7952286-be37-4657-a639-fd1d0e0fd54f-tmp\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.296158 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.296000    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 22:14:57.296158 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296014    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mnr9\" (UniqueName: \"kubernetes.io/projected/b578bb6c-1572-4342-be6c-d10f04301077-kube-api-access-5mnr9\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.296158 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42aea693-6e1b-4430-85b7-7f93340ca882-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-hfw45\" (UID: \"42aea693-6e1b-4430-85b7-7f93340ca882\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"
Jul 07 22:14:57.296158 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbmlv\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-kube-api-access-bbmlv\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.296158 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.296085    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs podName:b578bb6c-1572-4342-be6c-d10f04301077 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:57.796067993 +0000 UTC m=+37.112205414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs") pod "router-default-74b8948f45-trjld" (UID: "b578bb6c-1572-4342-be6c-d10f04301077") : secret "router-metrics-certs-default" not found
Jul 07 22:14:57.296158 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.296158 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-56drh\" (UID: \"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"
Jul 07 22:14:57.296467 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296183    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36015c76-eb45-4c10-b770-e2cba948b439-ca-trust-extracted\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.296467 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36015c76-eb45-4c10-b770-e2cba948b439-registry-certificates\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.296467 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296260    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42hrn\" (UniqueName: \"kubernetes.io/projected/42aea693-6e1b-4430-85b7-7f93340ca882-kube-api-access-42hrn\") pod \"kube-storage-version-migrator-operator-846bf668f7-hfw45\" (UID: \"42aea693-6e1b-4430-85b7-7f93340ca882\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"
Jul 07 22:14:57.296467 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc65q\" (UniqueName: \"kubernetes.io/projected/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-kube-api-access-tc65q\") pod \"cluster-samples-operator-56fcf86bf-56drh\" (UID: \"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"
Jul 07 22:14:57.296467 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296318    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlq8n\" (UniqueName: \"kubernetes.io/projected/e7952286-be37-4657-a639-fd1d0e0fd54f-kube-api-access-vlq8n\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.296467 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-tmp-dir\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:57.296467 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296365    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.296467 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296392    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-default-certificate\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.296467 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24n9z\" (UniqueName: \"kubernetes.io/projected/4b45fd96-0bc5-4293-8f54-c477274177fe-kube-api-access-24n9z\") pod \"console-operator-68b757fb67-j6ggt\" (UID: \"4b45fd96-0bc5-4293-8f54-c477274177fe\") " pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.296467 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296445    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/711e34a9-0496-4aa9-a5be-b178510ec995-cert\") pod \"ingress-canary-4889x\" (UID: \"711e34a9-0496-4aa9-a5be-b178510ec995\") " pod="openshift-ingress-canary/ingress-canary-4889x"
Jul 07 22:14:57.296980 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-config-volume\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:57.296980 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296499    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80c9ea8c-875d-42d5-bfe6-6664d34c799c-trusted-ca\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.296980 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7952286-be37-4657-a639-fd1d0e0fd54f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.296980 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b45fd96-0bc5-4293-8f54-c477274177fe-serving-cert\") pod \"console-operator-68b757fb67-j6ggt\" (UID: \"4b45fd96-0bc5-4293-8f54-c477274177fe\") " pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.296980 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296605    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-bound-sa-token\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.296980 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpdf6\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-kube-api-access-rpdf6\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.296980 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296650    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:57.296980 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296671    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b45fd96-0bc5-4293-8f54-c477274177fe-config\") pod \"console-operator-68b757fb67-j6ggt\" (UID: \"4b45fd96-0bc5-4293-8f54-c477274177fe\") " pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.296980 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-stats-auth\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.296980 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296722    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68dgp\" (UniqueName: \"kubernetes.io/projected/711e34a9-0496-4aa9-a5be-b178510ec995-kube-api-access-68dgp\") pod \"ingress-canary-4889x\" (UID: \"711e34a9-0496-4aa9-a5be-b178510ec995\") " pod="openshift-ingress-canary/ingress-canary-4889x"
Jul 07 22:14:57.296980 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296750    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.296980 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296772    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80c9ea8c-875d-42d5-bfe6-6664d34c799c-ca-trust-extracted\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.296980 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-bound-sa-token\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.297615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296833    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36015c76-eb45-4c10-b770-e2cba948b439-trusted-ca\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.297615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42aea693-6e1b-4430-85b7-7f93340ca882-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-hfw45\" (UID: \"42aea693-6e1b-4430-85b7-7f93340ca882\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"
Jul 07 22:14:57.297615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296885    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7952286-be37-4657-a639-fd1d0e0fd54f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.297615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhm5x\" (UniqueName: \"kubernetes.io/projected/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-kube-api-access-xhm5x\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:57.297615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7952286-be37-4657-a639-fd1d0e0fd54f-serving-cert\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.297615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b45fd96-0bc5-4293-8f54-c477274177fe-trusted-ca\") pod \"console-operator-68b757fb67-j6ggt\" (UID: \"4b45fd96-0bc5-4293-8f54-c477274177fe\") " pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.297615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.297010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-certificates\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.297615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.296994    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36015c76-eb45-4c10-b770-e2cba948b439-registry-certificates\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.297615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.297035    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e7952286-be37-4657-a639-fd1d0e0fd54f-snapshots\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.297615 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.297086    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle podName:b578bb6c-1572-4342-be6c-d10f04301077 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:57.797068211 +0000 UTC m=+37.113205634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle") pod "router-default-74b8948f45-trjld" (UID: "b578bb6c-1572-4342-be6c-d10f04301077") : configmap references non-existent config key: service-ca.crt
Jul 07 22:14:57.297615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.297454    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36015c76-eb45-4c10-b770-e2cba948b439-ca-trust-extracted\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.298449 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.297831    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-certificates\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.298449 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.297965    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:14:57.298449 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.297981    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6fd7cb44-l78cx: secret "image-registry-tls" not found
Jul 07 22:14:57.298449 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.298026    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls podName:80c9ea8c-875d-42d5-bfe6-6664d34c799c nodeName:}" failed. No retries permitted until 2026-07-07 22:14:57.798011056 +0000 UTC m=+37.114148479 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls") pod "image-registry-f6fd7cb44-l78cx" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c") : secret "image-registry-tls" not found
Jul 07 22:14:57.298449 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.298351    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36015c76-eb45-4c10-b770-e2cba948b439-trusted-ca\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.299905 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.299331    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80c9ea8c-875d-42d5-bfe6-6664d34c799c-image-registry-private-configuration\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.299905 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.299419    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 22:14:57.299905 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.299467    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls podName:3dfbc8a0-47ab-4477-8a40-f02a6a0038cd nodeName:}" failed. No retries permitted until 2026-07-07 22:14:57.799450954 +0000 UTC m=+37.115588360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-56drh" (UID: "3dfbc8a0-47ab-4477-8a40-f02a6a0038cd") : secret "samples-operator-tls" not found
Jul 07 22:14:57.299905 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.299524    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:14:57.299905 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.299542    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5859bf4c-vbt9h: secret "image-registry-tls" not found
Jul 07 22:14:57.299905 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.299598    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls podName:36015c76-eb45-4c10-b770-e2cba948b439 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:57.799583901 +0000 UTC m=+37.115721321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls") pod "image-registry-7f5859bf4c-vbt9h" (UID: "36015c76-eb45-4c10-b770-e2cba948b439") : secret "image-registry-tls" not found
Jul 07 22:14:57.299905 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.299755    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80c9ea8c-875d-42d5-bfe6-6664d34c799c-ca-trust-extracted\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.300425 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.300330    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80c9ea8c-875d-42d5-bfe6-6664d34c799c-trusted-ca\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.300830 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.300805    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/42aea693-6e1b-4430-85b7-7f93340ca882-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-hfw45\" (UID: \"42aea693-6e1b-4430-85b7-7f93340ca882\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"
Jul 07 22:14:57.301168 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.301115    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-stats-auth\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.301657 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.301575    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36015c76-eb45-4c10-b770-e2cba948b439-image-registry-private-configuration\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.301984 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.301967    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-default-certificate\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.302404 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.302375    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36015c76-eb45-4c10-b770-e2cba948b439-installation-pull-secrets\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.303164 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.303060    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80c9ea8c-875d-42d5-bfe6-6664d34c799c-installation-pull-secrets\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.305336 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.305311    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mnr9\" (UniqueName: \"kubernetes.io/projected/b578bb6c-1572-4342-be6c-d10f04301077-kube-api-access-5mnr9\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.305555 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.305538    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbmlv\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-kube-api-access-bbmlv\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.305790 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.305765    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc65q\" (UniqueName: \"kubernetes.io/projected/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-kube-api-access-tc65q\") pod \"cluster-samples-operator-56fcf86bf-56drh\" (UID: \"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"
Jul 07 22:14:57.305932 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.305912    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42hrn\" (UniqueName: \"kubernetes.io/projected/42aea693-6e1b-4430-85b7-7f93340ca882-kube-api-access-42hrn\") pod \"kube-storage-version-migrator-operator-846bf668f7-hfw45\" (UID: \"42aea693-6e1b-4430-85b7-7f93340ca882\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"
Jul 07 22:14:57.306639 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.306603    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-bound-sa-token\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.307143 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.307122    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/42aea693-6e1b-4430-85b7-7f93340ca882-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-hfw45\" (UID: \"42aea693-6e1b-4430-85b7-7f93340ca882\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"
Jul 07 22:14:57.307662 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.307640    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-bound-sa-token\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.307910 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.307892    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpdf6\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-kube-api-access-rpdf6\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.337375 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.337344    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"
Jul 07 22:14:57.400801 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7952286-be37-4657-a639-fd1d0e0fd54f-serving-cert\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.400801 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400460    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b45fd96-0bc5-4293-8f54-c477274177fe-trusted-ca\") pod \"console-operator-68b757fb67-j6ggt\" (UID: \"4b45fd96-0bc5-4293-8f54-c477274177fe\") " pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.400801 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e7952286-be37-4657-a639-fd1d0e0fd54f-snapshots\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.400801 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7952286-be37-4657-a639-fd1d0e0fd54f-tmp\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.400801 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlq8n\" (UniqueName: \"kubernetes.io/projected/e7952286-be37-4657-a639-fd1d0e0fd54f-kube-api-access-vlq8n\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.400801 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400717    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-tmp-dir\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:57.400801 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24n9z\" (UniqueName: \"kubernetes.io/projected/4b45fd96-0bc5-4293-8f54-c477274177fe-kube-api-access-24n9z\") pod \"console-operator-68b757fb67-j6ggt\" (UID: \"4b45fd96-0bc5-4293-8f54-c477274177fe\") " pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.400801 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400786    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/711e34a9-0496-4aa9-a5be-b178510ec995-cert\") pod \"ingress-canary-4889x\" (UID: \"711e34a9-0496-4aa9-a5be-b178510ec995\") " pod="openshift-ingress-canary/ingress-canary-4889x"
Jul 07 22:14:57.401298 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400819    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-config-volume\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:57.401298 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7952286-be37-4657-a639-fd1d0e0fd54f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.401298 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b45fd96-0bc5-4293-8f54-c477274177fe-serving-cert\") pod \"console-operator-68b757fb67-j6ggt\" (UID: \"4b45fd96-0bc5-4293-8f54-c477274177fe\") " pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.401298 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:57.401298 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b45fd96-0bc5-4293-8f54-c477274177fe-config\") pod \"console-operator-68b757fb67-j6ggt\" (UID: \"4b45fd96-0bc5-4293-8f54-c477274177fe\") " pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.401298 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.400981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68dgp\" (UniqueName: \"kubernetes.io/projected/711e34a9-0496-4aa9-a5be-b178510ec995-kube-api-access-68dgp\") pod \"ingress-canary-4889x\" (UID: \"711e34a9-0496-4aa9-a5be-b178510ec995\") " pod="openshift-ingress-canary/ingress-canary-4889x"
Jul 07 22:14:57.401298 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.401041    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7952286-be37-4657-a639-fd1d0e0fd54f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.401298 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.401075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhm5x\" (UniqueName: \"kubernetes.io/projected/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-kube-api-access-xhm5x\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:57.401670 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.401329    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e7952286-be37-4657-a639-fd1d0e0fd54f-snapshots\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.402093 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.402068    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-config-volume\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:57.403396 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.402454    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-tmp-dir\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:57.403396 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.402533    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7952286-be37-4657-a639-fd1d0e0fd54f-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.403396 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.402591    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7952286-be37-4657-a639-fd1d0e0fd54f-tmp\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.403396 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.402823    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 22:14:57.403396 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.402883    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls podName:5ae33a4a-0bdb-4f0e-9a86-221c82e0e066 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:57.90286201 +0000 UTC m=+37.218999432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls") pod "dns-default-8bg8x" (UID: "5ae33a4a-0bdb-4f0e-9a86-221c82e0e066") : secret "dns-default-metrics-tls" not found
Jul 07 22:14:57.403396 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.403162    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4b45fd96-0bc5-4293-8f54-c477274177fe-config\") pod \"console-operator-68b757fb67-j6ggt\" (UID: \"4b45fd96-0bc5-4293-8f54-c477274177fe\") " pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.403396 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.403307    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7952286-be37-4657-a639-fd1d0e0fd54f-serving-cert\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.403698 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.403410    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4b45fd96-0bc5-4293-8f54-c477274177fe-trusted-ca\") pod \"console-operator-68b757fb67-j6ggt\" (UID: \"4b45fd96-0bc5-4293-8f54-c477274177fe\") " pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.403698 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.403412    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7952286-be37-4657-a639-fd1d0e0fd54f-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.406210 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.406151    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/711e34a9-0496-4aa9-a5be-b178510ec995-cert\") pod \"ingress-canary-4889x\" (UID: \"711e34a9-0496-4aa9-a5be-b178510ec995\") " pod="openshift-ingress-canary/ingress-canary-4889x"
Jul 07 22:14:57.406401 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.406380    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b45fd96-0bc5-4293-8f54-c477274177fe-serving-cert\") pod \"console-operator-68b757fb67-j6ggt\" (UID: \"4b45fd96-0bc5-4293-8f54-c477274177fe\") " pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.410163 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.410111    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhm5x\" (UniqueName: \"kubernetes.io/projected/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-kube-api-access-xhm5x\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:57.411767 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.411745    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68dgp\" (UniqueName: \"kubernetes.io/projected/711e34a9-0496-4aa9-a5be-b178510ec995-kube-api-access-68dgp\") pod \"ingress-canary-4889x\" (UID: \"711e34a9-0496-4aa9-a5be-b178510ec995\") " pod="openshift-ingress-canary/ingress-canary-4889x"
Jul 07 22:14:57.411865 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.411789    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlq8n\" (UniqueName: \"kubernetes.io/projected/e7952286-be37-4657-a639-fd1d0e0fd54f-kube-api-access-vlq8n\") pod \"insights-operator-5c847dcfc4-xrff4\" (UID: \"e7952286-be37-4657-a639-fd1d0e0fd54f\") " pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.412147 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.412127    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24n9z\" (UniqueName: \"kubernetes.io/projected/4b45fd96-0bc5-4293-8f54-c477274177fe-kube-api-access-24n9z\") pod \"console-operator-68b757fb67-j6ggt\" (UID: \"4b45fd96-0bc5-4293-8f54-c477274177fe\") " pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.426245 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.426062    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-xrff4"
Jul 07 22:14:57.442032 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.441388    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:14:57.456163 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.455949    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4889x"
Jul 07 22:14:57.456637 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.456567    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-snwkk"]
Jul 07 22:14:57.467836 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:57.466979    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44656a98_ae77_4ed7_a2ee_aa6bb9af1437.slice/crio-88283974c9eb9b7c9abf573fa6eb9bfee21959409c2bf6639a77090f39eea113 WatchSource:0}: Error finding container 88283974c9eb9b7c9abf573fa6eb9bfee21959409c2bf6639a77090f39eea113: Status 404 returned error can't find the container with id 88283974c9eb9b7c9abf573fa6eb9bfee21959409c2bf6639a77090f39eea113
Jul 07 22:14:57.473659 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.473567    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-kmn4d"]
Jul 07 22:14:57.498807 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.498492    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-snwkk" event={"ID":"44656a98-ae77-4ed7-a2ee-aa6bb9af1437","Type":"ContainerStarted","Data":"88283974c9eb9b7c9abf573fa6eb9bfee21959409c2bf6639a77090f39eea113"}
Jul 07 22:14:57.502620 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.502539    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92"]
Jul 07 22:14:57.508136 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.508106    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r4qhq" event={"ID":"d0b88798-8527-4a73-a88f-df113df09d6a","Type":"ContainerStarted","Data":"da83371bf0769cf0b3e1caeb5f122425829866f5a3425433bae26113b568279a"}
Jul 07 22:14:57.514181 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.514149    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-kmn4d" event={"ID":"c9511a2a-cc3f-4040-93e5-2198149b0cb5","Type":"ContainerStarted","Data":"85698df54ec05d450e12923487840820217e19536a1aea0e2f8702e871172183"}
Jul 07 22:14:57.536062 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.536005    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r4qhq" podStartSLOduration=6.418352182 podStartE2EDuration="35.535979663s" totalImagesPullingTime="29.117627481s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:14:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:14:57.529884476 +0000 UTC m=+36.846021899" watchObservedRunningTime="2026-07-07 22:14:57.535979663 +0000 UTC m=+36.852117089"
Jul 07 22:14:57.583416 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.583359    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45"]
Jul 07 22:14:57.652567 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.652543    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-xrff4"]
Jul 07 22:14:57.654903 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.654876    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4889x"]
Jul 07 22:14:57.655456 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:57.655418    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7952286_be37_4657_a639_fd1d0e0fd54f.slice/crio-0b0bb2d6a67bba5da4e686d4c61e397a61bafcf10eab02539284ede3638edbe9 WatchSource:0}: Error finding container 0b0bb2d6a67bba5da4e686d4c61e397a61bafcf10eab02539284ede3638edbe9: Status 404 returned error can't find the container with id 0b0bb2d6a67bba5da4e686d4c61e397a61bafcf10eab02539284ede3638edbe9
Jul 07 22:14:57.657250 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:57.657221    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711e34a9_0496_4aa9_a5be_b178510ec995.slice/crio-23be2598c5aceb802df079e7f5f1f57166fac36f31c2ee80573b8daabb4d3a53 WatchSource:0}: Error finding container 23be2598c5aceb802df079e7f5f1f57166fac36f31c2ee80573b8daabb4d3a53: Status 404 returned error can't find the container with id 23be2598c5aceb802df079e7f5f1f57166fac36f31c2ee80573b8daabb4d3a53
Jul 07 22:14:57.673331 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.673305    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-j6ggt"]
Jul 07 22:14:57.675931 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:14:57.675906    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b45fd96_0bc5_4293_8f54_c477274177fe.slice/crio-98a513b7d851562e70ac07300f2fb19b7aad05fff431a437255fff44b786d953 WatchSource:0}: Error finding container 98a513b7d851562e70ac07300f2fb19b7aad05fff431a437255fff44b786d953: Status 404 returned error can't find the container with id 98a513b7d851562e70ac07300f2fb19b7aad05fff431a437255fff44b786d953
Jul 07 22:14:57.681523 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.681492    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:14:57.704001 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.703968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:14:57.704152 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.704111    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 22:14:57.704229 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.704169    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls podName:042e7349-698d-48f3-8af4-4fb44cb9352c nodeName:}" failed. No retries permitted until 2026-07-07 22:14:58.704154753 +0000 UTC m=+38.020292156 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4mk9h" (UID: "042e7349-698d-48f3-8af4-4fb44cb9352c") : secret "cluster-monitoring-operator-tls" not found
Jul 07 22:14:57.768948 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.768915    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:14:57.805089 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.805053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.805253 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.805102    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:57.805253 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.805120    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-56drh\" (UID: \"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"
Jul 07 22:14:57.805253 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.805225    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 22:14:57.805253 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.805231    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 22:14:57.805444 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.805226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:57.805444 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.805272    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls podName:3dfbc8a0-47ab-4477-8a40-f02a6a0038cd nodeName:}" failed. No retries permitted until 2026-07-07 22:14:58.805259292 +0000 UTC m=+38.121396694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-56drh" (UID: "3dfbc8a0-47ab-4477-8a40-f02a6a0038cd") : secret "samples-operator-tls" not found
Jul 07 22:14:57.805444 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.805290    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:14:57.805444 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.805301    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs podName:b578bb6c-1572-4342-be6c-d10f04301077 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:58.805286445 +0000 UTC m=+38.121423854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs") pod "router-default-74b8948f45-trjld" (UID: "b578bb6c-1572-4342-be6c-d10f04301077") : secret "router-metrics-certs-default" not found
Jul 07 22:14:57.805444 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.805305    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6fd7cb44-l78cx: secret "image-registry-tls" not found
Jul 07 22:14:57.805444 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.805344    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls podName:80c9ea8c-875d-42d5-bfe6-6664d34c799c nodeName:}" failed. No retries permitted until 2026-07-07 22:14:58.805334633 +0000 UTC m=+38.121472043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls") pod "image-registry-f6fd7cb44-l78cx" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c") : secret "image-registry-tls" not found
Jul 07 22:14:57.805444 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.805376    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle podName:b578bb6c-1572-4342-be6c-d10f04301077 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:58.805354814 +0000 UTC m=+38.121492239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle") pod "router-default-74b8948f45-trjld" (UID: "b578bb6c-1572-4342-be6c-d10f04301077") : configmap references non-existent config key: service-ca.crt
Jul 07 22:14:57.805706 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.805453    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:57.805706 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.805552    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:14:57.805706 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.805560    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5859bf4c-vbt9h: secret "image-registry-tls" not found
Jul 07 22:14:57.805706 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.805584    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls podName:36015c76-eb45-4c10-b770-e2cba948b439 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:58.8055775 +0000 UTC m=+38.121714908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls") pod "image-registry-7f5859bf4c-vbt9h" (UID: "36015c76-eb45-4c10-b770-e2cba948b439") : secret "image-registry-tls" not found
Jul 07 22:14:57.906483 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:57.906381    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:57.906657 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.906531    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 22:14:57.906657 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:57.906589    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls podName:5ae33a4a-0bdb-4f0e-9a86-221c82e0e066 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:58.906573297 +0000 UTC m=+38.222710714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls") pod "dns-default-8bg8x" (UID: "5ae33a4a-0bdb-4f0e-9a86-221c82e0e066") : secret "dns-default-metrics-tls" not found
Jul 07 22:14:58.287542 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.287502    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:14:58.287708 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.287557    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:14:58.290687 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.290351    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7fbf\""
Jul 07 22:14:58.290687 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.290350    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 22:14:58.520990 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.520891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt" event={"ID":"4b45fd96-0bc5-4293-8f54-c477274177fe","Type":"ContainerStarted","Data":"98a513b7d851562e70ac07300f2fb19b7aad05fff431a437255fff44b786d953"}
Jul 07 22:14:58.523212 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.523166    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xrff4" event={"ID":"e7952286-be37-4657-a639-fd1d0e0fd54f","Type":"ContainerStarted","Data":"0b0bb2d6a67bba5da4e686d4c61e397a61bafcf10eab02539284ede3638edbe9"}
Jul 07 22:14:58.524782 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.524727    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4889x" event={"ID":"711e34a9-0496-4aa9-a5be-b178510ec995","Type":"ContainerStarted","Data":"23be2598c5aceb802df079e7f5f1f57166fac36f31c2ee80573b8daabb4d3a53"}
Jul 07 22:14:58.526784 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.526749    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45" event={"ID":"42aea693-6e1b-4430-85b7-7f93340ca882","Type":"ContainerStarted","Data":"9395921fd3435d556d389506566a7c0686136f52d80b08a6f29a8e74b1cd9f2a"}
Jul 07 22:14:58.529287 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.529241    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92" event={"ID":"75caa7ea-49e8-41cf-809d-0c2353fa69dd","Type":"ContainerStarted","Data":"e031c0cd0d189f3a3d973e21127b0f1563c63c508944c9da0e39ff100e387d01"}
Jul 07 22:14:58.631526 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.629581    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"]
Jul 07 22:14:58.649083 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.648134    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"]
Jul 07 22:14:58.649083 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.648297    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:14:58.652074 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.651404    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 22:14:58.652074 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.651708    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jmfqn\""
Jul 07 22:14:58.652074 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.651893    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 22:14:58.716418 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.715573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:14:58.716418 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.716062    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 22:14:58.716418 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.716126    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls podName:042e7349-698d-48f3-8af4-4fb44cb9352c nodeName:}" failed. No retries permitted until 2026-07-07 22:15:00.7161033 +0000 UTC m=+40.032240709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4mk9h" (UID: "042e7349-698d-48f3-8af4-4fb44cb9352c") : secret "cluster-monitoring-operator-tls" not found
Jul 07 22:14:58.723123 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.723091    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:14:58.817098 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.817061    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:58.817299 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.817132    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:14:58.817299 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.817161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-56drh\" (UID: \"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"
Jul 07 22:14:58.817299 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.817230    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:14:58.817299 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.817273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19eac3ab-96ae-45bd-a521-26becaa7f563-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5b9f6\" (UID: \"19eac3ab-96ae-45bd-a521-26becaa7f563\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:14:58.817512 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.817340    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:14:58.817512 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.817371    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5b9f6\" (UID: \"19eac3ab-96ae-45bd-a521-26becaa7f563\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:14:58.817616 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.817577    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 22:14:58.817676 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.817635    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs podName:b578bb6c-1572-4342-be6c-d10f04301077 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:00.817615323 +0000 UTC m=+40.133752729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs") pod "router-default-74b8948f45-trjld" (UID: "b578bb6c-1572-4342-be6c-d10f04301077") : secret "router-metrics-certs-default" not found
Jul 07 22:14:58.817676 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.817705    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle podName:b578bb6c-1572-4342-be6c-d10f04301077 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:00.817695249 +0000 UTC m=+40.133832657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle") pod "router-default-74b8948f45-trjld" (UID: "b578bb6c-1572-4342-be6c-d10f04301077") : configmap references non-existent config key: service-ca.crt
Jul 07 22:14:58.817898 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.817765    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 22:14:58.817898 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.817795    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls podName:3dfbc8a0-47ab-4477-8a40-f02a6a0038cd nodeName:}" failed. No retries permitted until 2026-07-07 22:15:00.817784608 +0000 UTC m=+40.133922014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-56drh" (UID: "3dfbc8a0-47ab-4477-8a40-f02a6a0038cd") : secret "samples-operator-tls" not found
Jul 07 22:14:58.817898 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.817862    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:14:58.817898 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.817873    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6fd7cb44-l78cx: secret "image-registry-tls" not found
Jul 07 22:14:58.818101 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.817901    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls podName:80c9ea8c-875d-42d5-bfe6-6664d34c799c nodeName:}" failed. No retries permitted until 2026-07-07 22:15:00.817891467 +0000 UTC m=+40.134028872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls") pod "image-registry-f6fd7cb44-l78cx" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c") : secret "image-registry-tls" not found
Jul 07 22:14:58.818101 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.817971    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:14:58.818101 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.817981    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5859bf4c-vbt9h: secret "image-registry-tls" not found
Jul 07 22:14:58.818101 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.818007    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls podName:36015c76-eb45-4c10-b770-e2cba948b439 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:00.81799753 +0000 UTC m=+40.134134934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls") pod "image-registry-7f5859bf4c-vbt9h" (UID: "36015c76-eb45-4c10-b770-e2cba948b439") : secret "image-registry-tls" not found
Jul 07 22:14:58.825521 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.825471    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:14:58.918814 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.918730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19eac3ab-96ae-45bd-a521-26becaa7f563-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5b9f6\" (UID: \"19eac3ab-96ae-45bd-a521-26becaa7f563\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:14:58.918814 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.918805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:14:58.919047 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.918852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5b9f6\" (UID: \"19eac3ab-96ae-45bd-a521-26becaa7f563\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:14:58.919113 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.919060    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 22:14:58.919281 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.919262    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert podName:19eac3ab-96ae-45bd-a521-26becaa7f563 nodeName:}" failed. No retries permitted until 2026-07-07 22:14:59.419114995 +0000 UTC m=+38.735252403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5b9f6" (UID: "19eac3ab-96ae-45bd-a521-26becaa7f563") : secret "networking-console-plugin-cert" not found
Jul 07 22:14:58.920292 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.920265    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19eac3ab-96ae-45bd-a521-26becaa7f563-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5b9f6\" (UID: \"19eac3ab-96ae-45bd-a521-26becaa7f563\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:14:58.920406 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.920373    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 22:14:58.920467 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:58.920421    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls podName:5ae33a4a-0bdb-4f0e-9a86-221c82e0e066 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:00.92040481 +0000 UTC m=+40.236542216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls") pod "dns-default-8bg8x" (UID: "5ae33a4a-0bdb-4f0e-9a86-221c82e0e066") : secret "dns-default-metrics-tls" not found
Jul 07 22:14:58.926446 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:58.926388    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:14:59.023988 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:59.023911    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:14:59.125114 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:59.125029    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:14:59.423892 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:14:59.423124    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5b9f6\" (UID: \"19eac3ab-96ae-45bd-a521-26becaa7f563\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:14:59.423892 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:59.423479    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 22:14:59.423892 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:14:59.423544    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert podName:19eac3ab-96ae-45bd-a521-26becaa7f563 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:00.423526034 +0000 UTC m=+39.739663443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5b9f6" (UID: "19eac3ab-96ae-45bd-a521-26becaa7f563") : secret "networking-console-plugin-cert" not found
Jul 07 22:15:00.434401 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:00.434358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5b9f6\" (UID: \"19eac3ab-96ae-45bd-a521-26becaa7f563\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:15:00.435037 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.434522    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 22:15:00.435037 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.434592    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert podName:19eac3ab-96ae-45bd-a521-26becaa7f563 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:02.434572494 +0000 UTC m=+41.750709901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5b9f6" (UID: "19eac3ab-96ae-45bd-a521-26becaa7f563") : secret "networking-console-plugin-cert" not found
Jul 07 22:15:00.737024 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:00.736949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:15:00.737159 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.737096    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 22:15:00.737214 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.737158    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls podName:042e7349-698d-48f3-8af4-4fb44cb9352c nodeName:}" failed. No retries permitted until 2026-07-07 22:15:04.737143171 +0000 UTC m=+44.053280573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4mk9h" (UID: "042e7349-698d-48f3-8af4-4fb44cb9352c") : secret "cluster-monitoring-operator-tls" not found
Jul 07 22:15:00.837632 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:00.837599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:00.837780 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:00.837645    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:00.837780 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:00.837664    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-56drh\" (UID: \"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"
Jul 07 22:15:00.837780 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:00.837703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:15:00.837780 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.837749    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 22:15:00.837780 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.837771    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle podName:b578bb6c-1572-4342-be6c-d10f04301077 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:04.837756043 +0000 UTC m=+44.153893446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle") pod "router-default-74b8948f45-trjld" (UID: "b578bb6c-1572-4342-be6c-d10f04301077") : configmap references non-existent config key: service-ca.crt
Jul 07 22:15:00.837996 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:00.837753    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:15:00.837996 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.837810    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs podName:b578bb6c-1572-4342-be6c-d10f04301077 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:04.83779432 +0000 UTC m=+44.153931724 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs") pod "router-default-74b8948f45-trjld" (UID: "b578bb6c-1572-4342-be6c-d10f04301077") : secret "router-metrics-certs-default" not found
Jul 07 22:15:00.837996 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.837834    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:15:00.837996 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.837848    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5859bf4c-vbt9h: secret "image-registry-tls" not found
Jul 07 22:15:00.837996 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.837867    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:15:00.837996 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.837879    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls podName:36015c76-eb45-4c10-b770-e2cba948b439 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:04.837870512 +0000 UTC m=+44.154007915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls") pod "image-registry-7f5859bf4c-vbt9h" (UID: "36015c76-eb45-4c10-b770-e2cba948b439") : secret "image-registry-tls" not found
Jul 07 22:15:00.837996 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.837883    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6fd7cb44-l78cx: secret "image-registry-tls" not found
Jul 07 22:15:00.837996 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.837833    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 22:15:00.837996 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.837912    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls podName:3dfbc8a0-47ab-4477-8a40-f02a6a0038cd nodeName:}" failed. No retries permitted until 2026-07-07 22:15:04.837903545 +0000 UTC m=+44.154040987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-56drh" (UID: "3dfbc8a0-47ab-4477-8a40-f02a6a0038cd") : secret "samples-operator-tls" not found
Jul 07 22:15:00.837996 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.837927    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls podName:80c9ea8c-875d-42d5-bfe6-6664d34c799c nodeName:}" failed. No retries permitted until 2026-07-07 22:15:04.837918341 +0000 UTC m=+44.154055746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls") pod "image-registry-f6fd7cb44-l78cx" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c") : secret "image-registry-tls" not found
Jul 07 22:15:00.939008 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:00.938972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:15:00.939168 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.939130    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 22:15:00.939241 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:00.939215    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls podName:5ae33a4a-0bdb-4f0e-9a86-221c82e0e066 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:04.939184927 +0000 UTC m=+44.255322330 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls") pod "dns-default-8bg8x" (UID: "5ae33a4a-0bdb-4f0e-9a86-221c82e0e066") : secret "dns-default-metrics-tls" not found
Jul 07 22:15:02.423378 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:02.423345    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:02.456522 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:02.456487    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5b9f6\" (UID: \"19eac3ab-96ae-45bd-a521-26becaa7f563\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:15:02.456717 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:02.456659    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 22:15:02.456768 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:02.456740    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert podName:19eac3ab-96ae-45bd-a521-26becaa7f563 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:06.456718906 +0000 UTC m=+45.772856311 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5b9f6" (UID: "19eac3ab-96ae-45bd-a521-26becaa7f563") : secret "networking-console-plugin-cert" not found
Jul 07 22:15:02.523785 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:02.523743    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:03.036998 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:03.036972    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:03.117676 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:03.117641    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:03.218428 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:03.218398    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:03.315369 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:03.315278    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:03.410813 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:03.410764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:04.024021 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:04.023981    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:04.077313 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:04.077273    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:04.398129 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:04.398037    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:04.456621 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:04.456586    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:04.778632 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:04.778599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:15:04.778808 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.778772    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 22:15:04.778882 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.778843    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls podName:042e7349-698d-48f3-8af4-4fb44cb9352c nodeName:}" failed. No retries permitted until 2026-07-07 22:15:12.778827409 +0000 UTC m=+52.094964828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4mk9h" (UID: "042e7349-698d-48f3-8af4-4fb44cb9352c") : secret "cluster-monitoring-operator-tls" not found
Jul 07 22:15:04.879267 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:04.879227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:15:04.879449 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:04.879364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:04.879449 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.879385    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:15:04.879449 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.879404    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5859bf4c-vbt9h: secret "image-registry-tls" not found
Jul 07 22:15:04.879449 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:04.879414    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:04.879449 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:04.879444    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-56drh\" (UID: \"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"
Jul 07 22:15:04.879708 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.879468    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls podName:36015c76-eb45-4c10-b770-e2cba948b439 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:12.879446981 +0000 UTC m=+52.195584406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls") pod "image-registry-7f5859bf4c-vbt9h" (UID: "36015c76-eb45-4c10-b770-e2cba948b439") : secret "image-registry-tls" not found
Jul 07 22:15:04.879708 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.879483    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 22:15:04.879708 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.879520    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs podName:b578bb6c-1572-4342-be6c-d10f04301077 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:12.879508968 +0000 UTC m=+52.195646375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs") pod "router-default-74b8948f45-trjld" (UID: "b578bb6c-1572-4342-be6c-d10f04301077") : secret "router-metrics-certs-default" not found
Jul 07 22:15:04.879708 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.879529    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 22:15:04.879708 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.879542    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle podName:b578bb6c-1572-4342-be6c-d10f04301077 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:12.879533436 +0000 UTC m=+52.195670840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle") pod "router-default-74b8948f45-trjld" (UID: "b578bb6c-1572-4342-be6c-d10f04301077") : configmap references non-existent config key: service-ca.crt
Jul 07 22:15:04.879708 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.879575    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls podName:3dfbc8a0-47ab-4477-8a40-f02a6a0038cd nodeName:}" failed. No retries permitted until 2026-07-07 22:15:12.87956199 +0000 UTC m=+52.195699397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-56drh" (UID: "3dfbc8a0-47ab-4477-8a40-f02a6a0038cd") : secret "samples-operator-tls" not found
Jul 07 22:15:04.879708 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:04.879592    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:15:04.880139 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.879763    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:15:04.880139 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.879782    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6fd7cb44-l78cx: secret "image-registry-tls" not found
Jul 07 22:15:04.880139 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.879835    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls podName:80c9ea8c-875d-42d5-bfe6-6664d34c799c nodeName:}" failed. No retries permitted until 2026-07-07 22:15:12.879820212 +0000 UTC m=+52.195957637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls") pod "image-registry-f6fd7cb44-l78cx" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c") : secret "image-registry-tls" not found
Jul 07 22:15:04.980456 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:04.980421    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:15:04.980622 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.980563    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 22:15:04.980664 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:04.980628    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls podName:5ae33a4a-0bdb-4f0e-9a86-221c82e0e066 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:12.980613779 +0000 UTC m=+52.296751185 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls") pod "dns-default-8bg8x" (UID: "5ae33a4a-0bdb-4f0e-9a86-221c82e0e066") : secret "dns-default-metrics-tls" not found
Jul 07 22:15:05.208146 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:05.208113    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:05.282461 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:05.282437    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:05.552753 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:05.552718    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45" event={"ID":"42aea693-6e1b-4430-85b7-7f93340ca882","Type":"ContainerStarted","Data":"a5b7e4fc6c700f760e927d07e83bab73b8f368252e1b8b99d12012125701a55f"}
Jul 07 22:15:05.554479 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:05.554443    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92" event={"ID":"75caa7ea-49e8-41cf-809d-0c2353fa69dd","Type":"ContainerStarted","Data":"704a69279d1c43e991a94b9753497d82d926e20c76f5050220f98360bf5a6b39"}
Jul 07 22:15:05.557130 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:05.557098    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-snwkk" event={"ID":"44656a98-ae77-4ed7-a2ee-aa6bb9af1437","Type":"ContainerStarted","Data":"11f64db360fd91eccc5c0ed3675902ff14aa3e40705337ed907003c04a00605e"}
Jul 07 22:15:05.559538 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:05.558975    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt" event={"ID":"4b45fd96-0bc5-4293-8f54-c477274177fe","Type":"ContainerStarted","Data":"acdf1b2d80ee2338bca112bbebe97ee4d486f65e95f952f48ef9322462e3fc08"}
Jul 07 22:15:05.570988 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:05.570933    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45" podStartSLOduration=29.826116152 podStartE2EDuration="37.570917101s" totalImagesPullingTime="7.744800949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:05.57035413 +0000 UTC m=+44.886491558" watchObservedRunningTime="2026-07-07 22:15:05.570917101 +0000 UTC m=+44.887054525"
Jul 07 22:15:05.610244 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:05.610212    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:05.618508 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:05.617215    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-snwkk" podStartSLOduration=32.808444477 podStartE2EDuration="40.617179146s" totalImagesPullingTime="7.808734669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:05.592847313 +0000 UTC m=+44.908984738" watchObservedRunningTime="2026-07-07 22:15:05.617179146 +0000 UTC m=+44.933316572"
Jul 07 22:15:05.618508 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:05.617598    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92" podStartSLOduration=27.792009677 podStartE2EDuration="35.617583842s" totalImagesPullingTime="7.825574165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:05.616452387 +0000 UTC m=+44.932589828" watchObservedRunningTime="2026-07-07 22:15:05.617583842 +0000 UTC m=+44.933721265"
Jul 07 22:15:05.712693 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:05.712626    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:05.763190 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:05.763146    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:06.498115 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:06.498080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5b9f6\" (UID: \"19eac3ab-96ae-45bd-a521-26becaa7f563\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:15:06.498642 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:06.498357    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 22:15:06.498642 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:06.498421    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert podName:19eac3ab-96ae-45bd-a521-26becaa7f563 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:14.498403297 +0000 UTC m=+53.814540703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5b9f6" (UID: "19eac3ab-96ae-45bd-a521-26becaa7f563") : secret "networking-console-plugin-cert" not found
Jul 07 22:15:06.565167 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:06.564795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xrff4" event={"ID":"e7952286-be37-4657-a639-fd1d0e0fd54f","Type":"ContainerStarted","Data":"ea87f43c0cb57722fc9ca07b331489806eecc9551eabfbc1fbb928ad786054c4"}
Jul 07 22:15:06.566528 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:06.566476    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4889x" event={"ID":"711e34a9-0496-4aa9-a5be-b178510ec995","Type":"ContainerStarted","Data":"2306f133a4c72f8377a0eda4423abff611b88493a5c1cbc494472aa92d4f5357"}
Jul 07 22:15:06.575171 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:06.575132    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-kmn4d" event={"ID":"c9511a2a-cc3f-4040-93e5-2198149b0cb5","Type":"ContainerStarted","Data":"d7061208340c3bce9861a5791029207c1edef3520379634dab79e390a8495e71"}
Jul 07 22:15:06.577134 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:06.577114    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/0.log"
Jul 07 22:15:06.577282 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:06.577151    2561 generic.go:356] "Generic (PLEG): container finished" podID="4b45fd96-0bc5-4293-8f54-c477274177fe" containerID="acdf1b2d80ee2338bca112bbebe97ee4d486f65e95f952f48ef9322462e3fc08" exitCode=255
Jul 07 22:15:06.577282 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:06.577226    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt" event={"ID":"4b45fd96-0bc5-4293-8f54-c477274177fe","Type":"ContainerDied","Data":"acdf1b2d80ee2338bca112bbebe97ee4d486f65e95f952f48ef9322462e3fc08"}
Jul 07 22:15:06.577458 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:06.577442    2561 scope.go:117] "RemoveContainer" containerID="acdf1b2d80ee2338bca112bbebe97ee4d486f65e95f952f48ef9322462e3fc08"
Jul 07 22:15:06.590171 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:06.590049    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-xrff4" podStartSLOduration=33.910565458 podStartE2EDuration="41.590030231s" totalImagesPullingTime="7.679464773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:06.588640542 +0000 UTC m=+45.904777989" watchObservedRunningTime="2026-07-07 22:15:06.590030231 +0000 UTC m=+45.906167657"
Jul 07 22:15:06.628945 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:06.628879    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-kmn4d" podStartSLOduration=27.764381813 podStartE2EDuration="35.628857684s" totalImagesPullingTime="7.864475871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:06.626389478 +0000 UTC m=+45.942526939" watchObservedRunningTime="2026-07-07 22:15:06.628857684 +0000 UTC m=+45.944995112"
Jul 07 22:15:07.162257 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.162184    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4889x" podStartSLOduration=3.484655147 podStartE2EDuration="11.162162464s" totalImagesPullingTime="7.677507317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:06.647572561 +0000 UTC m=+45.963709984" watchObservedRunningTime="2026-07-07 22:15:07.162162464 +0000 UTC m=+46.478299888"
Jul 07 22:15:07.162937 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.162909    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mzlpx"]
Jul 07 22:15:07.184276 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.184243    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mzlpx"]
Jul 07 22:15:07.184474 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.184314    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.186918 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.186893    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hlhsn\""
Jul 07 22:15:07.187057 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.187029    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 22:15:07.188084 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.188055    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 22:15:07.208586 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.208552    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:07.266742 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.266702    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:07.318810 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.318767    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3775aa4f-886b-4e99-a63f-ff6930e1f560-data-volume\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.318985 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.318821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.319029 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.319007    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.319163 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.319138    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3775aa4f-886b-4e99-a63f-ff6930e1f560-crio-socket\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.319228 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.319184    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5f92\" (UniqueName: \"kubernetes.io/projected/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-api-access-g5f92\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.420368 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.420281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3775aa4f-886b-4e99-a63f-ff6930e1f560-data-volume\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.420368 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.420320    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.420565 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.420412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.420565 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:07.420500    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 22:15:07.420565 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.420506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3775aa4f-886b-4e99-a63f-ff6930e1f560-crio-socket\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.420565 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.420535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5f92\" (UniqueName: \"kubernetes.io/projected/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-api-access-g5f92\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.420565 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:07.420564    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm podName:3775aa4f-886b-4e99-a63f-ff6930e1f560 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:07.920544962 +0000 UTC m=+47.236682380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mzlpx" (UID: "3775aa4f-886b-4e99-a63f-ff6930e1f560") : configmap "kube-rbac-proxy" not found
Jul 07 22:15:07.420794 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:07.420620    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 22:15:07.420794 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.420642    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3775aa4f-886b-4e99-a63f-ff6930e1f560-data-volume\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.420794 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:07.420693    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls podName:3775aa4f-886b-4e99-a63f-ff6930e1f560 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:07.920672758 +0000 UTC m=+47.236810177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mzlpx" (UID: "3775aa4f-886b-4e99-a63f-ff6930e1f560") : secret "insights-runtime-extractor-tls" not found
Jul 07 22:15:07.420794 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.420706    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3775aa4f-886b-4e99-a63f-ff6930e1f560-crio-socket\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.431650 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.431615    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5f92\" (UniqueName: \"kubernetes.io/projected/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-api-access-g5f92\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.442516 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.442492    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:15:07.442650 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.442541    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:15:07.453989 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.453947    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:07.555804 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.555763    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:07.583179 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.583149    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:15:07.583589 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.583570    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/0.log"
Jul 07 22:15:07.583668 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.583604    2561 generic.go:356] "Generic (PLEG): container finished" podID="4b45fd96-0bc5-4293-8f54-c477274177fe" containerID="b7c1ec4e60124250e49a227ccc252b2a6e363f1bef1bca619e127f964b30c5db" exitCode=255
Jul 07 22:15:07.583668 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.583644    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt" event={"ID":"4b45fd96-0bc5-4293-8f54-c477274177fe","Type":"ContainerDied","Data":"b7c1ec4e60124250e49a227ccc252b2a6e363f1bef1bca619e127f964b30c5db"}
Jul 07 22:15:07.583771 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.583702    2561 scope.go:117] "RemoveContainer" containerID="acdf1b2d80ee2338bca112bbebe97ee4d486f65e95f952f48ef9322462e3fc08"
Jul 07 22:15:07.584218 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.584177    2561 scope.go:117] "RemoveContainer" containerID="b7c1ec4e60124250e49a227ccc252b2a6e363f1bef1bca619e127f964b30c5db"
Jul 07 22:15:07.584357 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:07.584338    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-j6ggt_openshift-console-operator(4b45fd96-0bc5-4293-8f54-c477274177fe)\"" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt" podUID="4b45fd96-0bc5-4293-8f54-c477274177fe"
Jul 07 22:15:07.636789 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.636762    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-pdg4x"]
Jul 07 22:15:07.650457 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.650414    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:07.662228 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.662186    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-pdg4x"]
Jul 07 22:15:07.662375 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.662311    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pdg4x"
Jul 07 22:15:07.665121 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.665099    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 07 22:15:07.665261 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.665156    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dnlsh\""
Jul 07 22:15:07.665261 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.665175    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 07 22:15:07.717872 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.717842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:07.723101 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.723062    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpb6k\" (UniqueName: \"kubernetes.io/projected/504958b6-3b25-47af-bebc-db979abb7c92-kube-api-access-bpb6k\") pod \"migrator-d57d58cc9-pdg4x\" (UID: \"504958b6-3b25-47af-bebc-db979abb7c92\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pdg4x"
Jul 07 22:15:07.824397 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.824359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpb6k\" (UniqueName: \"kubernetes.io/projected/504958b6-3b25-47af-bebc-db979abb7c92-kube-api-access-bpb6k\") pod \"migrator-d57d58cc9-pdg4x\" (UID: \"504958b6-3b25-47af-bebc-db979abb7c92\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pdg4x"
Jul 07 22:15:07.832580 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.832557    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpb6k\" (UniqueName: \"kubernetes.io/projected/504958b6-3b25-47af-bebc-db979abb7c92-kube-api-access-bpb6k\") pod \"migrator-d57d58cc9-pdg4x\" (UID: \"504958b6-3b25-47af-bebc-db979abb7c92\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pdg4x"
Jul 07 22:15:07.925946 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.925912    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.926126 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.926019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:07.926126 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:07.926071    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 22:15:07.926126 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:07.926121    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 22:15:07.926275 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:07.926138    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls podName:3775aa4f-886b-4e99-a63f-ff6930e1f560 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:08.926121662 +0000 UTC m=+48.242259064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mzlpx" (UID: "3775aa4f-886b-4e99-a63f-ff6930e1f560") : secret "insights-runtime-extractor-tls" not found
Jul 07 22:15:07.926275 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:07.926160    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm podName:3775aa4f-886b-4e99-a63f-ff6930e1f560 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:08.926147763 +0000 UTC m=+48.242285166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mzlpx" (UID: "3775aa4f-886b-4e99-a63f-ff6930e1f560") : configmap "kube-rbac-proxy" not found
Jul 07 22:15:07.972433 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:07.972351    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pdg4x"
Jul 07 22:15:08.057599 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:08.057556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:08.116513 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:08.116486    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-pdg4x"]
Jul 07 22:15:08.118873 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:15:08.118847    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504958b6_3b25_47af_bebc_db979abb7c92.slice/crio-a06120bc0145cf1ea8b43fcc5e34abaf1573427555a72b82155e0bb769307798 WatchSource:0}: Error finding container a06120bc0145cf1ea8b43fcc5e34abaf1573427555a72b82155e0bb769307798: Status 404 returned error can't find the container with id a06120bc0145cf1ea8b43fcc5e34abaf1573427555a72b82155e0bb769307798
Jul 07 22:15:08.119483 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:08.119445    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:08.549074 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:08.549046    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z9j2z_6cb3a312-1e9b-4d3d-899c-732658e9719e/dns-node-resolver/0.log"
Jul 07 22:15:08.589276 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:08.589246    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:15:08.589739 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:08.589628    2561 scope.go:117] "RemoveContainer" containerID="b7c1ec4e60124250e49a227ccc252b2a6e363f1bef1bca619e127f964b30c5db"
Jul 07 22:15:08.589804 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:08.589782    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-j6ggt_openshift-console-operator(4b45fd96-0bc5-4293-8f54-c477274177fe)\"" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt" podUID="4b45fd96-0bc5-4293-8f54-c477274177fe"
Jul 07 22:15:08.590637 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:08.590612    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pdg4x" event={"ID":"504958b6-3b25-47af-bebc-db979abb7c92","Type":"ContainerStarted","Data":"a06120bc0145cf1ea8b43fcc5e34abaf1573427555a72b82155e0bb769307798"}
Jul 07 22:15:08.936852 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:08.936807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:08.937028 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:08.936932    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 22:15:08.937028 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:08.936974    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:08.937028 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:08.936997    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm podName:3775aa4f-886b-4e99-a63f-ff6930e1f560 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:10.936980224 +0000 UTC m=+50.253117647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mzlpx" (UID: "3775aa4f-886b-4e99-a63f-ff6930e1f560") : configmap "kube-rbac-proxy" not found
Jul 07 22:15:08.937228 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:08.937065    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 22:15:08.937228 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:08.937115    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls podName:3775aa4f-886b-4e99-a63f-ff6930e1f560 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:10.937104575 +0000 UTC m=+50.253241978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mzlpx" (UID: "3775aa4f-886b-4e99-a63f-ff6930e1f560") : secret "insights-runtime-extractor-tls" not found
Jul 07 22:15:09.148800 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.148765    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gqdwk_9f07fbbf-a565-4d75-8c14-0231b9d78467/node-ca/0.log"
Jul 07 22:15:09.666088 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.666051    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-fh9fs"]
Jul 07 22:15:09.697183 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.697145    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:09.697909 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.697875    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-fh9fs"]
Jul 07 22:15:09.698033 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.697986    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-fh9fs"
Jul 07 22:15:09.700633 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.700559    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 07 22:15:09.700799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.700648    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 07 22:15:09.700899 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.700883    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 07 22:15:09.700954 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.700884    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 07 22:15:09.701950 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.701845    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nn5n8\""
Jul 07 22:15:09.749594 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.749551    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:09.846056 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.846024    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/33925724-182b-4433-ba59-7b1eb0520ca6-signing-cabundle\") pod \"service-ca-758f599c5-fh9fs\" (UID: \"33925724-182b-4433-ba59-7b1eb0520ca6\") " pod="openshift-service-ca/service-ca-758f599c5-fh9fs"
Jul 07 22:15:09.846256 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.846223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/33925724-182b-4433-ba59-7b1eb0520ca6-signing-key\") pod \"service-ca-758f599c5-fh9fs\" (UID: \"33925724-182b-4433-ba59-7b1eb0520ca6\") " pod="openshift-service-ca/service-ca-758f599c5-fh9fs"
Jul 07 22:15:09.846335 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.846267    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d58tf\" (UniqueName: \"kubernetes.io/projected/33925724-182b-4433-ba59-7b1eb0520ca6-kube-api-access-d58tf\") pod \"service-ca-758f599c5-fh9fs\" (UID: \"33925724-182b-4433-ba59-7b1eb0520ca6\") " pod="openshift-service-ca/service-ca-758f599c5-fh9fs"
Jul 07 22:15:09.947012 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.946976    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/33925724-182b-4433-ba59-7b1eb0520ca6-signing-cabundle\") pod \"service-ca-758f599c5-fh9fs\" (UID: \"33925724-182b-4433-ba59-7b1eb0520ca6\") " pod="openshift-service-ca/service-ca-758f599c5-fh9fs"
Jul 07 22:15:09.947218 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.947110    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/33925724-182b-4433-ba59-7b1eb0520ca6-signing-key\") pod \"service-ca-758f599c5-fh9fs\" (UID: \"33925724-182b-4433-ba59-7b1eb0520ca6\") " pod="openshift-service-ca/service-ca-758f599c5-fh9fs"
Jul 07 22:15:09.947218 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.947136    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d58tf\" (UniqueName: \"kubernetes.io/projected/33925724-182b-4433-ba59-7b1eb0520ca6-kube-api-access-d58tf\") pod \"service-ca-758f599c5-fh9fs\" (UID: \"33925724-182b-4433-ba59-7b1eb0520ca6\") " pod="openshift-service-ca/service-ca-758f599c5-fh9fs"
Jul 07 22:15:09.947693 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.947670    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/33925724-182b-4433-ba59-7b1eb0520ca6-signing-cabundle\") pod \"service-ca-758f599c5-fh9fs\" (UID: \"33925724-182b-4433-ba59-7b1eb0520ca6\") " pod="openshift-service-ca/service-ca-758f599c5-fh9fs"
Jul 07 22:15:09.949623 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.949601    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/33925724-182b-4433-ba59-7b1eb0520ca6-signing-key\") pod \"service-ca-758f599c5-fh9fs\" (UID: \"33925724-182b-4433-ba59-7b1eb0520ca6\") " pod="openshift-service-ca/service-ca-758f599c5-fh9fs"
Jul 07 22:15:09.949761 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.949740    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4889x_711e34a9-0496-4aa9-a5be-b178510ec995/serve-healthcheck-canary/0.log"
Jul 07 22:15:09.954729 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:09.954705    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d58tf\" (UniqueName: \"kubernetes.io/projected/33925724-182b-4433-ba59-7b1eb0520ca6-kube-api-access-d58tf\") pod \"service-ca-758f599c5-fh9fs\" (UID: \"33925724-182b-4433-ba59-7b1eb0520ca6\") " pod="openshift-service-ca/service-ca-758f599c5-fh9fs"
Jul 07 22:15:10.010043 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:10.010007    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-fh9fs"
Jul 07 22:15:10.237187 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:10.237163    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-fh9fs"]
Jul 07 22:15:10.239494 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:15:10.239471    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33925724_182b_4433_ba59_7b1eb0520ca6.slice/crio-25e5e2ff359d67993179fa59bbb472ca701cbd646d203991ef6ce737a2aefa6e WatchSource:0}: Error finding container 25e5e2ff359d67993179fa59bbb472ca701cbd646d203991ef6ce737a2aefa6e: Status 404 returned error can't find the container with id 25e5e2ff359d67993179fa59bbb472ca701cbd646d203991ef6ce737a2aefa6e
Jul 07 22:15:10.600918 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:10.600417    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-fh9fs" event={"ID":"33925724-182b-4433-ba59-7b1eb0520ca6","Type":"ContainerStarted","Data":"8c2f6272421e231cf0202a572118471d025e9c7f89d6f2a9b8fe15980214da78"}
Jul 07 22:15:10.600918 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:10.600526    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-fh9fs" event={"ID":"33925724-182b-4433-ba59-7b1eb0520ca6","Type":"ContainerStarted","Data":"25e5e2ff359d67993179fa59bbb472ca701cbd646d203991ef6ce737a2aefa6e"}
Jul 07 22:15:10.604017 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:10.602502    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pdg4x" event={"ID":"504958b6-3b25-47af-bebc-db979abb7c92","Type":"ContainerStarted","Data":"5ae23bbc708b612c75760c3cfa3eb64997a5264a3bfd65d4e7ffa2bf165bd704"}
Jul 07 22:15:10.604017 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:10.602562    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pdg4x" event={"ID":"504958b6-3b25-47af-bebc-db979abb7c92","Type":"ContainerStarted","Data":"4d38f1df262c0fd713b4e2af678ee4e56d78fdc355feb0098d6889580dcae81f"}
Jul 07 22:15:10.605651 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:10.605621    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:10.619908 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:10.619854    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-fh9fs" podStartSLOduration=1.619837626 podStartE2EDuration="1.619837626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:10.618309839 +0000 UTC m=+49.934447268" watchObservedRunningTime="2026-07-07 22:15:10.619837626 +0000 UTC m=+49.935975086"
Jul 07 22:15:10.635496 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:10.635453    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-pdg4x" podStartSLOduration=1.648486948 podStartE2EDuration="3.635434756s" totalImagesPullingTime="1.986947808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:10.634239297 +0000 UTC m=+49.950376746" watchObservedRunningTime="2026-07-07 22:15:10.635434756 +0000 UTC m=+49.951572206"
Jul 07 22:15:10.958318 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:10.958279    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:10.958761 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:10.958406    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 22:15:10.958761 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:10.958421    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:10.958761 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:10.958467    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm podName:3775aa4f-886b-4e99-a63f-ff6930e1f560 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:14.958450941 +0000 UTC m=+54.274588344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mzlpx" (UID: "3775aa4f-886b-4e99-a63f-ff6930e1f560") : configmap "kube-rbac-proxy" not found
Jul 07 22:15:10.958761 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:10.958540    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 22:15:10.958761 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:10.958601    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls podName:3775aa4f-886b-4e99-a63f-ff6930e1f560 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:14.958581511 +0000 UTC m=+54.274718919 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mzlpx" (UID: "3775aa4f-886b-4e99-a63f-ff6930e1f560") : secret "insights-runtime-extractor-tls" not found
Jul 07 22:15:11.639339 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:11.639300    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:11.846807 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:11.846775    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:12.006489 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.006457    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:12.198669 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.198612    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:12.317042 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.316954    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:12.417014 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.416979    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:12.517531 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.517486    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:12.728378 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.728334    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:12.878976 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.878937    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:15:12.879173 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:12.879105    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 22:15:12.879173 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:12.879171    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls podName:042e7349-698d-48f3-8af4-4fb44cb9352c nodeName:}" failed. No retries permitted until 2026-07-07 22:15:28.879154928 +0000 UTC m=+68.195292334 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-4mk9h" (UID: "042e7349-698d-48f3-8af4-4fb44cb9352c") : secret "cluster-monitoring-operator-tls" not found
Jul 07 22:15:12.980446 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.980352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:12.980446 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.980442    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:12.980640 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.980473    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-56drh\" (UID: \"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"
Jul 07 22:15:12.980640 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:12.980495    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 22:15:12.980640 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.980523    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:15:12.980640 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:12.980564    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs podName:b578bb6c-1572-4342-be6c-d10f04301077 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:28.980541083 +0000 UTC m=+68.296678489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs") pod "router-default-74b8948f45-trjld" (UID: "b578bb6c-1572-4342-be6c-d10f04301077") : secret "router-metrics-certs-default" not found
Jul 07 22:15:12.980640 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:12.980621    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:15:12.980640 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:12.980635    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6fd7cb44-l78cx: secret "image-registry-tls" not found
Jul 07 22:15:12.980640 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:12.980638    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle podName:b578bb6c-1572-4342-be6c-d10f04301077 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:28.980619097 +0000 UTC m=+68.296756503 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle") pod "router-default-74b8948f45-trjld" (UID: "b578bb6c-1572-4342-be6c-d10f04301077") : configmap references non-existent config key: service-ca.crt
Jul 07 22:15:12.980896 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:12.980676    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls podName:80c9ea8c-875d-42d5-bfe6-6664d34c799c nodeName:}" failed. No retries permitted until 2026-07-07 22:15:28.980662554 +0000 UTC m=+68.296799961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls") pod "image-registry-f6fd7cb44-l78cx" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c") : secret "image-registry-tls" not found
Jul 07 22:15:12.980896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.980737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:15:12.980896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.980772    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:15:12.980896 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:12.980850    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 22:15:12.980896 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:12.980892    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls podName:5ae33a4a-0bdb-4f0e-9a86-221c82e0e066 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:28.980879539 +0000 UTC m=+68.297016948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls") pod "dns-default-8bg8x" (UID: "5ae33a4a-0bdb-4f0e-9a86-221c82e0e066") : secret "dns-default-metrics-tls" not found
Jul 07 22:15:12.981138 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:12.980972    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 22:15:12.981138 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:12.980993    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f5859bf4c-vbt9h: secret "image-registry-tls" not found
Jul 07 22:15:12.981138 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:12.981059    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls podName:36015c76-eb45-4c10-b770-e2cba948b439 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:28.981031261 +0000 UTC m=+68.297168677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls") pod "image-registry-7f5859bf4c-vbt9h" (UID: "36015c76-eb45-4c10-b770-e2cba948b439") : secret "image-registry-tls" not found
Jul 07 22:15:12.982903 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:12.982882    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3dfbc8a0-47ab-4477-8a40-f02a6a0038cd-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-56drh\" (UID: \"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"
Jul 07 22:15:13.001848 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:13.001824    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"
Jul 07 22:15:13.126786 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:13.126761    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh"]
Jul 07 22:15:13.283722 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:13.283645    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:13.523468 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:13.523428    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:13.613797 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:13.613705    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh" event={"ID":"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd","Type":"ContainerStarted","Data":"fcdcd98e338a2006de0d4badef8d0857229e01f9a212cfb10d77ee9961d12409"}
Jul 07 22:15:13.923462 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:13.923375    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:14.313317 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:14.313287    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:14.416609 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:14.416570    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:14.516017 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:14.515981    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:14.597121 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:14.597028    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5b9f6\" (UID: \"19eac3ab-96ae-45bd-a521-26becaa7f563\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:15:14.597276 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:14.597185    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 22:15:14.597276 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:14.597268    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert podName:19eac3ab-96ae-45bd-a521-26becaa7f563 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:30.597250413 +0000 UTC m=+69.913387816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-5b9f6" (UID: "19eac3ab-96ae-45bd-a521-26becaa7f563") : secret "networking-console-plugin-cert" not found
Jul 07 22:15:15.000084 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:15.000048    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:15.000368 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:15.000143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:15.000368 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:15.000212    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 22:15:15.000368 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:15.000290    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm podName:3775aa4f-886b-4e99-a63f-ff6930e1f560 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:23.000274455 +0000 UTC m=+62.316411880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mzlpx" (UID: "3775aa4f-886b-4e99-a63f-ff6930e1f560") : configmap "kube-rbac-proxy" not found
Jul 07 22:15:15.000368 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:15.000294    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 22:15:15.000368 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:15:15.000343    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls podName:3775aa4f-886b-4e99-a63f-ff6930e1f560 nodeName:}" failed. No retries permitted until 2026-07-07 22:15:23.000330678 +0000 UTC m=+62.316468100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mzlpx" (UID: "3775aa4f-886b-4e99-a63f-ff6930e1f560") : secret "insights-runtime-extractor-tls" not found
Jul 07 22:15:15.115049 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:15.115004    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:15.310098 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:15.310001    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:15.362990 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:15.362956    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:15.623416 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:15.623386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh" event={"ID":"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd","Type":"ContainerStarted","Data":"a7c79c6e14d67dab55b1a58609b0f834a995c24d0b3a5a1f6914e49347572c4e"}
Jul 07 22:15:15.803052 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:15.803010    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:15.916272 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:15.916145    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:16.332951 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:16.332919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:16.435385 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:16.435351    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:16.614115 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:16.614007    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:16.628155 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:16.628128    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh" event={"ID":"3dfbc8a0-47ab-4477-8a40-f02a6a0038cd","Type":"ContainerStarted","Data":"2c0a412a17693476e7355579c441143211dc5920b5a0322fc2bf7daf59c87bd9"}
Jul 07 22:15:16.645030 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:16.644985    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-56drh" podStartSLOduration=49.276669696 podStartE2EDuration="51.644969854s" totalImagesPullingTime="2.368300158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:16.64300921 +0000 UTC m=+55.959146636" watchObservedRunningTime="2026-07-07 22:15:16.644969854 +0000 UTC m=+55.961107278"
Jul 07 22:15:16.722966 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:16.722919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:16.918694 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:16.918578    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:17.441813 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:17.441775    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:15:17.442222 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:17.441835    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:15:17.442269 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:17.442232    2561 scope.go:117] "RemoveContainer" containerID="b7c1ec4e60124250e49a227ccc252b2a6e363f1bef1bca619e127f964b30c5db"
Jul 07 22:15:17.515306 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:17.515179    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:17.634302 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:17.634274    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:15:17.634468 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:17.634397    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt" event={"ID":"4b45fd96-0bc5-4293-8f54-c477274177fe","Type":"ContainerStarted","Data":"c61f00e6f986ba852cd5b7b9760a4b0afc8e76e12fcbaf122c0ceb3fa4b682d3"}
Jul 07 22:15:17.634819 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:17.634718    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:15:17.650475 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:17.650420    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt" podStartSLOduration=44.991061449 podStartE2EDuration="52.650404383s" totalImagesPullingTime="7.659342934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:17.64987289 +0000 UTC m=+56.966010316" watchObservedRunningTime="2026-07-07 22:15:17.650404383 +0000 UTC m=+56.966541808"
Jul 07 22:15:17.986569 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:17.986533    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:18.112398 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:18.112361    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:18.312107 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:18.312007    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:18.449233 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:18.449189    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-j6ggt"
Jul 07 22:15:18.481926 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:18.481873    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjkqk"
Jul 07 22:15:18.538006 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:18.537969    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:18.681965 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:18.681877    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:18.778388 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:18.778359    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:18.898699 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:18.898664    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:18.999320 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:18.999284    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:19.299079 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:19.298990    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:19.513737 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:19.513705    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:19.724289 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:19.724254    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:19.822920 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:19.822884    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:19.924314 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:19.924285    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:20.131835 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:20.131744    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:20.232804 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:20.232767    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:20.333342 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:20.333303    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:20.434436 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:20.434408    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:20.534442 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:20.534395    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:20.587524 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:20.587492    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:20.722587 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:20.722497    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:20.885507 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:20.885473    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:20.986835 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:20.986743    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:21.313124 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:21.313028    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:21.732698 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:21.732651    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:21.913504 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:21.913458    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:22.115178 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:22.115069    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:22.512537 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:22.512508    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:22.715482 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:22.715443    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log" limit=1024
Jul 07 22:15:23.081273 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:23.081239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:23.081648 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:23.081410    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:23.081907 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:23.081878    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3775aa4f-886b-4e99-a63f-ff6930e1f560-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:23.083981 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:23.083953    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3775aa4f-886b-4e99-a63f-ff6930e1f560-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzlpx\" (UID: \"3775aa4f-886b-4e99-a63f-ff6930e1f560\") " pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:23.097994 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:23.097968    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hlhsn\""
Jul 07 22:15:23.106093 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:23.106069    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mzlpx"
Jul 07 22:15:23.260343 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:23.260299    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mzlpx"]
Jul 07 22:15:23.262913 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:15:23.262891    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3775aa4f_886b_4e99_a63f_ff6930e1f560.slice/crio-b52ee7cb9646ce6602ed3faadf08b24b19653040f2b20c9dc311cc524ccd3a12 WatchSource:0}: Error finding container b52ee7cb9646ce6602ed3faadf08b24b19653040f2b20c9dc311cc524ccd3a12: Status 404 returned error can't find the container with id b52ee7cb9646ce6602ed3faadf08b24b19653040f2b20c9dc311cc524ccd3a12
Jul 07 22:15:23.654372 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:23.654338    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzlpx" event={"ID":"3775aa4f-886b-4e99-a63f-ff6930e1f560","Type":"ContainerStarted","Data":"b52ee7cb9646ce6602ed3faadf08b24b19653040f2b20c9dc311cc524ccd3a12"}
Jul 07 22:15:27.120586 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.120544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs\") pod \"network-metrics-daemon-m7pwq\" (UID: \"49442a39-eb53-419a-a05d-209c81bba22e\") " pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:15:27.121064 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.120638    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:15:27.123419 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.123343    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 22:15:27.123419 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.123401    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 22:15:27.133722 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.133699    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c-original-pull-secret\") pod \"global-pull-secret-syncer-7rp6t\" (UID: \"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c\") " pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:15:27.133830 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.133746    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49442a39-eb53-419a-a05d-209c81bba22e-metrics-certs\") pod \"network-metrics-daemon-m7pwq\" (UID: \"49442a39-eb53-419a-a05d-209c81bba22e\") " pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:15:27.221695 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.221653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk98\" (UniqueName: \"kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98\") pod \"network-check-target-92k2m\" (UID: \"a48a3e6e-45b3-48b6-92ee-d350937c8c46\") " pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:15:27.224525 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.224500    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zk98\" (UniqueName: \"kubernetes.io/projected/a48a3e6e-45b3-48b6-92ee-d350937c8c46-kube-api-access-5zk98\") pod \"network-check-target-92k2m\" (UID: \"a48a3e6e-45b3-48b6-92ee-d350937c8c46\") " pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:15:27.302300 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.302257    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lkskh\""
Jul 07 22:15:27.310519 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.310476    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-m7pwq"
Jul 07 22:15:27.405881 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.405803    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j7fbf\""
Jul 07 22:15:27.409985 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.409955    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7rp6t"
Jul 07 22:15:27.414103 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.414077    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:15:27.682628 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.682592    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-92k2m"]
Jul 07 22:15:27.686145 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:15:27.686112    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48a3e6e_45b3_48b6_92ee_d350937c8c46.slice/crio-c1c8d858a76100e7b39683260ce882f6b660c0a92923c492733f8dc93ec0017f WatchSource:0}: Error finding container c1c8d858a76100e7b39683260ce882f6b660c0a92923c492733f8dc93ec0017f: Status 404 returned error can't find the container with id c1c8d858a76100e7b39683260ce882f6b660c0a92923c492733f8dc93ec0017f
Jul 07 22:15:27.706798 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.706768    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7rp6t"]
Jul 07 22:15:27.707925 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:27.707899    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-m7pwq"]
Jul 07 22:15:27.709364 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:15:27.709338    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b9c7c7_f0ee_45dd_8d3b_b2ca737b3d8c.slice/crio-ec447374cbca866b00869f9ac58138d7d54085763366bb65179c9e468bab692c WatchSource:0}: Error finding container ec447374cbca866b00869f9ac58138d7d54085763366bb65179c9e468bab692c: Status 404 returned error can't find the container with id ec447374cbca866b00869f9ac58138d7d54085763366bb65179c9e468bab692c
Jul 07 22:15:27.710338 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:15:27.710187    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49442a39_eb53_419a_a05d_209c81bba22e.slice/crio-e3c6fe6dcd45411cb80f44f4b307bb76710832dd82116c77bd083240e6ebe066 WatchSource:0}: Error finding container e3c6fe6dcd45411cb80f44f4b307bb76710832dd82116c77bd083240e6ebe066: Status 404 returned error can't find the container with id e3c6fe6dcd45411cb80f44f4b307bb76710832dd82116c77bd083240e6ebe066
Jul 07 22:15:28.675961 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:28.675875    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzlpx" event={"ID":"3775aa4f-886b-4e99-a63f-ff6930e1f560","Type":"ContainerStarted","Data":"cad5122d0fa45d0658ede2d86395c9966262f861dfc754e50e56b7d9cf838d49"}
Jul 07 22:15:28.677931 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:28.677897    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-92k2m" event={"ID":"a48a3e6e-45b3-48b6-92ee-d350937c8c46","Type":"ContainerStarted","Data":"06b6caf83edbc367eccb004693e4792a108bbcde9ebb3442b6a6b41dfa8c09f4"}
Jul 07 22:15:28.678081 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:28.677950    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-92k2m" event={"ID":"a48a3e6e-45b3-48b6-92ee-d350937c8c46","Type":"ContainerStarted","Data":"c1c8d858a76100e7b39683260ce882f6b660c0a92923c492733f8dc93ec0017f"}
Jul 07 22:15:28.678081 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:28.678000    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:15:28.679478 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:28.679454    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7rp6t" event={"ID":"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c","Type":"ContainerStarted","Data":"ec447374cbca866b00869f9ac58138d7d54085763366bb65179c9e468bab692c"}
Jul 07 22:15:28.681599 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:28.681545    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m7pwq" event={"ID":"49442a39-eb53-419a-a05d-209c81bba22e","Type":"ContainerStarted","Data":"e3c6fe6dcd45411cb80f44f4b307bb76710832dd82116c77bd083240e6ebe066"}
Jul 07 22:15:28.937556 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:28.937520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:15:28.940486 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:28.940456    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/042e7349-698d-48f3-8af4-4fb44cb9352c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-4mk9h\" (UID: \"042e7349-698d-48f3-8af4-4fb44cb9352c\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:15:29.015399 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.012724    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-92k2m" podStartSLOduration=66.012671472 podStartE2EDuration="1m6.012671472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:28.694412716 +0000 UTC m=+68.010550162" watchObservedRunningTime="2026-07-07 22:15:29.012671472 +0000 UTC m=+68.328808898"
Jul 07 22:15:29.015399 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.013355    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"]
Jul 07 22:15:29.035588 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.031898    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l"]
Jul 07 22:15:29.035588 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.033327    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"
Jul 07 22:15:29.040667 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.037403    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 22:15:29.040667 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.037540    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 22:15:29.040667 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.037633    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 22:15:29.040667 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.037822    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 22:15:29.040667 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.038072    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:29.040667 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.038119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:29.040667 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.038154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:15:29.040667 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.038221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:15:29.040667 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.038252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:15:29.040667 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.039496    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b578bb6c-1572-4342-be6c-d10f04301077-service-ca-bundle\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:29.044812 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.044664    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls\") pod \"image-registry-7f5859bf4c-vbt9h\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") " pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:15:29.044812 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.044662    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls\") pod \"image-registry-f6fd7cb44-l78cx\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") " pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:15:29.045020 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.044965    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ae33a4a-0bdb-4f0e-9a86-221c82e0e066-metrics-tls\") pod \"dns-default-8bg8x\" (UID: \"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066\") " pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:15:29.046632 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.046570    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b578bb6c-1572-4342-be6c-d10f04301077-metrics-certs\") pod \"router-default-74b8948f45-trjld\" (UID: \"b578bb6c-1572-4342-be6c-d10f04301077\") " pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:29.066602 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.066415    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"]
Jul 07 22:15:29.067045 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.067022    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l"
Jul 07 22:15:29.070020 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.069994    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-td2s9\""
Jul 07 22:15:29.070135 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.070088    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 22:15:29.088799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.088771    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"]
Jul 07 22:15:29.089092 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.089035    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l"]
Jul 07 22:15:29.089092 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.089061    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.089667 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.089065    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"]
Jul 07 22:15:29.089667 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.089619    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f6fd7cb44-l78cx"]
Jul 07 22:15:29.092463 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.092440    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 22:15:29.092578 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.092532    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 22:15:29.092578 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.092554    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 22:15:29.092692 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.092659    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 22:15:29.092793 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.092756    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rqfd9\""
Jul 07 22:15:29.100439 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.100239    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:15:29.101218 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.101157    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-dh2jr\""
Jul 07 22:15:29.109462 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.109435    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"
Jul 07 22:15:29.112895 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.112846    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-rz57s"]
Jul 07 22:15:29.131338 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.131224    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-rz57s"]
Jul 07 22:15:29.131678 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.131661    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-rz57s"
Jul 07 22:15:29.139307 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.139278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnsmt\" (UniqueName: \"kubernetes.io/projected/e65b517e-4bae-4366-b577-811c245a6c95-kube-api-access-jnsmt\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.139720 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.139695    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5ab65171-c0bf-480a-9c90-45493c0d1637-klusterlet-config\") pod \"klusterlet-addon-workmgr-f79bb9b9-fhzkl\" (UID: \"5ab65171-c0bf-480a-9c90-45493c0d1637\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"
Jul 07 22:15:29.139826 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.139744    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e65b517e-4bae-4366-b577-811c245a6c95-additional-service-ca\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.139826 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.139809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrz5g\" (UniqueName: \"kubernetes.io/projected/d8bee18c-a57b-4850-981b-b5f583f1b64e-kube-api-access-lrz5g\") pod \"managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l\" (UID: \"d8bee18c-a57b-4850-981b-b5f583f1b64e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l"
Jul 07 22:15:29.140154 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.139874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8bee18c-a57b-4850-981b-b5f583f1b64e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l\" (UID: \"d8bee18c-a57b-4850-981b-b5f583f1b64e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l"
Jul 07 22:15:29.140434 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.140411    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-v7n4z\""
Jul 07 22:15:29.140531 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.140417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e65b517e-4bae-4366-b577-811c245a6c95-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.140589 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.140512    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ab65171-c0bf-480a-9c90-45493c0d1637-tmp\") pod \"klusterlet-addon-workmgr-f79bb9b9-fhzkl\" (UID: \"5ab65171-c0bf-480a-9c90-45493c0d1637\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"
Jul 07 22:15:29.140647 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.140607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e65b517e-4bae-4366-b577-811c245a6c95-hub\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.140701 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.140648    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e65b517e-4bae-4366-b577-811c245a6c95-ca\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.140750 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.140720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e65b517e-4bae-4366-b577-811c245a6c95-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.141245 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.141220    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpt57\" (UniqueName: \"kubernetes.io/projected/5ab65171-c0bf-480a-9c90-45493c0d1637-kube-api-access-rpt57\") pod \"klusterlet-addon-workmgr-f79bb9b9-fhzkl\" (UID: \"5ab65171-c0bf-480a-9c90-45493c0d1637\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"
Jul 07 22:15:29.141806 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.141784    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 22:15:29.142052 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.142037    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 22:15:29.163496 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.163471    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rb8g2\""
Jul 07 22:15:29.171766 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.171690    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:29.193421 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.193237    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:15:29.242602 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.242559    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnsmt\" (UniqueName: \"kubernetes.io/projected/e65b517e-4bae-4366-b577-811c245a6c95-kube-api-access-jnsmt\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.242799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.242612    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5ab65171-c0bf-480a-9c90-45493c0d1637-klusterlet-config\") pod \"klusterlet-addon-workmgr-f79bb9b9-fhzkl\" (UID: \"5ab65171-c0bf-480a-9c90-45493c0d1637\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"
Jul 07 22:15:29.242799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.242640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e65b517e-4bae-4366-b577-811c245a6c95-additional-service-ca\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.242799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.242673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh6q6\" (UniqueName: \"kubernetes.io/projected/f05a84bd-4955-4220-a74f-ffb343e48d0c-kube-api-access-dh6q6\") pod \"downloads-685bfb5f64-rz57s\" (UID: \"f05a84bd-4955-4220-a74f-ffb343e48d0c\") " pod="openshift-console/downloads-685bfb5f64-rz57s"
Jul 07 22:15:29.242799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.242708    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrz5g\" (UniqueName: \"kubernetes.io/projected/d8bee18c-a57b-4850-981b-b5f583f1b64e-kube-api-access-lrz5g\") pod \"managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l\" (UID: \"d8bee18c-a57b-4850-981b-b5f583f1b64e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l"
Jul 07 22:15:29.242799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.242728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8bee18c-a57b-4850-981b-b5f583f1b64e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l\" (UID: \"d8bee18c-a57b-4850-981b-b5f583f1b64e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l"
Jul 07 22:15:29.242799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.242747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e65b517e-4bae-4366-b577-811c245a6c95-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.242799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.242769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ab65171-c0bf-480a-9c90-45493c0d1637-tmp\") pod \"klusterlet-addon-workmgr-f79bb9b9-fhzkl\" (UID: \"5ab65171-c0bf-480a-9c90-45493c0d1637\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"
Jul 07 22:15:29.242799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.242794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e65b517e-4bae-4366-b577-811c245a6c95-hub\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.243224 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.242821    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e65b517e-4bae-4366-b577-811c245a6c95-ca\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.243224 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.242847    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e65b517e-4bae-4366-b577-811c245a6c95-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.243224 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.242871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpt57\" (UniqueName: \"kubernetes.io/projected/5ab65171-c0bf-480a-9c90-45493c0d1637-kube-api-access-rpt57\") pod \"klusterlet-addon-workmgr-f79bb9b9-fhzkl\" (UID: \"5ab65171-c0bf-480a-9c90-45493c0d1637\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"
Jul 07 22:15:29.244036 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.243498    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e65b517e-4bae-4366-b577-811c245a6c95-additional-service-ca\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.246072 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.245592    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ab65171-c0bf-480a-9c90-45493c0d1637-tmp\") pod \"klusterlet-addon-workmgr-f79bb9b9-fhzkl\" (UID: \"5ab65171-c0bf-480a-9c90-45493c0d1637\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"
Jul 07 22:15:29.246631 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.246602    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e65b517e-4bae-4366-b577-811c245a6c95-ca\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.248180 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.246694    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e65b517e-4bae-4366-b577-811c245a6c95-hub\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.248180 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.246894    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e65b517e-4bae-4366-b577-811c245a6c95-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.248180 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.246996    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5ab65171-c0bf-480a-9c90-45493c0d1637-klusterlet-config\") pod \"klusterlet-addon-workmgr-f79bb9b9-fhzkl\" (UID: \"5ab65171-c0bf-480a-9c90-45493c0d1637\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"
Jul 07 22:15:29.248180 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.247965    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d8bee18c-a57b-4850-981b-b5f583f1b64e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l\" (UID: \"d8bee18c-a57b-4850-981b-b5f583f1b64e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l"
Jul 07 22:15:29.248180 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.248062    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e65b517e-4bae-4366-b577-811c245a6c95-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.252742 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.252710    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnsmt\" (UniqueName: \"kubernetes.io/projected/e65b517e-4bae-4366-b577-811c245a6c95-kube-api-access-jnsmt\") pod \"cluster-proxy-proxy-agent-658dcc7cf8-jdvnr\" (UID: \"e65b517e-4bae-4366-b577-811c245a6c95\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.254309 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.254259    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrz5g\" (UniqueName: \"kubernetes.io/projected/d8bee18c-a57b-4850-981b-b5f583f1b64e-kube-api-access-lrz5g\") pod \"managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l\" (UID: \"d8bee18c-a57b-4850-981b-b5f583f1b64e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l"
Jul 07 22:15:29.255359 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.255318    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpt57\" (UniqueName: \"kubernetes.io/projected/5ab65171-c0bf-480a-9c90-45493c0d1637-kube-api-access-rpt57\") pod \"klusterlet-addon-workmgr-f79bb9b9-fhzkl\" (UID: \"5ab65171-c0bf-480a-9c90-45493c0d1637\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"
Jul 07 22:15:29.276102 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.276067    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dxzxn\""
Jul 07 22:15:29.284042 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.284009    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:15:29.343800 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.343761    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh6q6\" (UniqueName: \"kubernetes.io/projected/f05a84bd-4955-4220-a74f-ffb343e48d0c-kube-api-access-dh6q6\") pod \"downloads-685bfb5f64-rz57s\" (UID: \"f05a84bd-4955-4220-a74f-ffb343e48d0c\") " pod="openshift-console/downloads-685bfb5f64-rz57s"
Jul 07 22:15:29.355991 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.355961    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh6q6\" (UniqueName: \"kubernetes.io/projected/f05a84bd-4955-4220-a74f-ffb343e48d0c-kube-api-access-dh6q6\") pod \"downloads-685bfb5f64-rz57s\" (UID: \"f05a84bd-4955-4220-a74f-ffb343e48d0c\") " pod="openshift-console/downloads-685bfb5f64-rz57s"
Jul 07 22:15:29.370691 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.370659    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"
Jul 07 22:15:29.387840 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.387806    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l"
Jul 07 22:15:29.402491 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.402465    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"
Jul 07 22:15:29.458361 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:29.458278    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-rz57s"
Jul 07 22:15:30.244065 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.243987    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8bg8x"]
Jul 07 22:15:30.246590 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.246488    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h"]
Jul 07 22:15:30.248048 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.248023    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74b8948f45-trjld"]
Jul 07 22:15:30.250128 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.250106    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f5859bf4c-vbt9h"]
Jul 07 22:15:30.251875 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.251451    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f6fd7cb44-l78cx"]
Jul 07 22:15:30.299301 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.299273    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l"]
Jul 07 22:15:30.302078 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.302048    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"]
Jul 07 22:15:30.303332 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.303294    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-rz57s"]
Jul 07 22:15:30.305341 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:15:30.305318    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8bee18c_a57b_4850_981b_b5f583f1b64e.slice/crio-51efdf2071214c93b8f5855c7ea7ec65386e62f97133719379b23fdf2ee4d508 WatchSource:0}: Error finding container 51efdf2071214c93b8f5855c7ea7ec65386e62f97133719379b23fdf2ee4d508: Status 404 returned error can't find the container with id 51efdf2071214c93b8f5855c7ea7ec65386e62f97133719379b23fdf2ee4d508
Jul 07 22:15:30.305575 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.305507    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr"]
Jul 07 22:15:30.308087 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:15:30.308047    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf05a84bd_4955_4220_a74f_ffb343e48d0c.slice/crio-f58ef9e3cb404d5d4f824ea3d39dc1ae08a70e0118dd8575a6109280768bd8d3 WatchSource:0}: Error finding container f58ef9e3cb404d5d4f824ea3d39dc1ae08a70e0118dd8575a6109280768bd8d3: Status 404 returned error can't find the container with id f58ef9e3cb404d5d4f824ea3d39dc1ae08a70e0118dd8575a6109280768bd8d3
Jul 07 22:15:30.310050 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:15:30.309948    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab65171_c0bf_480a_9c90_45493c0d1637.slice/crio-72f9e08fd87ec07766c63e4e8466eee360410518eb4ccb71c7b1a91c9be9674c WatchSource:0}: Error finding container 72f9e08fd87ec07766c63e4e8466eee360410518eb4ccb71c7b1a91c9be9674c: Status 404 returned error can't find the container with id 72f9e08fd87ec07766c63e4e8466eee360410518eb4ccb71c7b1a91c9be9674c
Jul 07 22:15:30.310532 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:15:30.310503    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode65b517e_4bae_4366_b577_811c245a6c95.slice/crio-f76be263e4da48019a75a5051429aa94fbb424c1a825ebc85ee4af567d3aa11a WatchSource:0}: Error finding container f76be263e4da48019a75a5051429aa94fbb424c1a825ebc85ee4af567d3aa11a: Status 404 returned error can't find the container with id f76be263e4da48019a75a5051429aa94fbb424c1a825ebc85ee4af567d3aa11a
Jul 07 22:15:30.668285 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.667652    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5b9f6\" (UID: \"19eac3ab-96ae-45bd-a521-26becaa7f563\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:15:30.671527 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.671459    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19eac3ab-96ae-45bd-a521-26becaa7f563-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5b9f6\" (UID: \"19eac3ab-96ae-45bd-a521-26becaa7f563\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:15:30.713860 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.713811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m7pwq" event={"ID":"49442a39-eb53-419a-a05d-209c81bba22e","Type":"ContainerStarted","Data":"d45885574312b06316764c5b01b292742c6dced4c2a00cfa60aa7108af84611f"}
Jul 07 22:15:30.714038 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.713882    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-m7pwq" event={"ID":"49442a39-eb53-419a-a05d-209c81bba22e","Type":"ContainerStarted","Data":"edef563b3a5940270e0475a42d09123be622e0b08cfe6e54a9fab053c3c18e26"}
Jul 07 22:15:30.716531 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.716491    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzlpx" event={"ID":"3775aa4f-886b-4e99-a63f-ff6930e1f560","Type":"ContainerStarted","Data":"99ccb0b47e18f9275779f21b4f4c8d8e1ad0a6f8b932c235788dde52412e64fe"}
Jul 07 22:15:30.718680 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.718623    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-rz57s" event={"ID":"f05a84bd-4955-4220-a74f-ffb343e48d0c","Type":"ContainerStarted","Data":"f58ef9e3cb404d5d4f824ea3d39dc1ae08a70e0118dd8575a6109280768bd8d3"}
Jul 07 22:15:30.721024 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.720997    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74b8948f45-trjld" event={"ID":"b578bb6c-1572-4342-be6c-d10f04301077","Type":"ContainerStarted","Data":"935850b84c1e6501c6e6e1244ebc8571816e11226e5c92a91be52e1449bfe702"}
Jul 07 22:15:30.721132 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.721045    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74b8948f45-trjld" event={"ID":"b578bb6c-1572-4342-be6c-d10f04301077","Type":"ContainerStarted","Data":"027a05aa81076d0a4cfa8c2485b15c4d7a40cb884c012236b50f559efd300d12"}
Jul 07 22:15:30.722710 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.722642    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8bg8x" event={"ID":"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066","Type":"ContainerStarted","Data":"eebafdae0b3b577bc9cfbb7beab14cac75ec9bed1ee9d09b0046b379fb0c56a3"}
Jul 07 22:15:30.724257 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.724213    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h" event={"ID":"042e7349-698d-48f3-8af4-4fb44cb9352c","Type":"ContainerStarted","Data":"70dc7b42af9e837945d52f01f06dad64627bbe64d75272c8bc589ac07f047207"}
Jul 07 22:15:30.725800 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.725762    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l" event={"ID":"d8bee18c-a57b-4850-981b-b5f583f1b64e","Type":"ContainerStarted","Data":"51efdf2071214c93b8f5855c7ea7ec65386e62f97133719379b23fdf2ee4d508"}
Jul 07 22:15:30.727398 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.727344    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr" event={"ID":"e65b517e-4bae-4366-b577-811c245a6c95","Type":"ContainerStarted","Data":"f76be263e4da48019a75a5051429aa94fbb424c1a825ebc85ee4af567d3aa11a"}
Jul 07 22:15:30.729517 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.729492    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h" event={"ID":"36015c76-eb45-4c10-b770-e2cba948b439","Type":"ContainerStarted","Data":"73cac77b422a2af00494349af53f3de17b1d71785957e3b7d4145827841aa666"}
Jul 07 22:15:30.729613 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.729537    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h" event={"ID":"36015c76-eb45-4c10-b770-e2cba948b439","Type":"ContainerStarted","Data":"48761ea1de291ac9578c108a857a2e6702d84e3bceef4496d4d6aae89da91fa5"}
Jul 07 22:15:30.730124 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.730105    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:15:30.730833 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.730742    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-m7pwq" podStartSLOduration=66.718043893 podStartE2EDuration="1m8.730725594s" totalImagesPullingTime="2.012681701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:30.72847569 +0000 UTC m=+70.044613116" watchObservedRunningTime="2026-07-07 22:15:30.730725594 +0000 UTC m=+70.046863020"
Jul 07 22:15:30.733367 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.733218    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx" event={"ID":"80c9ea8c-875d-42d5-bfe6-6664d34c799c","Type":"ContainerStarted","Data":"122163b94eeb1c09cb58f63178aa185a9d8d69b845612f99f11a85c73e217a04"}
Jul 07 22:15:30.733367 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.733262    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx" event={"ID":"80c9ea8c-875d-42d5-bfe6-6664d34c799c","Type":"ContainerStarted","Data":"061dc1c958a9c4550614652cc94181c5c77c9fa153be1673c45246a128177cc4"}
Jul 07 22:15:30.733537 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.733429    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:15:30.735796 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.735771    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl" event={"ID":"5ab65171-c0bf-480a-9c90-45493c0d1637","Type":"ContainerStarted","Data":"72f9e08fd87ec07766c63e4e8466eee360410518eb4ccb71c7b1a91c9be9674c"}
Jul 07 22:15:30.751118 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.751060    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-74b8948f45-trjld" podStartSLOduration=65.751039165 podStartE2EDuration="1m5.751039165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:30.748374958 +0000 UTC m=+70.064512377" watchObservedRunningTime="2026-07-07 22:15:30.751039165 +0000 UTC m=+70.067176591"
Jul 07 22:15:30.769740 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.769539    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h" podStartSLOduration=67.769515915 podStartE2EDuration="1m7.769515915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:30.76796101 +0000 UTC m=+70.084098430" watchObservedRunningTime="2026-07-07 22:15:30.769515915 +0000 UTC m=+70.085653336"
Jul 07 22:15:30.770790 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.770765    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jmfqn\""
Jul 07 22:15:30.777750 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.777722    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"
Jul 07 22:15:30.788218 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.788060    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx" podStartSLOduration=55.788045139 podStartE2EDuration="55.788045139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:30.787008822 +0000 UTC m=+70.103146249" watchObservedRunningTime="2026-07-07 22:15:30.788045139 +0000 UTC m=+70.104182564"
Jul 07 22:15:30.963521 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:30.963489    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6"]
Jul 07 22:15:30.966917 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:15:30.966883    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19eac3ab_96ae_45bd_a521_26becaa7f563.slice/crio-f40e40b0a2542485135369f78c57a9e706a3ce8903305889028b45c3444d889c WatchSource:0}: Error finding container f40e40b0a2542485135369f78c57a9e706a3ce8903305889028b45c3444d889c: Status 404 returned error can't find the container with id f40e40b0a2542485135369f78c57a9e706a3ce8903305889028b45c3444d889c
Jul 07 22:15:31.172886 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:31.172848    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:31.176391 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:31.176330    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:31.767658 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:31.767622    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6" event={"ID":"19eac3ab-96ae-45bd-a521-26becaa7f563","Type":"ContainerStarted","Data":"f40e40b0a2542485135369f78c57a9e706a3ce8903305889028b45c3444d889c"}
Jul 07 22:15:31.769300 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:31.769257    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:31.772144 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:31.772123    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-74b8948f45-trjld"
Jul 07 22:15:35.738931 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.738893    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67566f656b-c2r29"]
Jul 07 22:15:35.756352 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.756318    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67566f656b-c2r29"]
Jul 07 22:15:35.756527 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.756443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.759308 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.759278    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 22:15:35.759455 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.759278    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 22:15:35.759455 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.759333    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z4kb7\""
Jul 07 22:15:35.760263 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.760244    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 22:15:35.760263 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.760251    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 22:15:35.760442 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.760286    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 22:15:35.826549 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.826513    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-serving-cert\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.826729 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.826565    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-oauth-serving-cert\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.826729 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.826625    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-service-ca\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.826729 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.826705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-config\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.826900 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.826780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-oauth-config\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.826900 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.826833    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9kh9\" (UniqueName: \"kubernetes.io/projected/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-kube-api-access-b9kh9\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.927797 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.927751    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-serving-cert\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.927797 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.927795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-oauth-serving-cert\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.928006 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.927826    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-service-ca\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.928006 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.927860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-config\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.928006 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.927892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-oauth-config\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.928006 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.927927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9kh9\" (UniqueName: \"kubernetes.io/projected/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-kube-api-access-b9kh9\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.928545 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.928519    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-service-ca\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.928667 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.928549    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-oauth-serving-cert\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.928722 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.928666    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-config\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.930384 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.930352    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-serving-cert\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.930492 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.930421    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-oauth-config\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:35.935987 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:35.935956    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9kh9\" (UniqueName: \"kubernetes.io/projected/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-kube-api-access-b9kh9\") pod \"console-67566f656b-c2r29\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") " pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:36.069930 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:36.069855    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:43.347867 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.340925    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67566f656b-c2r29"]
Jul 07 22:15:43.847438 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.847389    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l" event={"ID":"d8bee18c-a57b-4850-981b-b5f583f1b64e","Type":"ContainerStarted","Data":"b147ff651bfcc352343aa9a95d9420701a50bd21ca1647bfe5efa30d8416b345"}
Jul 07 22:15:43.850913 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.850876    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr" event={"ID":"e65b517e-4bae-4366-b577-811c245a6c95","Type":"ContainerStarted","Data":"eea4d839f8a073277114fe1d735704f7f1c2cd9488bd722968b3c4e6dd5a9f3a"}
Jul 07 22:15:43.851087 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.850928    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr" event={"ID":"e65b517e-4bae-4366-b577-811c245a6c95","Type":"ContainerStarted","Data":"d7c6ef1b8224ec6596ddd2bc2277aa323aa150b4744d9e244bd8267001568fcf"}
Jul 07 22:15:43.851087 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.850949    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr" event={"ID":"e65b517e-4bae-4366-b577-811c245a6c95","Type":"ContainerStarted","Data":"7123b936215710af61d87d43e0ba75956705ddb1fce7c1ec34b26416ee41559f"}
Jul 07 22:15:43.852782 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.852695    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7rp6t" event={"ID":"a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c","Type":"ContainerStarted","Data":"9f0cc0d0acd3f072d8f41a6194aa0bf34bf05775fa145aa6fb17c2a7673cc768"}
Jul 07 22:15:43.854079 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.854053    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67566f656b-c2r29" event={"ID":"99172b68-ddf0-42c9-a7a1-5c764eccaf9d","Type":"ContainerStarted","Data":"53b8d587419f13a3a17a6f3a47d2bf46c17c0c33dfd4a99675ded5f771e8da59"}
Jul 07 22:15:43.855850 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.855825    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl" event={"ID":"5ab65171-c0bf-480a-9c90-45493c0d1637","Type":"ContainerStarted","Data":"d4ac091f53ae7649b3d21a165a525eccc67f4d1f60fe4b58df75ea7dfe5c6b61"}
Jul 07 22:15:43.856045 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.855996    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"
Jul 07 22:15:43.857597 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.857579    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl"
Jul 07 22:15:43.857806 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.857783    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6" event={"ID":"19eac3ab-96ae-45bd-a521-26becaa7f563","Type":"ContainerStarted","Data":"35e5ea5bc8eea0e0fefeea8d1a1ead9d17ccdbf1a200a19039f6d9a8aaa67e97"}
Jul 07 22:15:43.860890 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.860868    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzlpx" event={"ID":"3775aa4f-886b-4e99-a63f-ff6930e1f560","Type":"ContainerStarted","Data":"d3a17947f8aafa0cb62f24e0fba826c4c96414ad47caa42818f2aff296704d42"}
Jul 07 22:15:43.864071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.863988    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8bg8x" event={"ID":"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066","Type":"ContainerStarted","Data":"e95c2b062211e55cd9187644cc5fef269da933252ec2d9cfa86e76fe8f08dcce"}
Jul 07 22:15:43.864071 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.864028    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8bg8x" event={"ID":"5ae33a4a-0bdb-4f0e-9a86-221c82e0e066","Type":"ContainerStarted","Data":"d8f9ebdb734a658a6991f8cad0f01895ae3de07694da2ca1c99d20457a73aaba"}
Jul 07 22:15:43.864326 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.864305    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:15:43.864835 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.864791    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-bdc98d6fb-8pb8l" podStartSLOduration=2.987733197 podStartE2EDuration="15.864776595s" totalImagesPullingTime="12.877043398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:43.862727005 +0000 UTC m=+83.178864432" watchObservedRunningTime="2026-07-07 22:15:43.864776595 +0000 UTC m=+83.180914003"
Jul 07 22:15:43.866115 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.866084    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h" event={"ID":"042e7349-698d-48f3-8af4-4fb44cb9352c","Type":"ContainerStarted","Data":"3d9a65dd3bd12db626aeb4f353178c8d579ec23db92e7e61f43e53aa38263ebb"}
Jul 07 22:15:43.877141 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.877094    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7rp6t" podStartSLOduration=65.758431317 podStartE2EDuration="1m20.877079904s" totalImagesPullingTime="15.118648587s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:43.876237035 +0000 UTC m=+83.192374461" watchObservedRunningTime="2026-07-07 22:15:43.877079904 +0000 UTC m=+83.193217329"
Jul 07 22:15:43.892870 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.892823    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mzlpx" podStartSLOduration=17.412065995 podStartE2EDuration="36.89280886s" totalImagesPullingTime="19.480742865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:43.891386281 +0000 UTC m=+83.207523745" watchObservedRunningTime="2026-07-07 22:15:43.89280886 +0000 UTC m=+83.208946263"
Jul 07 22:15:43.908158 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.908101    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658dcc7cf8-jdvnr" podStartSLOduration=3.037121941 podStartE2EDuration="15.908085281s" totalImagesPullingTime="12.87096334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:43.906726629 +0000 UTC m=+83.222864077" watchObservedRunningTime="2026-07-07 22:15:43.908085281 +0000 UTC m=+83.224222684"
Jul 07 22:15:43.922665 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.922602    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f79bb9b9-fhzkl" podStartSLOduration=3.044018733 podStartE2EDuration="15.922579177s" totalImagesPullingTime="12.878560444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:43.921059121 +0000 UTC m=+83.237196548" watchObservedRunningTime="2026-07-07 22:15:43.922579177 +0000 UTC m=+83.238716604"
Jul 07 22:15:43.936351 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.936289    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5b9f6" podStartSLOduration=33.714985848 podStartE2EDuration="45.93626917s" totalImagesPullingTime="12.221283322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:43.93489973 +0000 UTC m=+83.251037156" watchObservedRunningTime="2026-07-07 22:15:43.93626917 +0000 UTC m=+83.252406595"
Jul 07 22:15:43.959108 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:43.959036    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-4mk9h" podStartSLOduration=66.384559433 podStartE2EDuration="1m18.9590145s" totalImagesPullingTime="12.574455067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:43.958330167 +0000 UTC m=+83.274467593" watchObservedRunningTime="2026-07-07 22:15:43.9590145 +0000 UTC m=+83.275151929"
Jul 07 22:15:49.198394 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:49.198352    2561 patch_prober.go:28] interesting pod/image-registry-7f5859bf4c-vbt9h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 22:15:49.198905 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:49.198415    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h" podUID="36015c76-eb45-4c10-b770-e2cba948b439" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 22:15:50.739908 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:50.739873    2561 patch_prober.go:28] interesting pod/image-registry-f6fd7cb44-l78cx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 22:15:50.740386 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:50.739934    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx" podUID="80c9ea8c-875d-42d5-bfe6-6664d34c799c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 22:15:52.793934 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:52.793896    2561 patch_prober.go:28] interesting pod/image-registry-7f5859bf4c-vbt9h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 22:15:52.794427 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:52.793950    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h" podUID="36015c76-eb45-4c10-b770-e2cba948b439" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 22:15:53.877426 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:53.877385    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8bg8x"
Jul 07 22:15:53.896021 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:53.895959    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8bg8x" podStartSLOduration=44.967564871 podStartE2EDuration="57.895936461s" totalImagesPullingTime="12.92837159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:43.97639213 +0000 UTC m=+83.292529592" watchObservedRunningTime="2026-07-07 22:15:53.895936461 +0000 UTC m=+93.212073885"
Jul 07 22:15:53.920653 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:53.920618    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-rz57s" event={"ID":"f05a84bd-4955-4220-a74f-ffb343e48d0c","Type":"ContainerStarted","Data":"2fee06e88b754f8c77617ed7eaf1a995e9b6121ccc3eb083d3c1cf3fba3bc749"}
Jul 07 22:15:53.921028 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:53.921001    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-rz57s"
Jul 07 22:15:53.923610 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:53.923584    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67566f656b-c2r29" event={"ID":"99172b68-ddf0-42c9-a7a1-5c764eccaf9d","Type":"ContainerStarted","Data":"33f5a5890494799c88b9a71777d0d6b673b9c686c83d694dabc2849265aeb743"}
Jul 07 22:15:53.937436 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:53.937356    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-rz57s" podStartSLOduration=2.218854178 podStartE2EDuration="24.937333672s" totalImagesPullingTime="22.718479494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:53.936414473 +0000 UTC m=+93.252551925" watchObservedRunningTime="2026-07-07 22:15:53.937333672 +0000 UTC m=+93.253471099"
Jul 07 22:15:53.937908 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:53.937883    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-rz57s"
Jul 07 22:15:53.953112 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:53.953049    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67566f656b-c2r29" podStartSLOduration=9.297031301 podStartE2EDuration="18.953024587s" totalImagesPullingTime="9.655993286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:15:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:15:53.951873767 +0000 UTC m=+93.268011193" watchObservedRunningTime="2026-07-07 22:15:53.953024587 +0000 UTC m=+93.269162013"
Jul 07 22:15:55.766874 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:55.766827    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx" podUID="80c9ea8c-875d-42d5-bfe6-6664d34c799c" containerName="registry" containerID="cri-o://122163b94eeb1c09cb58f63178aa185a9d8d69b845612f99f11a85c73e217a04" gracePeriod=30
Jul 07 22:15:55.936065 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:55.936022    2561 generic.go:356] "Generic (PLEG): container finished" podID="80c9ea8c-875d-42d5-bfe6-6664d34c799c" containerID="122163b94eeb1c09cb58f63178aa185a9d8d69b845612f99f11a85c73e217a04" exitCode=0
Jul 07 22:15:55.936732 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:55.936703    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx" event={"ID":"80c9ea8c-875d-42d5-bfe6-6664d34c799c","Type":"ContainerDied","Data":"122163b94eeb1c09cb58f63178aa185a9d8d69b845612f99f11a85c73e217a04"}
Jul 07 22:15:56.062035 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.062002    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:15:56.070751 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.070721    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:56.070888 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.070786    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:15:56.072294 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.072265    2561 patch_prober.go:28] interesting pod/console-67566f656b-c2r29 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.27:8443/health\": dial tcp 10.132.0.27:8443: connect: connection refused" start-of-body=
Jul 07 22:15:56.072414 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.072308    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-67566f656b-c2r29" podUID="99172b68-ddf0-42c9-a7a1-5c764eccaf9d" containerName="console" probeResult="failure" output="Get \"https://10.132.0.27:8443/health\": dial tcp 10.132.0.27:8443: connect: connection refused"
Jul 07 22:15:56.228057 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.228019    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80c9ea8c-875d-42d5-bfe6-6664d34c799c-image-registry-private-configuration\") pod \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") "
Jul 07 22:15:56.228270 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.228091    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80c9ea8c-875d-42d5-bfe6-6664d34c799c-ca-trust-extracted\") pod \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") "
Jul 07 22:15:56.228270 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.228122    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-bound-sa-token\") pod \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") "
Jul 07 22:15:56.228270 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.228180    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80c9ea8c-875d-42d5-bfe6-6664d34c799c-trusted-ca\") pod \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") "
Jul 07 22:15:56.228270 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.228225    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbmlv\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-kube-api-access-bbmlv\") pod \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") "
Jul 07 22:15:56.228270 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.228260    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80c9ea8c-875d-42d5-bfe6-6664d34c799c-installation-pull-secrets\") pod \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") "
Jul 07 22:15:56.228535 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.228306    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls\") pod \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") "
Jul 07 22:15:56.228535 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.228347    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-certificates\") pod \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\" (UID: \"80c9ea8c-875d-42d5-bfe6-6664d34c799c\") "
Jul 07 22:15:56.229373 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.228682    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c9ea8c-875d-42d5-bfe6-6664d34c799c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "80c9ea8c-875d-42d5-bfe6-6664d34c799c" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:15:56.229373 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.229335    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "80c9ea8c-875d-42d5-bfe6-6664d34c799c" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:15:56.232461 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.232327    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c9ea8c-875d-42d5-bfe6-6664d34c799c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "80c9ea8c-875d-42d5-bfe6-6664d34c799c" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:15:56.232461 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.232351    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "80c9ea8c-875d-42d5-bfe6-6664d34c799c" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:15:56.232650 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.232513    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80c9ea8c-875d-42d5-bfe6-6664d34c799c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "80c9ea8c-875d-42d5-bfe6-6664d34c799c" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:15:56.232881 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.232840    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-kube-api-access-bbmlv" (OuterVolumeSpecName: "kube-api-access-bbmlv") pod "80c9ea8c-875d-42d5-bfe6-6664d34c799c" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c"). InnerVolumeSpecName "kube-api-access-bbmlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:15:56.233722 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.233694    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "80c9ea8c-875d-42d5-bfe6-6664d34c799c" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:15:56.241276 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.241249    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80c9ea8c-875d-42d5-bfe6-6664d34c799c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "80c9ea8c-875d-42d5-bfe6-6664d34c799c" (UID: "80c9ea8c-875d-42d5-bfe6-6664d34c799c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:15:56.329364 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.329326    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/80c9ea8c-875d-42d5-bfe6-6664d34c799c-installation-pull-secrets\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:15:56.329364 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.329360    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-tls\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:15:56.329364 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.329369    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/80c9ea8c-875d-42d5-bfe6-6664d34c799c-registry-certificates\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:15:56.329364 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.329378    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/80c9ea8c-875d-42d5-bfe6-6664d34c799c-image-registry-private-configuration\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:15:56.329647 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.329387    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/80c9ea8c-875d-42d5-bfe6-6664d34c799c-ca-trust-extracted\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:15:56.329647 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.329396    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-bound-sa-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:15:56.329647 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.329404    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/80c9ea8c-875d-42d5-bfe6-6664d34c799c-trusted-ca\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:15:56.329647 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.329411    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbmlv\" (UniqueName: \"kubernetes.io/projected/80c9ea8c-875d-42d5-bfe6-6664d34c799c-kube-api-access-bbmlv\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:15:56.942683 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.942633    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx" event={"ID":"80c9ea8c-875d-42d5-bfe6-6664d34c799c","Type":"ContainerDied","Data":"061dc1c958a9c4550614652cc94181c5c77c9fa153be1673c45246a128177cc4"}
Jul 07 22:15:56.943146 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.942703    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6fd7cb44-l78cx"
Jul 07 22:15:56.943146 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.942735    2561 scope.go:117] "RemoveContainer" containerID="122163b94eeb1c09cb58f63178aa185a9d8d69b845612f99f11a85c73e217a04"
Jul 07 22:15:56.962179 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.962147    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f6fd7cb44-l78cx"]
Jul 07 22:15:56.965577 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:56.965545    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f6fd7cb44-l78cx"]
Jul 07 22:15:58.260575 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.260541    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-whldw"]
Jul 07 22:15:58.261632 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.261613    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80c9ea8c-875d-42d5-bfe6-6664d34c799c" containerName="registry"
Jul 07 22:15:58.261767 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.261757    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="80c9ea8c-875d-42d5-bfe6-6664d34c799c" containerName="registry"
Jul 07 22:15:58.261942 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.261931    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="80c9ea8c-875d-42d5-bfe6-6664d34c799c" containerName="registry"
Jul 07 22:15:58.292630 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.292596    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.298794 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.298407    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 22:15:58.298794 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.298629    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 22:15:58.298794 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.298670    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 22:15:58.301414 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.301385    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 22:15:58.301414 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.301416    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w7tnb\""
Jul 07 22:15:58.306049 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.306014    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80c9ea8c-875d-42d5-bfe6-6664d34c799c" path="/var/lib/kubelet/pods/80c9ea8c-875d-42d5-bfe6-6664d34c799c/volumes"
Jul 07 22:15:58.448473 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.448433    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f5089c0-1ac1-4843-b358-7741aed113c0-sys\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.448473 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.448476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.448720 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.448505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.448720 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.448535    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbjvm\" (UniqueName: \"kubernetes.io/projected/5f5089c0-1ac1-4843-b358-7741aed113c0-kube-api-access-dbjvm\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.449948 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.448909    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5f5089c0-1ac1-4843-b358-7741aed113c0-root\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.449948 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.448992    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-wtmp\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.449948 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.449037    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-textfile\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.449948 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.449095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f5089c0-1ac1-4843-b358-7741aed113c0-metrics-client-ca\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.449948 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.449154    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-tls\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.550255 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.550144    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-tls\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.550255 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.550208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f5089c0-1ac1-4843-b358-7741aed113c0-sys\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.550255 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.550240    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.550510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.550273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.550510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.550305    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbjvm\" (UniqueName: \"kubernetes.io/projected/5f5089c0-1ac1-4843-b358-7741aed113c0-kube-api-access-dbjvm\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.550510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.550336    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5f5089c0-1ac1-4843-b358-7741aed113c0-root\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.550510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.550395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-wtmp\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.550510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.550424    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-textfile\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.550510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.550484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f5089c0-1ac1-4843-b358-7741aed113c0-metrics-client-ca\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.550820 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.550795    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-wtmp\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.550993 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.550969    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f5089c0-1ac1-4843-b358-7741aed113c0-sys\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.551121 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.551014    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5f5089c0-1ac1-4843-b358-7741aed113c0-root\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.551244 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.551053    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f5089c0-1ac1-4843-b358-7741aed113c0-metrics-client-ca\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.551365 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.551343    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-textfile\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.551541 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.551520    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-accelerators-collector-config\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.553597 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.553574    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-tls\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.553941 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.553921    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f5089c0-1ac1-4843-b358-7741aed113c0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.559591 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.559568    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbjvm\" (UniqueName: \"kubernetes.io/projected/5f5089c0-1ac1-4843-b358-7741aed113c0-kube-api-access-dbjvm\") pod \"node-exporter-whldw\" (UID: \"5f5089c0-1ac1-4843-b358-7741aed113c0\") " pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.611580 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.611537    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-whldw"
Jul 07 22:15:58.642208 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:15:58.642153    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5089c0_1ac1_4843_b358_7741aed113c0.slice/crio-97d91cfee99ceb660fad1dfa46c221aa1e17571aa05de65f2941b652e0ce0bd2 WatchSource:0}: Error finding container 97d91cfee99ceb660fad1dfa46c221aa1e17571aa05de65f2941b652e0ce0bd2: Status 404 returned error can't find the container with id 97d91cfee99ceb660fad1dfa46c221aa1e17571aa05de65f2941b652e0ce0bd2
Jul 07 22:15:58.957256 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:58.957221    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-whldw" event={"ID":"5f5089c0-1ac1-4843-b358-7741aed113c0","Type":"ContainerStarted","Data":"97d91cfee99ceb660fad1dfa46c221aa1e17571aa05de65f2941b652e0ce0bd2"}
Jul 07 22:15:59.203217 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:59.202807    2561 patch_prober.go:28] interesting pod/image-registry-7f5859bf4c-vbt9h container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 22:15:59.203217 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:59.202876    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h" podUID="36015c76-eb45-4c10-b770-e2cba948b439" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 22:15:59.259292 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:59.258738    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f5859bf4c-vbt9h"]
Jul 07 22:15:59.266830 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:59.266481    2561 patch_prober.go:28] interesting pod/image-registry-7f5859bf4c-vbt9h container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 22:15:59.266830 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:59.266569    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h" podUID="36015c76-eb45-4c10-b770-e2cba948b439" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 22:15:59.339495 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:59.339445    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67566f656b-c2r29"]
Jul 07 22:15:59.708050 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:15:59.707942    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-92k2m"
Jul 07 22:16:00.976721 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:00.976677    2561 generic.go:356] "Generic (PLEG): container finished" podID="5f5089c0-1ac1-4843-b358-7741aed113c0" containerID="2f1ae71ef2efcccb7950c4e47a09f977613635e29d95ea44e10b10dec5106243" exitCode=0
Jul 07 22:16:00.977181 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:00.976762    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-whldw" event={"ID":"5f5089c0-1ac1-4843-b358-7741aed113c0","Type":"ContainerDied","Data":"2f1ae71ef2efcccb7950c4e47a09f977613635e29d95ea44e10b10dec5106243"}
Jul 07 22:16:01.984797 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:01.984756    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-whldw" event={"ID":"5f5089c0-1ac1-4843-b358-7741aed113c0","Type":"ContainerStarted","Data":"55cc53f8cb6e1afa35d7f543e6fdcb6adc952ad661ad74f906251d863379abf4"}
Jul 07 22:16:01.985242 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:01.984815    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-whldw" event={"ID":"5f5089c0-1ac1-4843-b358-7741aed113c0","Type":"ContainerStarted","Data":"107409cc7014c2b286bcd978109f6dbc294abd8c0952360dc6c1810bf8858864"}
Jul 07 22:16:02.006790 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:02.006731    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-whldw" podStartSLOduration=1.972771377 podStartE2EDuration="4.006710043s" totalImagesPullingTime="1.928671618s" totalInitContainerRuntime="105.267048ms" isStatefulPod=true podCreationTimestamp="2026-07-07 22:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:16:02.004319215 +0000 UTC m=+101.320456665" watchObservedRunningTime="2026-07-07 22:16:02.006710043 +0000 UTC m=+101.322847469"
Jul 07 22:16:09.264354 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:09.264313    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:16:22.071123 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:22.071085    2561 generic.go:356] "Generic (PLEG): container finished" podID="e7952286-be37-4657-a639-fd1d0e0fd54f" containerID="ea87f43c0cb57722fc9ca07b331489806eecc9551eabfbc1fbb928ad786054c4" exitCode=0
Jul 07 22:16:22.071584 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:22.071163    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xrff4" event={"ID":"e7952286-be37-4657-a639-fd1d0e0fd54f","Type":"ContainerDied","Data":"ea87f43c0cb57722fc9ca07b331489806eecc9551eabfbc1fbb928ad786054c4"}
Jul 07 22:16:22.071584 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:22.071546    2561 scope.go:117] "RemoveContainer" containerID="ea87f43c0cb57722fc9ca07b331489806eecc9551eabfbc1fbb928ad786054c4"
Jul 07 22:16:22.609647 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:22.609619    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b8948f45-trjld_b578bb6c-1572-4342-be6c-d10f04301077/router/0.log"
Jul 07 22:16:22.615182 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:22.615159    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4889x_711e34a9-0496-4aa9-a5be-b178510ec995/serve-healthcheck-canary/0.log"
Jul 07 22:16:23.076873 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:23.076836    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-xrff4" event={"ID":"e7952286-be37-4657-a639-fd1d0e0fd54f","Type":"ContainerStarted","Data":"15fb7fcd5e7ce5c62541d1247360b08de1afa89639a048fa10feb1e19264b287"}
Jul 07 22:16:24.291835 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.291789    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h" podUID="36015c76-eb45-4c10-b770-e2cba948b439" containerName="registry" containerID="cri-o://73cac77b422a2af00494349af53f3de17b1d71785957e3b7d4145827841aa666" gracePeriod=30
Jul 07 22:16:24.374869 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.374806    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-67566f656b-c2r29" podUID="99172b68-ddf0-42c9-a7a1-5c764eccaf9d" containerName="console" containerID="cri-o://33f5a5890494799c88b9a71777d0d6b673b9c686c83d694dabc2849265aeb743" gracePeriod=15
Jul 07 22:16:24.582832 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.582805    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:16:24.660472 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.660440    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:16:24.664859 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.664833    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36015c76-eb45-4c10-b770-e2cba948b439-ca-trust-extracted\") pod \"36015c76-eb45-4c10-b770-e2cba948b439\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") "
Jul 07 22:16:24.664977 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.664888    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36015c76-eb45-4c10-b770-e2cba948b439-image-registry-private-configuration\") pod \"36015c76-eb45-4c10-b770-e2cba948b439\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") "
Jul 07 22:16:24.664977 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.664925    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls\") pod \"36015c76-eb45-4c10-b770-e2cba948b439\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") "
Jul 07 22:16:24.664977 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.664954    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36015c76-eb45-4c10-b770-e2cba948b439-registry-certificates\") pod \"36015c76-eb45-4c10-b770-e2cba948b439\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") "
Jul 07 22:16:24.665113 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.665009    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36015c76-eb45-4c10-b770-e2cba948b439-trusted-ca\") pod \"36015c76-eb45-4c10-b770-e2cba948b439\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") "
Jul 07 22:16:24.665113 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.665036    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-bound-sa-token\") pod \"36015c76-eb45-4c10-b770-e2cba948b439\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") "
Jul 07 22:16:24.665113 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.665064    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36015c76-eb45-4c10-b770-e2cba948b439-installation-pull-secrets\") pod \"36015c76-eb45-4c10-b770-e2cba948b439\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") "
Jul 07 22:16:24.665113 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.665098    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpdf6\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-kube-api-access-rpdf6\") pod \"36015c76-eb45-4c10-b770-e2cba948b439\" (UID: \"36015c76-eb45-4c10-b770-e2cba948b439\") "
Jul 07 22:16:24.665758 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.665721    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36015c76-eb45-4c10-b770-e2cba948b439-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "36015c76-eb45-4c10-b770-e2cba948b439" (UID: "36015c76-eb45-4c10-b770-e2cba948b439"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:16:24.665856 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.665803    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36015c76-eb45-4c10-b770-e2cba948b439-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "36015c76-eb45-4c10-b770-e2cba948b439" (UID: "36015c76-eb45-4c10-b770-e2cba948b439"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:16:24.667658 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.667606    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "36015c76-eb45-4c10-b770-e2cba948b439" (UID: "36015c76-eb45-4c10-b770-e2cba948b439"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:16:24.667766 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.667725    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36015c76-eb45-4c10-b770-e2cba948b439-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "36015c76-eb45-4c10-b770-e2cba948b439" (UID: "36015c76-eb45-4c10-b770-e2cba948b439"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:16:24.667861 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.667838    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-kube-api-access-rpdf6" (OuterVolumeSpecName: "kube-api-access-rpdf6") pod "36015c76-eb45-4c10-b770-e2cba948b439" (UID: "36015c76-eb45-4c10-b770-e2cba948b439"). InnerVolumeSpecName "kube-api-access-rpdf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:16:24.668120 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.668097    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "36015c76-eb45-4c10-b770-e2cba948b439" (UID: "36015c76-eb45-4c10-b770-e2cba948b439"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:16:24.668178 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.668141    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36015c76-eb45-4c10-b770-e2cba948b439-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "36015c76-eb45-4c10-b770-e2cba948b439" (UID: "36015c76-eb45-4c10-b770-e2cba948b439"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:16:24.673308 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.673287    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36015c76-eb45-4c10-b770-e2cba948b439-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "36015c76-eb45-4c10-b770-e2cba948b439" (UID: "36015c76-eb45-4c10-b770-e2cba948b439"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:16:24.765823 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.765789    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-service-ca\") pod \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") "
Jul 07 22:16:24.765823 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.765830    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-serving-cert\") pod \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") "
Jul 07 22:16:24.766092 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.765867    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9kh9\" (UniqueName: \"kubernetes.io/projected/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-kube-api-access-b9kh9\") pod \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") "
Jul 07 22:16:24.766092 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.765899    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-config\") pod \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") "
Jul 07 22:16:24.766092 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.765933    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-oauth-serving-cert\") pod \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") "
Jul 07 22:16:24.766092 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.766005    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-oauth-config\") pod \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\" (UID: \"99172b68-ddf0-42c9-a7a1-5c764eccaf9d\") "
Jul 07 22:16:24.766398 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.766277    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-registry-tls\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:24.766398 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.766296    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36015c76-eb45-4c10-b770-e2cba948b439-registry-certificates\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:24.766398 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.766309    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36015c76-eb45-4c10-b770-e2cba948b439-trusted-ca\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:24.766398 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.766322    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-bound-sa-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:24.766398 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.766336    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36015c76-eb45-4c10-b770-e2cba948b439-installation-pull-secrets\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:24.766398 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.766348    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpdf6\" (UniqueName: \"kubernetes.io/projected/36015c76-eb45-4c10-b770-e2cba948b439-kube-api-access-rpdf6\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:24.766398 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.766362    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36015c76-eb45-4c10-b770-e2cba948b439-ca-trust-extracted\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:24.766398 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.766376    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36015c76-eb45-4c10-b770-e2cba948b439-image-registry-private-configuration\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:24.766398 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.766376    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-service-ca" (OuterVolumeSpecName: "service-ca") pod "99172b68-ddf0-42c9-a7a1-5c764eccaf9d" (UID: "99172b68-ddf0-42c9-a7a1-5c764eccaf9d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:16:24.766719 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.766394    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "99172b68-ddf0-42c9-a7a1-5c764eccaf9d" (UID: "99172b68-ddf0-42c9-a7a1-5c764eccaf9d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:16:24.766719 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.766393    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-config" (OuterVolumeSpecName: "console-config") pod "99172b68-ddf0-42c9-a7a1-5c764eccaf9d" (UID: "99172b68-ddf0-42c9-a7a1-5c764eccaf9d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:16:24.768439 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.768414    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "99172b68-ddf0-42c9-a7a1-5c764eccaf9d" (UID: "99172b68-ddf0-42c9-a7a1-5c764eccaf9d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:16:24.768439 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.768424    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-kube-api-access-b9kh9" (OuterVolumeSpecName: "kube-api-access-b9kh9") pod "99172b68-ddf0-42c9-a7a1-5c764eccaf9d" (UID: "99172b68-ddf0-42c9-a7a1-5c764eccaf9d"). InnerVolumeSpecName "kube-api-access-b9kh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:16:24.768540 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.768465    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "99172b68-ddf0-42c9-a7a1-5c764eccaf9d" (UID: "99172b68-ddf0-42c9-a7a1-5c764eccaf9d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:16:24.867562 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.867487    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-config\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:24.867562 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.867511    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-oauth-serving-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:24.867562 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.867521    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-oauth-config\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:24.867562 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.867530    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-service-ca\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:24.867562 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.867539    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-console-serving-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:24.867562 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:24.867548    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9kh9\" (UniqueName: \"kubernetes.io/projected/99172b68-ddf0-42c9-a7a1-5c764eccaf9d-kube-api-access-b9kh9\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:16:25.085778 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.085742    2561 generic.go:356] "Generic (PLEG): container finished" podID="36015c76-eb45-4c10-b770-e2cba948b439" containerID="73cac77b422a2af00494349af53f3de17b1d71785957e3b7d4145827841aa666" exitCode=0
Jul 07 22:16:25.085957 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.085789    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h"
Jul 07 22:16:25.085957 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.085829    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h" event={"ID":"36015c76-eb45-4c10-b770-e2cba948b439","Type":"ContainerDied","Data":"73cac77b422a2af00494349af53f3de17b1d71785957e3b7d4145827841aa666"}
Jul 07 22:16:25.085957 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.085890    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f5859bf4c-vbt9h" event={"ID":"36015c76-eb45-4c10-b770-e2cba948b439","Type":"ContainerDied","Data":"48761ea1de291ac9578c108a857a2e6702d84e3bceef4496d4d6aae89da91fa5"}
Jul 07 22:16:25.085957 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.085920    2561 scope.go:117] "RemoveContainer" containerID="73cac77b422a2af00494349af53f3de17b1d71785957e3b7d4145827841aa666"
Jul 07 22:16:25.087182 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.087162    2561 generic.go:356] "Generic (PLEG): container finished" podID="99172b68-ddf0-42c9-a7a1-5c764eccaf9d" containerID="33f5a5890494799c88b9a71777d0d6b673b9c686c83d694dabc2849265aeb743" exitCode=0
Jul 07 22:16:25.087283 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.087236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67566f656b-c2r29" event={"ID":"99172b68-ddf0-42c9-a7a1-5c764eccaf9d","Type":"ContainerDied","Data":"33f5a5890494799c88b9a71777d0d6b673b9c686c83d694dabc2849265aeb743"}
Jul 07 22:16:25.087325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.087297    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67566f656b-c2r29" event={"ID":"99172b68-ddf0-42c9-a7a1-5c764eccaf9d","Type":"ContainerDied","Data":"53b8d587419f13a3a17a6f3a47d2bf46c17c0c33dfd4a99675ded5f771e8da59"}
Jul 07 22:16:25.087325 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.087243    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67566f656b-c2r29"
Jul 07 22:16:25.095657 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.095641    2561 scope.go:117] "RemoveContainer" containerID="73cac77b422a2af00494349af53f3de17b1d71785957e3b7d4145827841aa666"
Jul 07 22:16:25.095931 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:16:25.095909    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73cac77b422a2af00494349af53f3de17b1d71785957e3b7d4145827841aa666\": container with ID starting with 73cac77b422a2af00494349af53f3de17b1d71785957e3b7d4145827841aa666 not found: ID does not exist" containerID="73cac77b422a2af00494349af53f3de17b1d71785957e3b7d4145827841aa666"
Jul 07 22:16:25.096019 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.095936    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73cac77b422a2af00494349af53f3de17b1d71785957e3b7d4145827841aa666"} err="failed to get container status \"73cac77b422a2af00494349af53f3de17b1d71785957e3b7d4145827841aa666\": rpc error: code = NotFound desc = could not find container \"73cac77b422a2af00494349af53f3de17b1d71785957e3b7d4145827841aa666\": container with ID starting with 73cac77b422a2af00494349af53f3de17b1d71785957e3b7d4145827841aa666 not found: ID does not exist"
Jul 07 22:16:25.096019 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.095987    2561 scope.go:117] "RemoveContainer" containerID="33f5a5890494799c88b9a71777d0d6b673b9c686c83d694dabc2849265aeb743"
Jul 07 22:16:25.103595 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.103571    2561 scope.go:117] "RemoveContainer" containerID="33f5a5890494799c88b9a71777d0d6b673b9c686c83d694dabc2849265aeb743"
Jul 07 22:16:25.103861 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:16:25.103844    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33f5a5890494799c88b9a71777d0d6b673b9c686c83d694dabc2849265aeb743\": container with ID starting with 33f5a5890494799c88b9a71777d0d6b673b9c686c83d694dabc2849265aeb743 not found: ID does not exist" containerID="33f5a5890494799c88b9a71777d0d6b673b9c686c83d694dabc2849265aeb743"
Jul 07 22:16:25.103920 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.103867    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f5a5890494799c88b9a71777d0d6b673b9c686c83d694dabc2849265aeb743"} err="failed to get container status \"33f5a5890494799c88b9a71777d0d6b673b9c686c83d694dabc2849265aeb743\": rpc error: code = NotFound desc = could not find container \"33f5a5890494799c88b9a71777d0d6b673b9c686c83d694dabc2849265aeb743\": container with ID starting with 33f5a5890494799c88b9a71777d0d6b673b9c686c83d694dabc2849265aeb743 not found: ID does not exist"
Jul 07 22:16:25.107779 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.107758    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f5859bf4c-vbt9h"]
Jul 07 22:16:25.111184 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.111163    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f5859bf4c-vbt9h"]
Jul 07 22:16:25.122322 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.122268    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67566f656b-c2r29"]
Jul 07 22:16:25.126925 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:25.126904    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67566f656b-c2r29"]
Jul 07 22:16:26.292409 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:26.292380    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36015c76-eb45-4c10-b770-e2cba948b439" path="/var/lib/kubelet/pods/36015c76-eb45-4c10-b770-e2cba948b439/volumes"
Jul 07 22:16:26.292793 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:26.292760    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99172b68-ddf0-42c9-a7a1-5c764eccaf9d" path="/var/lib/kubelet/pods/99172b68-ddf0-42c9-a7a1-5c764eccaf9d/volumes"
Jul 07 22:16:37.144829 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:37.144796    2561 generic.go:356] "Generic (PLEG): container finished" podID="42aea693-6e1b-4430-85b7-7f93340ca882" containerID="a5b7e4fc6c700f760e927d07e83bab73b8f368252e1b8b99d12012125701a55f" exitCode=0
Jul 07 22:16:37.145273 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:37.144850    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45" event={"ID":"42aea693-6e1b-4430-85b7-7f93340ca882","Type":"ContainerDied","Data":"a5b7e4fc6c700f760e927d07e83bab73b8f368252e1b8b99d12012125701a55f"}
Jul 07 22:16:37.145273 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:37.145142    2561 scope.go:117] "RemoveContainer" containerID="a5b7e4fc6c700f760e927d07e83bab73b8f368252e1b8b99d12012125701a55f"
Jul 07 22:16:38.151141 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:38.151099    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-hfw45" event={"ID":"42aea693-6e1b-4430-85b7-7f93340ca882","Type":"ContainerStarted","Data":"19b609e3ced91a884f497e383615a8fbb42862c7000332a9c5f95dd77343fde3"}
Jul 07 22:16:42.170447 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:42.170412    2561 generic.go:356] "Generic (PLEG): container finished" podID="75caa7ea-49e8-41cf-809d-0c2353fa69dd" containerID="704a69279d1c43e991a94b9753497d82d926e20c76f5050220f98360bf5a6b39" exitCode=0
Jul 07 22:16:42.170887 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:42.170485    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92" event={"ID":"75caa7ea-49e8-41cf-809d-0c2353fa69dd","Type":"ContainerDied","Data":"704a69279d1c43e991a94b9753497d82d926e20c76f5050220f98360bf5a6b39"}
Jul 07 22:16:42.170887 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:42.170826    2561 scope.go:117] "RemoveContainer" containerID="704a69279d1c43e991a94b9753497d82d926e20c76f5050220f98360bf5a6b39"
Jul 07 22:16:43.176874 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:16:43.176836    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-zzp92" event={"ID":"75caa7ea-49e8-41cf-809d-0c2353fa69dd","Type":"ContainerStarted","Data":"a479082a3870d33012765b06133b598f32a6c217f6a057c89ab1306212646b6c"}
Jul 07 22:19:21.196788 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:21.196759    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:19:21.206782 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:21.206761    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 22:19:21.645799 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:21.645724    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:19:54.426908 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.426875    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"]
Jul 07 22:19:54.428243 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.427175    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36015c76-eb45-4c10-b770-e2cba948b439" containerName="registry"
Jul 07 22:19:54.428243 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.427187    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="36015c76-eb45-4c10-b770-e2cba948b439" containerName="registry"
Jul 07 22:19:54.428243 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.427212    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99172b68-ddf0-42c9-a7a1-5c764eccaf9d" containerName="console"
Jul 07 22:19:54.428243 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.427217    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="99172b68-ddf0-42c9-a7a1-5c764eccaf9d" containerName="console"
Jul 07 22:19:54.428243 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.427273    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="36015c76-eb45-4c10-b770-e2cba948b439" containerName="registry"
Jul 07 22:19:54.428243 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.427281    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="99172b68-ddf0-42c9-a7a1-5c764eccaf9d" containerName="console"
Jul 07 22:19:54.429062 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.429047    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.431798 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.431775    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 22:19:54.431798 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.431792    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 22:19:54.432102 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.432079    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-clx4d\""
Jul 07 22:19:54.432183 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.432160    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 22:19:54.432270 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.432190    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 22:19:54.452257 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.452232    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"]
Jul 07 22:19:54.593569 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.593527    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvm74\" (UniqueName: \"kubernetes.io/projected/cb80a9b1-862f-4002-a2a5-2ad302b2f969-kube-api-access-vvm74\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.593760 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.593596    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb80a9b1-862f-4002-a2a5-2ad302b2f969-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.593760 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.593625    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cb80a9b1-862f-4002-a2a5-2ad302b2f969-manifests\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.593760 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.593653    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb80a9b1-862f-4002-a2a5-2ad302b2f969-tmp\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.593885 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.593764    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb80a9b1-862f-4002-a2a5-2ad302b2f969-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.694945 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.694904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvm74\" (UniqueName: \"kubernetes.io/projected/cb80a9b1-862f-4002-a2a5-2ad302b2f969-kube-api-access-vvm74\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.695123 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.694965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb80a9b1-862f-4002-a2a5-2ad302b2f969-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.695123 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.694999    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cb80a9b1-862f-4002-a2a5-2ad302b2f969-manifests\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.695123 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.695027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb80a9b1-862f-4002-a2a5-2ad302b2f969-tmp\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.695312 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.695184    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb80a9b1-862f-4002-a2a5-2ad302b2f969-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.695525 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.695496    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cb80a9b1-862f-4002-a2a5-2ad302b2f969-manifests\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.697260 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.697235    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cb80a9b1-862f-4002-a2a5-2ad302b2f969-tmp\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.697608 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.697583    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cb80a9b1-862f-4002-a2a5-2ad302b2f969-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.697653 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.697611    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb80a9b1-862f-4002-a2a5-2ad302b2f969-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.707187 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.707161    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvm74\" (UniqueName: \"kubernetes.io/projected/cb80a9b1-862f-4002-a2a5-2ad302b2f969-kube-api-access-vvm74\") pod \"opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch\" (UID: \"cb80a9b1-862f-4002-a2a5-2ad302b2f969\") " pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.740826 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.740797    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:54.879742 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.879715    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"]
Jul 07 22:19:54.882615 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:19:54.882586    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb80a9b1_862f_4002_a2a5_2ad302b2f969.slice/crio-efd6dfc714cf3bc1c41fb68ed3387cdc3874375c91306b39bd17f2c9488bab1d WatchSource:0}: Error finding container efd6dfc714cf3bc1c41fb68ed3387cdc3874375c91306b39bd17f2c9488bab1d: Status 404 returned error can't find the container with id efd6dfc714cf3bc1c41fb68ed3387cdc3874375c91306b39bd17f2c9488bab1d
Jul 07 22:19:54.884336 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.884317    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 22:19:54.920987 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:54.920957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch" event={"ID":"cb80a9b1-862f-4002-a2a5-2ad302b2f969","Type":"ContainerStarted","Data":"efd6dfc714cf3bc1c41fb68ed3387cdc3874375c91306b39bd17f2c9488bab1d"}
Jul 07 22:19:57.938916 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:57.938882    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch" event={"ID":"cb80a9b1-862f-4002-a2a5-2ad302b2f969","Type":"ContainerStarted","Data":"7b83025f725512a73d2e05b47b389980ee909148c273ce4782da50fa15701739"}
Jul 07 22:19:58.945061 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:58.945027    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb80a9b1-862f-4002-a2a5-2ad302b2f969" containerID="7b83025f725512a73d2e05b47b389980ee909148c273ce4782da50fa15701739" exitCode=0
Jul 07 22:19:58.945493 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:58.945110    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch" event={"ID":"cb80a9b1-862f-4002-a2a5-2ad302b2f969","Type":"ContainerDied","Data":"7b83025f725512a73d2e05b47b389980ee909148c273ce4782da50fa15701739"}
Jul 07 22:19:59.951707 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:59.951670    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch" event={"ID":"cb80a9b1-862f-4002-a2a5-2ad302b2f969","Type":"ContainerStarted","Data":"8458f7f423a37f78a64ceced220f7d811f83b30fdf64ba65201a2e77ec8ab112"}
Jul 07 22:19:59.952130 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:59.951756    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:19:59.974266 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:19:59.974219    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch" podStartSLOduration=1.797898135 podStartE2EDuration="5.974190211s" totalImagesPullingTime="3.116182232s" totalInitContainerRuntime="1.060109844s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:19:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:19:59.972058992 +0000 UTC m=+339.288196443" watchObservedRunningTime="2026-07-07 22:19:59.974190211 +0000 UTC m=+339.290327703"
Jul 07 22:20:10.958460 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:10.958428    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch"
Jul 07 22:20:18.500884 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.500798    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"]
Jul 07 22:20:18.505188 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.505163    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.507638 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.507615    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-frkrl\""
Jul 07 22:20:18.508933 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.508911    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 22:20:18.509046 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.508948    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 22:20:18.509046 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.509036    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 22:20:18.509162 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.508917    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 22:20:18.509162 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.509065    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 22:20:18.517738 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.517716    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"]
Jul 07 22:20:18.601688 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.601657    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a371edff-1295-47da-b38b-0fc4d80e8fd3-manager-config\") pod \"lws-controller-manager-6f8cffc658-ntkcf\" (UID: \"a371edff-1295-47da-b38b-0fc4d80e8fd3\") " pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.601862 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.601722    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a371edff-1295-47da-b38b-0fc4d80e8fd3-metrics-cert\") pod \"lws-controller-manager-6f8cffc658-ntkcf\" (UID: \"a371edff-1295-47da-b38b-0fc4d80e8fd3\") " pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.601862 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.601764    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvb8w\" (UniqueName: \"kubernetes.io/projected/a371edff-1295-47da-b38b-0fc4d80e8fd3-kube-api-access-pvb8w\") pod \"lws-controller-manager-6f8cffc658-ntkcf\" (UID: \"a371edff-1295-47da-b38b-0fc4d80e8fd3\") " pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.601862 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.601786    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a371edff-1295-47da-b38b-0fc4d80e8fd3-cert\") pod \"lws-controller-manager-6f8cffc658-ntkcf\" (UID: \"a371edff-1295-47da-b38b-0fc4d80e8fd3\") " pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.702823 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.702785    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a371edff-1295-47da-b38b-0fc4d80e8fd3-metrics-cert\") pod \"lws-controller-manager-6f8cffc658-ntkcf\" (UID: \"a371edff-1295-47da-b38b-0fc4d80e8fd3\") " pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.703006 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.702831    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvb8w\" (UniqueName: \"kubernetes.io/projected/a371edff-1295-47da-b38b-0fc4d80e8fd3-kube-api-access-pvb8w\") pod \"lws-controller-manager-6f8cffc658-ntkcf\" (UID: \"a371edff-1295-47da-b38b-0fc4d80e8fd3\") " pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.703006 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.702867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a371edff-1295-47da-b38b-0fc4d80e8fd3-cert\") pod \"lws-controller-manager-6f8cffc658-ntkcf\" (UID: \"a371edff-1295-47da-b38b-0fc4d80e8fd3\") " pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.703006 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.702922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a371edff-1295-47da-b38b-0fc4d80e8fd3-manager-config\") pod \"lws-controller-manager-6f8cffc658-ntkcf\" (UID: \"a371edff-1295-47da-b38b-0fc4d80e8fd3\") " pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.703634 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.703607    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a371edff-1295-47da-b38b-0fc4d80e8fd3-manager-config\") pod \"lws-controller-manager-6f8cffc658-ntkcf\" (UID: \"a371edff-1295-47da-b38b-0fc4d80e8fd3\") " pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.705750 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.705721    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a371edff-1295-47da-b38b-0fc4d80e8fd3-cert\") pod \"lws-controller-manager-6f8cffc658-ntkcf\" (UID: \"a371edff-1295-47da-b38b-0fc4d80e8fd3\") " pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.705917 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.705889    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a371edff-1295-47da-b38b-0fc4d80e8fd3-metrics-cert\") pod \"lws-controller-manager-6f8cffc658-ntkcf\" (UID: \"a371edff-1295-47da-b38b-0fc4d80e8fd3\") " pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.711506 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.711480    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvb8w\" (UniqueName: \"kubernetes.io/projected/a371edff-1295-47da-b38b-0fc4d80e8fd3-kube-api-access-pvb8w\") pod \"lws-controller-manager-6f8cffc658-ntkcf\" (UID: \"a371edff-1295-47da-b38b-0fc4d80e8fd3\") " pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.814720 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.814620    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:18.958082 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:18.958056    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"]
Jul 07 22:20:18.960870 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:20:18.960841    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda371edff_1295_47da_b38b_0fc4d80e8fd3.slice/crio-4585c58d245ad9544b9076282ee698e7a62eec9e4fdb5f8b68b3cee5ce9afcb9 WatchSource:0}: Error finding container 4585c58d245ad9544b9076282ee698e7a62eec9e4fdb5f8b68b3cee5ce9afcb9: Status 404 returned error can't find the container with id 4585c58d245ad9544b9076282ee698e7a62eec9e4fdb5f8b68b3cee5ce9afcb9
Jul 07 22:20:19.036589 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:19.036553    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf" event={"ID":"a371edff-1295-47da-b38b-0fc4d80e8fd3","Type":"ContainerStarted","Data":"4585c58d245ad9544b9076282ee698e7a62eec9e4fdb5f8b68b3cee5ce9afcb9"}
Jul 07 22:20:21.491462 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.491401    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"]
Jul 07 22:20:21.494871 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.494842    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.498881 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.498815    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 22:20:21.498881 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.498864    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-xtvg2\""
Jul 07 22:20:21.507849 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.507823    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"]
Jul 07 22:20:21.639263 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.639166    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.639263 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.639225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.639263 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.639257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.639510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.639312    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.639510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.639337    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl27c\" (UniqueName: \"kubernetes.io/projected/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-kube-api-access-vl27c\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.639510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.639387    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.639510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.639408    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.639510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.639426    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.639510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.639441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.740127 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.740091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.740127 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.740131    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.740400 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.740161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl27c\" (UniqueName: \"kubernetes.io/projected/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-kube-api-access-vl27c\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.740400 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.740240    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.740400 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.740268    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.740400 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.740303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.740400 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.740327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.740765 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.740462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.740765 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.740498    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.740765 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.740737    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.740919 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.740854    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.740919 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.740881    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.741024 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.740913    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.741134 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.741101    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.742796 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.742776    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.742890 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.742797    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.762644 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.762610    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.768191 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.768161    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl27c\" (UniqueName: \"kubernetes.io/projected/17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb-kube-api-access-vl27c\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4v94rh\" (UID: \"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.807395 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.807368    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:21.961829 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:21.961796    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"]
Jul 07 22:20:21.963635 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:20:21.963609    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e71e04_0db5_42a8_a9a6_acf5d7a8f6fb.slice/crio-7a490ebe367a53c7f7fa513efa2755c34b5ddc93b4f51c2de48ba909fc06192a WatchSource:0}: Error finding container 7a490ebe367a53c7f7fa513efa2755c34b5ddc93b4f51c2de48ba909fc06192a: Status 404 returned error can't find the container with id 7a490ebe367a53c7f7fa513efa2755c34b5ddc93b4f51c2de48ba909fc06192a
Jul 07 22:20:22.054968 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:22.054908    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf" event={"ID":"a371edff-1295-47da-b38b-0fc4d80e8fd3","Type":"ContainerStarted","Data":"32bb6355fd9e738ed50519f3a17c37d7b0f8b5d91ab91632482e3165a153435a"}
Jul 07 22:20:22.055622 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:22.055596    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:20:22.057152 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:22.057119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh" event={"ID":"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb","Type":"ContainerStarted","Data":"7a490ebe367a53c7f7fa513efa2755c34b5ddc93b4f51c2de48ba909fc06192a"}
Jul 07 22:20:22.076837 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:22.076779    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf" podStartSLOduration=1.6629360869999998 podStartE2EDuration="4.076761382s" totalImagesPullingTime="2.413825295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:20:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:20:22.075702952 +0000 UTC m=+361.391840378" watchObservedRunningTime="2026-07-07 22:20:22.076761382 +0000 UTC m=+361.392898807"
Jul 07 22:20:24.824290 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:24.824254    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:20:24.824521 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:24.824333    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:20:24.824521 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:24.824368    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:20:25.074976 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:25.074887    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh" event={"ID":"17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb","Type":"ContainerStarted","Data":"369936d121645fb084a8528c5c63ba77e5d104b1694e9c81fdcd7f2bd7c054fd"}
Jul 07 22:20:25.099616 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:25.099567    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh" podStartSLOduration=1.241343542 podStartE2EDuration="4.099551008s" totalImagesPullingTime="2.858207466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:20:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:20:25.097950459 +0000 UTC m=+364.414087885" watchObservedRunningTime="2026-07-07 22:20:25.099551008 +0000 UTC m=+364.415688432"
Jul 07 22:20:25.808474 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:25.808438    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:25.813340 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:25.813315    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:26.079811 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:26.079726    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:26.080747 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:26.080726    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4v94rh"
Jul 07 22:20:34.070105 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:20:34.070073    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f8cffc658-ntkcf"
Jul 07 22:21:53.866604 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:53.866520    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-f8s6n"]
Jul 07 22:21:53.869585 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:53.869568    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f8s6n"
Jul 07 22:21:53.872491 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:53.872465    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 22:21:53.872617 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:53.872529    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 22:21:53.872617 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:53.872548    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-b8gnx\""
Jul 07 22:21:53.880482 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:53.880459    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-f8s6n"]
Jul 07 22:21:53.924779 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:53.924749    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r99g\" (UniqueName: \"kubernetes.io/projected/4d5bd86b-77fd-499f-816f-34323721ebd5-kube-api-access-8r99g\") pod \"authorino-operator-75cc8d5cb7-f8s6n\" (UID: \"4d5bd86b-77fd-499f-816f-34323721ebd5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-f8s6n"
Jul 07 22:21:54.025146 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:54.025110    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r99g\" (UniqueName: \"kubernetes.io/projected/4d5bd86b-77fd-499f-816f-34323721ebd5-kube-api-access-8r99g\") pod \"authorino-operator-75cc8d5cb7-f8s6n\" (UID: \"4d5bd86b-77fd-499f-816f-34323721ebd5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-f8s6n"
Jul 07 22:21:54.033607 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:54.033575    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r99g\" (UniqueName: \"kubernetes.io/projected/4d5bd86b-77fd-499f-816f-34323721ebd5-kube-api-access-8r99g\") pod \"authorino-operator-75cc8d5cb7-f8s6n\" (UID: \"4d5bd86b-77fd-499f-816f-34323721ebd5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-f8s6n"
Jul 07 22:21:54.179672 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:54.179574    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f8s6n"
Jul 07 22:21:54.308879 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:54.308826    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-f8s6n"]
Jul 07 22:21:54.311092 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:21:54.311065    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5bd86b_77fd_499f_816f_34323721ebd5.slice/crio-537be7117d4e768e46b531b608f010d593f7d75e63821ccd743610c44e3cce43 WatchSource:0}: Error finding container 537be7117d4e768e46b531b608f010d593f7d75e63821ccd743610c44e3cce43: Status 404 returned error can't find the container with id 537be7117d4e768e46b531b608f010d593f7d75e63821ccd743610c44e3cce43
Jul 07 22:21:54.455710 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:54.455672    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f8s6n" event={"ID":"4d5bd86b-77fd-499f-816f-34323721ebd5","Type":"ContainerStarted","Data":"537be7117d4e768e46b531b608f010d593f7d75e63821ccd743610c44e3cce43"}
Jul 07 22:21:57.474456 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:57.474424    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f8s6n" event={"ID":"4d5bd86b-77fd-499f-816f-34323721ebd5","Type":"ContainerStarted","Data":"0c2e621528617225844716cb26f10949f3edfd199a3a9ffdbcbc9c66c51ed8c5"}
Jul 07 22:21:57.474851 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:57.474529    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f8s6n"
Jul 07 22:21:57.491546 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:21:57.491497    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f8s6n" podStartSLOduration=2.057849946 podStartE2EDuration="4.491481546s" totalImagesPullingTime="2.4336316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:21:57.490845365 +0000 UTC m=+456.806982803" watchObservedRunningTime="2026-07-07 22:21:57.491481546 +0000 UTC m=+456.807618971"
Jul 07 22:22:08.482889 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:08.482856    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-f8s6n"
Jul 07 22:22:51.245947 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.245911    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"]
Jul 07 22:22:51.249544 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.249523    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.251946 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.251928    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xtpp8\""
Jul 07 22:22:51.260324 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.260299    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"]
Jul 07 22:22:51.307520 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.307485    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52xd8\" (UniqueName: \"kubernetes.io/projected/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-kube-api-access-52xd8\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.307707 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.307529    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.307707 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.307556    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.307707 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.307599    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.307707 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.307663    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.307707 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.307688    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.307954 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.307714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.307954 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.307795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.307954 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.307825    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.408602 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.408561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.408602 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.408599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.408863 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.408640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52xd8\" (UniqueName: \"kubernetes.io/projected/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-kube-api-access-52xd8\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.408863 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.408663    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.408863 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.408680    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.408863 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.408699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.409097 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.408856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.409097 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.408919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.409097 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.408954    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.409097 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.409031    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.409097 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.409076    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.409312 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.409294    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.409357 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.409326    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.409510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.409489    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.411265 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.411248    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.411400 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.411385    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.416605 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.416576    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.416894 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.416877    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52xd8\" (UniqueName: \"kubernetes.io/projected/9b6a4a1d-06a2-45d1-bde0-558a2e03fd86-kube-api-access-52xd8\") pod \"maas-default-gateway-openshift-default-56654dcf7-xc84c\" (UID: \"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.560308 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.560186    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:51.694155 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.694127    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"]
Jul 07 22:22:51.697242 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:22:51.697213    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6a4a1d_06a2_45d1_bde0_558a2e03fd86.slice/crio-359efac75c230df520346280dec0f18334e15975a497d773074187f60c3971e6 WatchSource:0}: Error finding container 359efac75c230df520346280dec0f18334e15975a497d773074187f60c3971e6: Status 404 returned error can't find the container with id 359efac75c230df520346280dec0f18334e15975a497d773074187f60c3971e6
Jul 07 22:22:51.700237 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.700161    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:22:51.700349 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.700276    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:22:51.700349 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.700326    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:22:51.732341 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:51.732305    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c" event={"ID":"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86","Type":"ContainerStarted","Data":"359efac75c230df520346280dec0f18334e15975a497d773074187f60c3971e6"}
Jul 07 22:22:52.737625 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:52.737587    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c" event={"ID":"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86","Type":"ContainerStarted","Data":"06d0405441d2caedec5b777f350fd1b7a3580f533d6779f3c1a1b3d53a32c1f7"}
Jul 07 22:22:52.757715 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:52.757667    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c" podStartSLOduration=1.757650452 podStartE2EDuration="1.757650452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:22:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:22:52.755844035 +0000 UTC m=+512.071981472" watchObservedRunningTime="2026-07-07 22:22:52.757650452 +0000 UTC m=+512.073787877"
Jul 07 22:22:53.561079 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:53.561038    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:53.566042 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:53.566016    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:53.742653 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:53.742621    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:22:53.743609 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:22:53.743587    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:23:03.356781 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.356747    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:23:03.360613 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.360590    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6x84p"
Jul 07 22:23:03.363225 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.363181    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 22:23:03.363335 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.363251    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f55xt\""
Jul 07 22:23:03.367041 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.367018    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:23:03.391838 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.391803    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:23:03.412050 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.412020    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc4rf\" (UniqueName: \"kubernetes.io/projected/8603929d-cb30-4473-9b76-b41e9abd69e1-kube-api-access-sc4rf\") pod \"limitador-limitador-54d6d988d5-6x84p\" (UID: \"8603929d-cb30-4473-9b76-b41e9abd69e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6x84p"
Jul 07 22:23:03.412156 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.412138    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8603929d-cb30-4473-9b76-b41e9abd69e1-config-file\") pod \"limitador-limitador-54d6d988d5-6x84p\" (UID: \"8603929d-cb30-4473-9b76-b41e9abd69e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6x84p"
Jul 07 22:23:03.513498 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.513457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8603929d-cb30-4473-9b76-b41e9abd69e1-config-file\") pod \"limitador-limitador-54d6d988d5-6x84p\" (UID: \"8603929d-cb30-4473-9b76-b41e9abd69e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6x84p"
Jul 07 22:23:03.513498 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.513507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc4rf\" (UniqueName: \"kubernetes.io/projected/8603929d-cb30-4473-9b76-b41e9abd69e1-kube-api-access-sc4rf\") pod \"limitador-limitador-54d6d988d5-6x84p\" (UID: \"8603929d-cb30-4473-9b76-b41e9abd69e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6x84p"
Jul 07 22:23:03.514174 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.514147    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8603929d-cb30-4473-9b76-b41e9abd69e1-config-file\") pod \"limitador-limitador-54d6d988d5-6x84p\" (UID: \"8603929d-cb30-4473-9b76-b41e9abd69e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6x84p"
Jul 07 22:23:03.521600 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.521570    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc4rf\" (UniqueName: \"kubernetes.io/projected/8603929d-cb30-4473-9b76-b41e9abd69e1-kube-api-access-sc4rf\") pod \"limitador-limitador-54d6d988d5-6x84p\" (UID: \"8603929d-cb30-4473-9b76-b41e9abd69e1\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6x84p"
Jul 07 22:23:03.672140 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.672042    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6x84p"
Jul 07 22:23:03.804394 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:03.804369    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:23:03.807333 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:23:03.807304    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8603929d_cb30_4473_9b76_b41e9abd69e1.slice/crio-ac680deaffd92095f93fe80a2ae56dadbdd1d36a5fe2f35ed998dc08185faf0b WatchSource:0}: Error finding container ac680deaffd92095f93fe80a2ae56dadbdd1d36a5fe2f35ed998dc08185faf0b: Status 404 returned error can't find the container with id ac680deaffd92095f93fe80a2ae56dadbdd1d36a5fe2f35ed998dc08185faf0b
Jul 07 22:23:04.792443 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:04.792399    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6x84p" event={"ID":"8603929d-cb30-4473-9b76-b41e9abd69e1","Type":"ContainerStarted","Data":"ac680deaffd92095f93fe80a2ae56dadbdd1d36a5fe2f35ed998dc08185faf0b"}
Jul 07 22:23:06.803462 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:06.803429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6x84p" event={"ID":"8603929d-cb30-4473-9b76-b41e9abd69e1","Type":"ContainerStarted","Data":"bec1811e6a7f60db3e64e8ebd29f3b85a0ba94a7ec76f49e6b68be8004a9974e"}
Jul 07 22:23:06.803854 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:06.803577    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6x84p"
Jul 07 22:23:06.820239 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:06.820173    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-6x84p" podStartSLOduration=1.351670079 podStartE2EDuration="3.82015972s" totalImagesPullingTime="2.468489641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:23:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:23:06.819122186 +0000 UTC m=+526.135259627" watchObservedRunningTime="2026-07-07 22:23:06.82015972 +0000 UTC m=+526.136297161"
Jul 07 22:23:17.808956 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:23:17.808866    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6x84p"
Jul 07 22:24:14.476327 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:14.476295    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:24:21.223891 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:21.223862    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:24:21.671726 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:21.671639    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:24:22.155588 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:22.155504    2561 generic.go:356] "Generic (PLEG): container finished" podID="9b6a4a1d-06a2-45d1-bde0-558a2e03fd86" containerID="06d0405441d2caedec5b777f350fd1b7a3580f533d6779f3c1a1b3d53a32c1f7" exitCode=0
Jul 07 22:24:22.155588 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:22.155545    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c" event={"ID":"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86","Type":"ContainerDied","Data":"06d0405441d2caedec5b777f350fd1b7a3580f533d6779f3c1a1b3d53a32c1f7"}
Jul 07 22:24:22.155969 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:22.155953    2561 scope.go:117] "RemoveContainer" containerID="06d0405441d2caedec5b777f350fd1b7a3580f533d6779f3c1a1b3d53a32c1f7"
Jul 07 22:24:22.156915 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:22.156887    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:24:22.156976 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:22.156960    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:24:22.157011 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:22.156993    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:24:23.161368 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:23.161330    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c" event={"ID":"9b6a4a1d-06a2-45d1-bde0-558a2e03fd86","Type":"ContainerStarted","Data":"5cd480087652aa1f69f265450e94fd4e1c3037ed07a9ea7ade38c6285830fc86"}
Jul 07 22:24:23.561406 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:23.561361    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:24:23.562481 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:23.562445    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xc84c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 07 22:24:23.562621 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:23.562512    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c" podUID="9b6a4a1d-06a2-45d1-bde0-558a2e03fd86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 07 22:24:23.743223 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:23.743169    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:24:24.561082 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:24.561043    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xc84c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 07 22:24:24.561516 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:24.561109    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c" podUID="9b6a4a1d-06a2-45d1-bde0-558a2e03fd86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 07 22:24:25.561045 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:25.561007    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xc84c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 07 22:24:25.561234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:25.561069    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c" podUID="9b6a4a1d-06a2-45d1-bde0-558a2e03fd86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 07 22:24:26.561081 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:26.561046    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-xc84c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused" start-of-body=
Jul 07 22:24:26.561324 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:26.561111    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c" podUID="9b6a4a1d-06a2-45d1-bde0-558a2e03fd86" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.32:15021/healthz/ready\": dial tcp 10.132.0.32:15021: connect: connection refused"
Jul 07 22:24:27.565304 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:27.565265    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:24:27.566365 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:27.566346    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-xc84c"
Jul 07 22:24:35.716107 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:35.716068    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:24:56.815929 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:56.815885    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:24:59.880043 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:59.880004    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"]
Jul 07 22:24:59.883035 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:59.883016    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:24:59.886951 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:59.886929    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nwrnv\""
Jul 07 22:24:59.886951 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:59.886947    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 22:24:59.887226 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:59.887004    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 22:24:59.887226 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:59.886932    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 22:24:59.894618 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:24:59.894595    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"]
Jul 07 22:25:00.035481 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.035444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw9xm\" (UniqueName: \"kubernetes.io/projected/c5b753d1-d661-4fb1-994e-f333b2a13ea3-kube-api-access-xw9xm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.035481 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.035485    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5b753d1-d661-4fb1-994e-f333b2a13ea3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.035716 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.035551    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5b753d1-d661-4fb1-994e-f333b2a13ea3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.035716 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.035580    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5b753d1-d661-4fb1-994e-f333b2a13ea3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.035716 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.035637    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5b753d1-d661-4fb1-994e-f333b2a13ea3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.035716 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.035659    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5b753d1-d661-4fb1-994e-f333b2a13ea3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.137141 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.137047    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw9xm\" (UniqueName: \"kubernetes.io/projected/c5b753d1-d661-4fb1-994e-f333b2a13ea3-kube-api-access-xw9xm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.137141 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.137087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5b753d1-d661-4fb1-994e-f333b2a13ea3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.137141 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.137120    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5b753d1-d661-4fb1-994e-f333b2a13ea3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.137141 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.137135    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5b753d1-d661-4fb1-994e-f333b2a13ea3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.137497 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.137167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5b753d1-d661-4fb1-994e-f333b2a13ea3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.137497 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.137186    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5b753d1-d661-4fb1-994e-f333b2a13ea3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.137623 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.137599    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5b753d1-d661-4fb1-994e-f333b2a13ea3-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.137688 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.137599    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5b753d1-d661-4fb1-994e-f333b2a13ea3-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.137688 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.137651    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5b753d1-d661-4fb1-994e-f333b2a13ea3-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.139449 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.139429    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5b753d1-d661-4fb1-994e-f333b2a13ea3-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.139704 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.139685    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5b753d1-d661-4fb1-994e-f333b2a13ea3-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.145123 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.145099    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw9xm\" (UniqueName: \"kubernetes.io/projected/c5b753d1-d661-4fb1-994e-f333b2a13ea3-kube-api-access-xw9xm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-vq874\" (UID: \"c5b753d1-d661-4fb1-994e-f333b2a13ea3\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.193858 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.193824    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:00.328621 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.328594    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"]
Jul 07 22:25:00.330462 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:25:00.330428    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b753d1_d661_4fb1_994e_f333b2a13ea3.slice/crio-3756bf9587fd13765031bdb3885e701606474f7e3e2b6bacbcf31abafd9de0f0 WatchSource:0}: Error finding container 3756bf9587fd13765031bdb3885e701606474f7e3e2b6bacbcf31abafd9de0f0: Status 404 returned error can't find the container with id 3756bf9587fd13765031bdb3885e701606474f7e3e2b6bacbcf31abafd9de0f0
Jul 07 22:25:00.332075 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.332053    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 22:25:00.345102 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:00.345074    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874" event={"ID":"c5b753d1-d661-4fb1-994e-f333b2a13ea3","Type":"ContainerStarted","Data":"3756bf9587fd13765031bdb3885e701606474f7e3e2b6bacbcf31abafd9de0f0"}
Jul 07 22:25:01.110752 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:01.110718    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:25:02.358420 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:02.358384    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874" event={"ID":"c5b753d1-d661-4fb1-994e-f333b2a13ea3","Type":"ContainerStarted","Data":"d5e32966bdc6cd87a3abc8aef7e15f4b93c11f307e04e3cd2d50a4f41f5b362d"}
Jul 07 22:25:02.374597 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:02.374544    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874" podStartSLOduration=2.226160015 podStartE2EDuration="3.374528654s" totalImagesPullingTime="1.148368639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:25:02.374437618 +0000 UTC m=+641.690575046" watchObservedRunningTime="2026-07-07 22:25:02.374528654 +0000 UTC m=+641.690666079"
Jul 07 22:25:10.194757 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:10.194714    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:10.195162 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:10.194784    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:10.206955 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:10.206928    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:10.407392 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:10.407364    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-vq874"
Jul 07 22:25:20.516012 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:20.515976    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:25:34.420231 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:34.420181    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:25:40.928003 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:25:40.927964    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:27:20.525905 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:27:20.525868    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:27:31.307745 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:27:31.307707    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:27:42.810975 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:27:42.810934    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:27:50.915421 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:27:50.915377    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:28:01.407727 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:28:01.407688    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:28:28.412315 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:28:28.412279    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:28:41.216734 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:28:41.216683    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:29:12.112557 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:29:12.112522    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:29:19.412611 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:29:19.412581    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:29:21.251589 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:29:21.251565    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:29:21.709248 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:29:21.709220    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:29:29.609158 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:29:29.609124    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:29:35.309180 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:29:35.309144    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:29:46.117781 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:29:46.117740    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:29:55.212956 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:29:55.212918    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:30:00.144860 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:00.144823    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724390-dm7b8"]
Jul 07 22:30:00.148292 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:00.148274    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724390-dm7b8"
Jul 07 22:30:00.150900 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:00.150872    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-r9rv4\""
Jul 07 22:30:00.159153 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:00.159129    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724390-dm7b8"]
Jul 07 22:30:00.269733 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:00.269697    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fmrj\" (UniqueName: \"kubernetes.io/projected/7be6eff1-e84d-4fb2-bfae-e846254cb294-kube-api-access-4fmrj\") pod \"maas-api-key-cleanup-29724390-dm7b8\" (UID: \"7be6eff1-e84d-4fb2-bfae-e846254cb294\") " pod="opendatahub/maas-api-key-cleanup-29724390-dm7b8"
Jul 07 22:30:00.370569 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:00.370517    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fmrj\" (UniqueName: \"kubernetes.io/projected/7be6eff1-e84d-4fb2-bfae-e846254cb294-kube-api-access-4fmrj\") pod \"maas-api-key-cleanup-29724390-dm7b8\" (UID: \"7be6eff1-e84d-4fb2-bfae-e846254cb294\") " pod="opendatahub/maas-api-key-cleanup-29724390-dm7b8"
Jul 07 22:30:00.378985 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:00.378948    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fmrj\" (UniqueName: \"kubernetes.io/projected/7be6eff1-e84d-4fb2-bfae-e846254cb294-kube-api-access-4fmrj\") pod \"maas-api-key-cleanup-29724390-dm7b8\" (UID: \"7be6eff1-e84d-4fb2-bfae-e846254cb294\") " pod="opendatahub/maas-api-key-cleanup-29724390-dm7b8"
Jul 07 22:30:00.458249 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:00.458218    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724390-dm7b8"
Jul 07 22:30:00.591820 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:00.591794    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724390-dm7b8"]
Jul 07 22:30:00.594286 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:30:00.594250    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be6eff1_e84d_4fb2_bfae_e846254cb294.slice/crio-dc4eed31e2f7381448be698e421cac93edabe6d947aa9151986f1bdcfb9cab81 WatchSource:0}: Error finding container dc4eed31e2f7381448be698e421cac93edabe6d947aa9151986f1bdcfb9cab81: Status 404 returned error can't find the container with id dc4eed31e2f7381448be698e421cac93edabe6d947aa9151986f1bdcfb9cab81
Jul 07 22:30:00.596507 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:00.596486    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 22:30:00.711178 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:00.711082    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724390-dm7b8" event={"ID":"7be6eff1-e84d-4fb2-bfae-e846254cb294","Type":"ContainerStarted","Data":"dc4eed31e2f7381448be698e421cac93edabe6d947aa9151986f1bdcfb9cab81"}
Jul 07 22:30:07.013001 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:07.012958    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:30:07.746056 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:07.746017    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724390-dm7b8" event={"ID":"7be6eff1-e84d-4fb2-bfae-e846254cb294","Type":"ContainerStarted","Data":"db1be0a63bea7fb1b7449b668d4db0e69fe852fb8493aa635c9e07620f80065a"}
Jul 07 22:30:07.764023 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:07.763976    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724390-dm7b8" podStartSLOduration=1.213549491 podStartE2EDuration="7.763959583s" totalImagesPullingTime="6.550410092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:30:07.762180123 +0000 UTC m=+947.078317567" watchObservedRunningTime="2026-07-07 22:30:07.763959583 +0000 UTC m=+947.080097008"
Jul 07 22:30:08.752243 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:08.752187    2561 generic.go:356] "Generic (PLEG): container finished" podID="7be6eff1-e84d-4fb2-bfae-e846254cb294" containerID="db1be0a63bea7fb1b7449b668d4db0e69fe852fb8493aa635c9e07620f80065a" exitCode=0
Jul 07 22:30:08.752621 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:08.752268    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724390-dm7b8" event={"ID":"7be6eff1-e84d-4fb2-bfae-e846254cb294","Type":"ContainerDied","Data":"db1be0a63bea7fb1b7449b668d4db0e69fe852fb8493aa635c9e07620f80065a"}
Jul 07 22:30:09.894774 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:09.894740    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724390-dm7b8"
Jul 07 22:30:10.062355 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:10.062258    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fmrj\" (UniqueName: \"kubernetes.io/projected/7be6eff1-e84d-4fb2-bfae-e846254cb294-kube-api-access-4fmrj\") pod \"7be6eff1-e84d-4fb2-bfae-e846254cb294\" (UID: \"7be6eff1-e84d-4fb2-bfae-e846254cb294\") "
Jul 07 22:30:10.064440 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:10.064413    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7be6eff1-e84d-4fb2-bfae-e846254cb294-kube-api-access-4fmrj" (OuterVolumeSpecName: "kube-api-access-4fmrj") pod "7be6eff1-e84d-4fb2-bfae-e846254cb294" (UID: "7be6eff1-e84d-4fb2-bfae-e846254cb294"). InnerVolumeSpecName "kube-api-access-4fmrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:30:10.163500 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:10.163467    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fmrj\" (UniqueName: \"kubernetes.io/projected/7be6eff1-e84d-4fb2-bfae-e846254cb294-kube-api-access-4fmrj\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:30:10.762865 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:10.762831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724390-dm7b8" event={"ID":"7be6eff1-e84d-4fb2-bfae-e846254cb294","Type":"ContainerDied","Data":"dc4eed31e2f7381448be698e421cac93edabe6d947aa9151986f1bdcfb9cab81"}
Jul 07 22:30:10.762865 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:10.762866    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724390-dm7b8"
Jul 07 22:30:10.763081 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:10.762881    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc4eed31e2f7381448be698e421cac93edabe6d947aa9151986f1bdcfb9cab81"
Jul 07 22:30:16.610506 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:16.610468    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:30:39.010082 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:39.010045    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:30:50.519953 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:30:50.519867    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:31:12.313068 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:31:12.313034    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:31:22.820484 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:31:22.820450    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:31:39.028947 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:31:39.028915    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:31:48.212314 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:31:48.212278    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:31:59.217870 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:31:59.217834    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:32:08.616755 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:32:08.616718    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:32:17.911372 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:32:17.911285    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:34:06.676399 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:34:06.676318    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:34:15.567296 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:34:15.567258    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:34:21.277848 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:34:21.277820    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:34:21.735090 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:34:21.735066    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:34:27.878230 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:34:27.877028    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:34:39.775823 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:34:39.775782    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:34:50.776834 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:34:50.776800    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:34:59.469693 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:34:59.469660    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:35:07.870674 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:35:07.870630    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:35:16.475454 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:35:16.475368    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:35:24.972853 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:35:24.972814    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:35:35.376261 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:35:35.376223    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:35:42.581664 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:35:42.581633    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:35:53.675977 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:35:53.675937    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:36:14.975588 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:36:14.975553    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:36:23.678785 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:36:23.678746    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:36:34.080671 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:36:34.080638    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:36:46.080843 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:36:46.080764    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:36:54.774919 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:36:54.774881    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:37:02.387375 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:37:02.387332    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:37:11.369296 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:37:11.369251    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:37:19.872355 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:37:19.872318    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:37:29.941419 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:37:29.941386    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:37:39.179840 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:37:39.179804    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:37:48.279222 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:37:48.279170    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:38:00.778957 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:38:00.778903    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:38:09.279035 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:38:09.279000    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:38:19.376988 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:38:19.376904    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:38:30.974917 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:38:30.974881    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:38:43.769309 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:38:43.769264    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:38:52.071842 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:38:52.071806    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:39:04.579061 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:39:04.579013    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:39:16.778902 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:39:16.778864    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:39:21.305010 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:39:21.304985    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:39:21.761885 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:39:21.761858    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:39:29.675596 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:39:29.675555    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:39:38.466692 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:39:38.466658    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:39:50.673911 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:39:50.673825    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:39:58.649244 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:39:58.649188    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:40:04.516184 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.516149    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"]
Jul 07 22:40:04.516539 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.516525    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7be6eff1-e84d-4fb2-bfae-e846254cb294" containerName="cleanup"
Jul 07 22:40:04.516539 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.516540    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7be6eff1-e84d-4fb2-bfae-e846254cb294" containerName="cleanup"
Jul 07 22:40:04.516614 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.516596    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7be6eff1-e84d-4fb2-bfae-e846254cb294" containerName="cleanup"
Jul 07 22:40:04.519324 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.519304    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.522013 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.521990    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-638b90a2-openshift-default-dockercfg-7p87z\""
Jul 07 22:40:04.526234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.526084    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-data\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.526234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.526145    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-podinfo\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.526234 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.526187    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-credential-socket\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.526383 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.526235    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-workload-socket\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.526383 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.526257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-token\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.526383 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.526364    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-envoy\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.526476 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.526420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-workload-certs\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.526476 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.526451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9qlc\" (UniqueName: \"kubernetes.io/projected/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-kube-api-access-z9qlc\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.526553 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.526480    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istiod-ca-cert\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.543638 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.543609    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"]
Jul 07 22:40:04.627522 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.627490    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-workload-certs\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.627700 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.627530    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9qlc\" (UniqueName: \"kubernetes.io/projected/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-kube-api-access-z9qlc\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.627700 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.627566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istiod-ca-cert\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.627700 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.627586    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-data\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.627700 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.627629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-podinfo\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.627700 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.627673    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-credential-socket\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.627965 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.627701    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-workload-socket\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.627965 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.627872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-token\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.627965 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.627915    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-envoy\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.628119 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.627977    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-data\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.628179 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.628143    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-credential-socket\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.628300 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.628270    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-workload-socket\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.628423 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.628298    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-workload-certs\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.628485 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.628421    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istiod-ca-cert\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.630072 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.630052    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-envoy\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.630231 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.630214    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-podinfo\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.636482 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.636463    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-token\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.636773 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.636751    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9qlc\" (UniqueName: \"kubernetes.io/projected/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-kube-api-access-z9qlc\") pod \"e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") " pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.829772 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.829673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:04.977996 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.977971    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"]
Jul 07 22:40:04.979624 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:40:04.979600    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b054203_3ed1_462e_8ffd_2ae00fbe39b9.slice/crio-0ad4a2e7d106416e0bd02a82d21bac14dbab41ab3b529f35c7a02869c98340fe WatchSource:0}: Error finding container 0ad4a2e7d106416e0bd02a82d21bac14dbab41ab3b529f35c7a02869c98340fe: Status 404 returned error can't find the container with id 0ad4a2e7d106416e0bd02a82d21bac14dbab41ab3b529f35c7a02869c98340fe
Jul 07 22:40:04.981848 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.981809    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:40:04.981927 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.981893    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:40:04.981969 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:04.981935    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:40:05.485225 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:05.485170    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz" event={"ID":"6b054203-3ed1-462e-8ffd-2ae00fbe39b9","Type":"ContainerStarted","Data":"5db2353e808ddfc4d52d34869ff37f8ae62743c75d7b9989e3bebc2da33e6ad1"}
Jul 07 22:40:05.485625 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:05.485245    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz" event={"ID":"6b054203-3ed1-462e-8ffd-2ae00fbe39b9","Type":"ContainerStarted","Data":"0ad4a2e7d106416e0bd02a82d21bac14dbab41ab3b529f35c7a02869c98340fe"}
Jul 07 22:40:05.504845 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:05.504795    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz" podStartSLOduration=1.5047809939999999 podStartE2EDuration="1.504780994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:40:05.503918094 +0000 UTC m=+1544.820055518" watchObservedRunningTime="2026-07-07 22:40:05.504780994 +0000 UTC m=+1544.820918420"
Jul 07 22:40:05.830701 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:05.830612    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:06.834781 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:06.834753    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:07.495944 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:07.495908    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:07.496791 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:07.496774    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:08.670934 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:08.670905    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:40:10.898261 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:10.898224    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"]
Jul 07 22:40:10.898753 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:10.898453    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz" podUID="6b054203-3ed1-462e-8ffd-2ae00fbe39b9" containerName="istio-proxy" containerID="cri-o://5db2353e808ddfc4d52d34869ff37f8ae62743c75d7b9989e3bebc2da33e6ad1" gracePeriod=30
Jul 07 22:40:16.538139 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:16.538046    2561 generic.go:356] "Generic (PLEG): container finished" podID="6b054203-3ed1-462e-8ffd-2ae00fbe39b9" containerID="5db2353e808ddfc4d52d34869ff37f8ae62743c75d7b9989e3bebc2da33e6ad1" exitCode=0
Jul 07 22:40:16.538139 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:16.538111    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz" event={"ID":"6b054203-3ed1-462e-8ffd-2ae00fbe39b9","Type":"ContainerDied","Data":"5db2353e808ddfc4d52d34869ff37f8ae62743c75d7b9989e3bebc2da33e6ad1"}
Jul 07 22:40:16.890157 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:16.890120    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:40:17.056554 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.056528    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:17.145789 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.145705    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-credential-socket\") pod \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") "
Jul 07 22:40:17.145789 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.145742    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-data\") pod \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") "
Jul 07 22:40:17.145789 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.145759    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-workload-certs\") pod \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") "
Jul 07 22:40:17.145789 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.145782    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-podinfo\") pod \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") "
Jul 07 22:40:17.146081 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.145842    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-token\") pod \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") "
Jul 07 22:40:17.146081 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.145857    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9qlc\" (UniqueName: \"kubernetes.io/projected/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-kube-api-access-z9qlc\") pod \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") "
Jul 07 22:40:17.146081 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.145875    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-envoy\") pod \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") "
Jul 07 22:40:17.146081 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.145901    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istiod-ca-cert\") pod \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") "
Jul 07 22:40:17.146081 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.145996    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-workload-socket\") pod \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\" (UID: \"6b054203-3ed1-462e-8ffd-2ae00fbe39b9\") "
Jul 07 22:40:17.146081 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.146068    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b054203-3ed1-462e-8ffd-2ae00fbe39b9" (UID: "6b054203-3ed1-462e-8ffd-2ae00fbe39b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:40:17.146421 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.146083    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b054203-3ed1-462e-8ffd-2ae00fbe39b9" (UID: "6b054203-3ed1-462e-8ffd-2ae00fbe39b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:40:17.146421 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.146331    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:40:17.146421 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.146352    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:40:17.146421 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.146367    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b054203-3ed1-462e-8ffd-2ae00fbe39b9" (UID: "6b054203-3ed1-462e-8ffd-2ae00fbe39b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:40:17.146618 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.146445    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b054203-3ed1-462e-8ffd-2ae00fbe39b9" (UID: "6b054203-3ed1-462e-8ffd-2ae00fbe39b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:40:17.146682 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.146633    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b054203-3ed1-462e-8ffd-2ae00fbe39b9" (UID: "6b054203-3ed1-462e-8ffd-2ae00fbe39b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:40:17.148495 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.148464    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-kube-api-access-z9qlc" (OuterVolumeSpecName: "kube-api-access-z9qlc") pod "6b054203-3ed1-462e-8ffd-2ae00fbe39b9" (UID: "6b054203-3ed1-462e-8ffd-2ae00fbe39b9"). InnerVolumeSpecName "kube-api-access-z9qlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:40:17.148495 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.148480    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b054203-3ed1-462e-8ffd-2ae00fbe39b9" (UID: "6b054203-3ed1-462e-8ffd-2ae00fbe39b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:40:17.148639 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.148487    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b054203-3ed1-462e-8ffd-2ae00fbe39b9" (UID: "6b054203-3ed1-462e-8ffd-2ae00fbe39b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 22:40:17.148639 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.148528    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b054203-3ed1-462e-8ffd-2ae00fbe39b9" (UID: "6b054203-3ed1-462e-8ffd-2ae00fbe39b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:40:17.247472 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.247438    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:40:17.247472 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.247466    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9qlc\" (UniqueName: \"kubernetes.io/projected/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-kube-api-access-z9qlc\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:40:17.247472 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.247477    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:40:17.247696 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.247486    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:40:17.247696 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.247494    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:40:17.247696 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.247501    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:40:17.247696 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.247509    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b054203-3ed1-462e-8ffd-2ae00fbe39b9-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:40:17.544731 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.544702    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz" event={"ID":"6b054203-3ed1-462e-8ffd-2ae00fbe39b9","Type":"ContainerDied","Data":"0ad4a2e7d106416e0bd02a82d21bac14dbab41ab3b529f35c7a02869c98340fe"}
Jul 07 22:40:17.544731 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.544729    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"
Jul 07 22:40:17.545254 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.544780    2561 scope.go:117] "RemoveContainer" containerID="5db2353e808ddfc4d52d34869ff37f8ae62743c75d7b9989e3bebc2da33e6ad1"
Jul 07 22:40:17.567704 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.567668    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"]
Jul 07 22:40:17.573331 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:17.573307    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-638b90a2-openshift-default-5c6c795cd5-slpsz"]
Jul 07 22:40:18.294180 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:18.294143    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b054203-3ed1-462e-8ffd-2ae00fbe39b9" path="/var/lib/kubelet/pods/6b054203-3ed1-462e-8ffd-2ae00fbe39b9/volumes"
Jul 07 22:40:38.778383 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:38.778349    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:40:47.072956 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:40:47.072916    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:42:09.374573 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:42:09.374522    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:42:18.274867 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:42:18.274823    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:42:28.978100 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:42:28.978059    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:42:39.773744 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:42:39.773705    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:43:08.473314 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:43:08.473225    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:43:19.672820 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:43:19.672781    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:43:38.480186 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:43:38.480148    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:43:51.880611 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:43:51.880562    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:44:21.332127 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:44:21.332097    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:44:21.788319 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:44:21.788291    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:44:31.775117 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:44:31.775070    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:44:40.779364 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:44:40.779320    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:44:50.889994 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:44:50.889955    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:45:00.137762 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.137724    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724405-4rx5w"]
Jul 07 22:45:00.138288 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.138056    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b054203-3ed1-462e-8ffd-2ae00fbe39b9" containerName="istio-proxy"
Jul 07 22:45:00.138288 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.138067    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b054203-3ed1-462e-8ffd-2ae00fbe39b9" containerName="istio-proxy"
Jul 07 22:45:00.138288 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.138141    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b054203-3ed1-462e-8ffd-2ae00fbe39b9" containerName="istio-proxy"
Jul 07 22:45:00.141137 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.141118    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724405-4rx5w"
Jul 07 22:45:00.143596 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.143570    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-r9rv4\""
Jul 07 22:45:00.147761 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.147735    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724405-4rx5w"]
Jul 07 22:45:00.228495 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.228459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff25s\" (UniqueName: \"kubernetes.io/projected/6c3f3830-7ba3-4a0c-a7c9-645c55644e67-kube-api-access-ff25s\") pod \"maas-api-key-cleanup-29724405-4rx5w\" (UID: \"6c3f3830-7ba3-4a0c-a7c9-645c55644e67\") " pod="opendatahub/maas-api-key-cleanup-29724405-4rx5w"
Jul 07 22:45:00.329266 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.329233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff25s\" (UniqueName: \"kubernetes.io/projected/6c3f3830-7ba3-4a0c-a7c9-645c55644e67-kube-api-access-ff25s\") pod \"maas-api-key-cleanup-29724405-4rx5w\" (UID: \"6c3f3830-7ba3-4a0c-a7c9-645c55644e67\") " pod="opendatahub/maas-api-key-cleanup-29724405-4rx5w"
Jul 07 22:45:00.337838 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.337814    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff25s\" (UniqueName: \"kubernetes.io/projected/6c3f3830-7ba3-4a0c-a7c9-645c55644e67-kube-api-access-ff25s\") pod \"maas-api-key-cleanup-29724405-4rx5w\" (UID: \"6c3f3830-7ba3-4a0c-a7c9-645c55644e67\") " pod="opendatahub/maas-api-key-cleanup-29724405-4rx5w"
Jul 07 22:45:00.453403 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.453372    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724405-4rx5w"
Jul 07 22:45:00.591360 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.591302    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724405-4rx5w"]
Jul 07 22:45:00.593639 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:45:00.593608    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3f3830_7ba3_4a0c_a7c9_645c55644e67.slice/crio-f7fc620817e25888abc143817a9b0337827af60840d1fe88b96a0e2c0b4fa09c WatchSource:0}: Error finding container f7fc620817e25888abc143817a9b0337827af60840d1fe88b96a0e2c0b4fa09c: Status 404 returned error can't find the container with id f7fc620817e25888abc143817a9b0337827af60840d1fe88b96a0e2c0b4fa09c
Jul 07 22:45:00.874379 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.874339    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724405-4rx5w" event={"ID":"6c3f3830-7ba3-4a0c-a7c9-645c55644e67","Type":"ContainerStarted","Data":"18eb0f39ae0e1a24c5c3ee503673d3f3b9d4eaba860fda15ae7619e0fc02fc29"}
Jul 07 22:45:00.874550 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.874396    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724405-4rx5w" event={"ID":"6c3f3830-7ba3-4a0c-a7c9-645c55644e67","Type":"ContainerStarted","Data":"f7fc620817e25888abc143817a9b0337827af60840d1fe88b96a0e2c0b4fa09c"}
Jul 07 22:45:00.890395 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:00.890340    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724405-4rx5w" podStartSLOduration=0.890323103 podStartE2EDuration="890.323103ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:45:00.889735668 +0000 UTC m=+1840.205873095" watchObservedRunningTime="2026-07-07 22:45:00.890323103 +0000 UTC m=+1840.206460527"
Jul 07 22:45:01.882534 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:01.882424    2561 generic.go:356] "Generic (PLEG): container finished" podID="6c3f3830-7ba3-4a0c-a7c9-645c55644e67" containerID="18eb0f39ae0e1a24c5c3ee503673d3f3b9d4eaba860fda15ae7619e0fc02fc29" exitCode=0
Jul 07 22:45:01.882534 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:01.882507    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724405-4rx5w" event={"ID":"6c3f3830-7ba3-4a0c-a7c9-645c55644e67","Type":"ContainerDied","Data":"18eb0f39ae0e1a24c5c3ee503673d3f3b9d4eaba860fda15ae7619e0fc02fc29"}
Jul 07 22:45:03.026757 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:03.026732    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724405-4rx5w"
Jul 07 22:45:03.154309 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:03.154224    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ff25s\" (UniqueName: \"kubernetes.io/projected/6c3f3830-7ba3-4a0c-a7c9-645c55644e67-kube-api-access-ff25s\") pod \"6c3f3830-7ba3-4a0c-a7c9-645c55644e67\" (UID: \"6c3f3830-7ba3-4a0c-a7c9-645c55644e67\") "
Jul 07 22:45:03.156274 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:03.156248    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c3f3830-7ba3-4a0c-a7c9-645c55644e67-kube-api-access-ff25s" (OuterVolumeSpecName: "kube-api-access-ff25s") pod "6c3f3830-7ba3-4a0c-a7c9-645c55644e67" (UID: "6c3f3830-7ba3-4a0c-a7c9-645c55644e67"). InnerVolumeSpecName "kube-api-access-ff25s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:45:03.255079 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:03.255031    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff25s\" (UniqueName: \"kubernetes.io/projected/6c3f3830-7ba3-4a0c-a7c9-645c55644e67-kube-api-access-ff25s\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:45:03.892643 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:03.892611    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724405-4rx5w"
Jul 07 22:45:03.892643 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:03.892619    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724405-4rx5w" event={"ID":"6c3f3830-7ba3-4a0c-a7c9-645c55644e67","Type":"ContainerDied","Data":"f7fc620817e25888abc143817a9b0337827af60840d1fe88b96a0e2c0b4fa09c"}
Jul 07 22:45:03.892870 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:03.892710    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7fc620817e25888abc143817a9b0337827af60840d1fe88b96a0e2c0b4fa09c"
Jul 07 22:45:36.980645 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:36.980610    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"]
Jul 07 22:45:36.981132 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:36.981000    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c3f3830-7ba3-4a0c-a7c9-645c55644e67" containerName="cleanup"
Jul 07 22:45:36.981132 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:36.981013    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c3f3830-7ba3-4a0c-a7c9-645c55644e67" containerName="cleanup"
Jul 07 22:45:36.981132 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:36.981085    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c3f3830-7ba3-4a0c-a7c9-645c55644e67" containerName="cleanup"
Jul 07 22:45:36.984246 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:36.984184    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:36.986996 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:36.986970    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-346e61-openshift-default-dockercfg-x6rmv\""
Jul 07 22:45:36.997442 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:36.997411    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"]
Jul 07 22:45:37.049637 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.049599    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-workload-socket\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.049637 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.049637    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-istio-data\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.049897 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.049658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-credential-socket\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.049897 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.049714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-workload-certs\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.049897 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.049743    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51100d6a-f6fd-4511-affd-d43d0a438718-istio-podinfo\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.049897 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.049783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44bwq\" (UniqueName: \"kubernetes.io/projected/51100d6a-f6fd-4511-affd-d43d0a438718-kube-api-access-44bwq\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.049897 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.049854    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51100d6a-f6fd-4511-affd-d43d0a438718-istio-token\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.049897 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.049888    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51100d6a-f6fd-4511-affd-d43d0a438718-istiod-ca-cert\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.050244 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.049955    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-istio-envoy\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.151208 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.151163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-istio-envoy\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.151429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.151258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-workload-socket\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.151429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.151279    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-istio-data\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.151429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.151299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-credential-socket\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.151429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.151316    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-workload-certs\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.151429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.151332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51100d6a-f6fd-4511-affd-d43d0a438718-istio-podinfo\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.151429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.151361    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44bwq\" (UniqueName: \"kubernetes.io/projected/51100d6a-f6fd-4511-affd-d43d0a438718-kube-api-access-44bwq\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.151429 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.151424    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51100d6a-f6fd-4511-affd-d43d0a438718-istio-token\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.151789 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.151461    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51100d6a-f6fd-4511-affd-d43d0a438718-istiod-ca-cert\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.151789 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.151701    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-workload-socket\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.151893 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.151876    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-workload-certs\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.151953 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.151931    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-credential-socket\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.152007 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.151992    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-istio-data\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.152452 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.152425    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51100d6a-f6fd-4511-affd-d43d0a438718-istiod-ca-cert\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.153759 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.153728    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-istio-envoy\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.154009 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.153990    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51100d6a-f6fd-4511-affd-d43d0a438718-istio-podinfo\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.159513 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.159486    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51100d6a-f6fd-4511-affd-d43d0a438718-istio-token\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.159722 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.159702    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44bwq\" (UniqueName: \"kubernetes.io/projected/51100d6a-f6fd-4511-affd-d43d0a438718-kube-api-access-44bwq\") pod \"e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") " pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.298926 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.298815    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:37.445161 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.445133    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"]
Jul 07 22:45:37.447172 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:45:37.447135    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51100d6a_f6fd_4511_affd_d43d0a438718.slice/crio-21dd58a4fd7a9b09570b7b8302cab40492202f6e3d7cf079311d73c0527ddf4f WatchSource:0}: Error finding container 21dd58a4fd7a9b09570b7b8302cab40492202f6e3d7cf079311d73c0527ddf4f: Status 404 returned error can't find the container with id 21dd58a4fd7a9b09570b7b8302cab40492202f6e3d7cf079311d73c0527ddf4f
Jul 07 22:45:37.449432 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.449395    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:45:37.449515 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.449478    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:45:37.449556 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:37.449521    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:45:38.051388 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:38.051353    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx" event={"ID":"51100d6a-f6fd-4511-affd-d43d0a438718","Type":"ContainerStarted","Data":"d02075890ba58bdea48a4a5220818b92fa0764a5ac760e1de2bce23fef35400d"}
Jul 07 22:45:38.051848 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:38.051407    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx" event={"ID":"51100d6a-f6fd-4511-affd-d43d0a438718","Type":"ContainerStarted","Data":"21dd58a4fd7a9b09570b7b8302cab40492202f6e3d7cf079311d73c0527ddf4f"}
Jul 07 22:45:38.072440 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:38.072388    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx" podStartSLOduration=2.072371553 podStartE2EDuration="2.072371553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:45:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:45:38.07019244 +0000 UTC m=+1877.386348068" watchObservedRunningTime="2026-07-07 22:45:38.072371553 +0000 UTC m=+1877.388508977"
Jul 07 22:45:38.299686 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:38.299657    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:38.304788 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:38.304716    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:39.056418 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:39.056388    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:39.057507 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:39.057486    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:39.876425 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:39.876391    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:45:50.671589 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:50.671492    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:45:53.480209 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.480157    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"]
Jul 07 22:45:53.486411 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.486380    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.490510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.490473    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2de05d\"/\"openshift-service-ca.crt\""
Jul 07 22:45:53.490656 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.490532    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2de05d\"/\"kube-root-ca.crt\""
Jul 07 22:45:53.490656 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.490592    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2de05d\"/\"default-dockercfg-x6jvd\""
Jul 07 22:45:53.490656 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.490592    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2de05d\"/\"test-model-2de05d-kserve-self-signed-certs\""
Jul 07 22:45:53.494546 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.494219    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"]
Jul 07 22:45:53.613018 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.612986    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-dshm\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.613238 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.613023    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-model-cache\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.613238 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.613070    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-home\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.613238 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.613144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c65c2a5b-697f-4461-8385-8f6837eb9639-tls-certs\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.613238 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.613183    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxjnv\" (UniqueName: \"kubernetes.io/projected/c65c2a5b-697f-4461-8385-8f6837eb9639-kube-api-access-bxjnv\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.613414 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.613284    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-tmp-dir\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.714462 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.714424    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-home\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.714462 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.714466    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c65c2a5b-697f-4461-8385-8f6837eb9639-tls-certs\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.714720 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.714490    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxjnv\" (UniqueName: \"kubernetes.io/projected/c65c2a5b-697f-4461-8385-8f6837eb9639-kube-api-access-bxjnv\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.714720 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.714541    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-tmp-dir\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.714720 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.714603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-dshm\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.714720 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.714631    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-model-cache\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.715042 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.715012    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-home\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.715212 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.715074    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-tmp-dir\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.715212 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.715118    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-model-cache\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.716972 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.716939    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-dshm\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.717173 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.717156    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c65c2a5b-697f-4461-8385-8f6837eb9639-tls-certs\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.722464 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.722435    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxjnv\" (UniqueName: \"kubernetes.io/projected/c65c2a5b-697f-4461-8385-8f6837eb9639-kube-api-access-bxjnv\") pod \"test-model-2de05d-kserve-787d7786cc-77jtx\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") " pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.798490 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.798395    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:45:53.945813 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:53.945782    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"]
Jul 07 22:45:53.948664 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:45:53.948632    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc65c2a5b_697f_4461_8385_8f6837eb9639.slice/crio-713d96caf7f8308785363d3177903aee3ba7b6e111d00fa6f8060d9284c84233 WatchSource:0}: Error finding container 713d96caf7f8308785363d3177903aee3ba7b6e111d00fa6f8060d9284c84233: Status 404 returned error can't find the container with id 713d96caf7f8308785363d3177903aee3ba7b6e111d00fa6f8060d9284c84233
Jul 07 22:45:54.140203 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:54.140100    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx" event={"ID":"c65c2a5b-697f-4461-8385-8f6837eb9639","Type":"ContainerStarted","Data":"fbf622ccdc85152fce0925edb2696ebe9931a2bbca9cec6b8ef2602ff3f01194"}
Jul 07 22:45:54.140203 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:54.140155    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx" event={"ID":"c65c2a5b-697f-4461-8385-8f6837eb9639","Type":"ContainerStarted","Data":"713d96caf7f8308785363d3177903aee3ba7b6e111d00fa6f8060d9284c84233"}
Jul 07 22:45:54.156617 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:54.156565    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx" podStartSLOduration=1.156549445 podStartE2EDuration="1.156549445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:45:54.155782184 +0000 UTC m=+1893.471919610" watchObservedRunningTime="2026-07-07 22:45:54.156549445 +0000 UTC m=+1893.472686870"
Jul 07 22:45:54.310612 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:54.310377    2561 patch_prober.go:28] interesting pod/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:35828->10.132.0.38:15021: read: connection reset by peer" start-of-body=
Jul 07 22:45:54.310612 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:54.310461    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx" podUID="51100d6a-f6fd-4511-affd-d43d0a438718" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:35828->10.132.0.38:15021: read: connection reset by peer"
Jul 07 22:45:55.147609 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:55.147522    2561 generic.go:356] "Generic (PLEG): container finished" podID="51100d6a-f6fd-4511-affd-d43d0a438718" containerID="d02075890ba58bdea48a4a5220818b92fa0764a5ac760e1de2bce23fef35400d" exitCode=0
Jul 07 22:45:55.147609 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:55.147597    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx" event={"ID":"51100d6a-f6fd-4511-affd-d43d0a438718","Type":"ContainerDied","Data":"d02075890ba58bdea48a4a5220818b92fa0764a5ac760e1de2bce23fef35400d"}
Jul 07 22:45:55.148017 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:55.147923    2561 scope.go:117] "RemoveContainer" containerID="d02075890ba58bdea48a4a5220818b92fa0764a5ac760e1de2bce23fef35400d"
Jul 07 22:45:55.148960 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:55.148929    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:45:55.149014 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:55.149002    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:45:55.149048 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:55.149030    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:45:56.154339 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:56.154306    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx" event={"ID":"51100d6a-f6fd-4511-affd-d43d0a438718","Type":"ContainerStarted","Data":"13bb62794f1168b7006b9e484c1a7c1a251f61d903b9846434ed057545f7a1c2"}
Jul 07 22:45:56.299276 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:56.299238    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:45:56.299566 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:56.299542    2561 patch_prober.go:28] interesting pod/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 07 22:45:56.299622 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:56.299599    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx" podUID="51100d6a-f6fd-4511-affd-d43d0a438718" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 07 22:45:57.299304 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:57.299264    2561 patch_prober.go:28] interesting pod/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 07 22:45:57.299694 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:57.299320    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx" podUID="51100d6a-f6fd-4511-affd-d43d0a438718" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 07 22:45:57.876583 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:57.876531    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:45:58.299874 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:58.299836    2561 patch_prober.go:28] interesting pod/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 07 22:45:58.300299 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:58.299888    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx" podUID="51100d6a-f6fd-4511-affd-d43d0a438718" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 07 22:45:59.300276 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:59.300227    2561 patch_prober.go:28] interesting pod/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 07 22:45:59.300673 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:45:59.300319    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx" podUID="51100d6a-f6fd-4511-affd-d43d0a438718" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 07 22:46:00.302830 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:46:00.302798    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:46:00.303318 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:46:00.303188    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:46:00.303829 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:46:00.303813    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:46:03.799312 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:46:03.799273    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:46:03.799312 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:46:03.799321    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:46:03.811867 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:46:03.811843    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:46:04.205342 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:46:04.205305    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:46:14.384333 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:46:14.384297    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:46:59.549816 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:46:59.549782    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"]
Jul 07 22:47:04.380255 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:04.380220    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:47:14.572882 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.572771    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx" podUID="c65c2a5b-697f-4461-8385-8f6837eb9639" containerName="main" containerID="cri-o://fbf622ccdc85152fce0925edb2696ebe9931a2bbca9cec6b8ef2602ff3f01194" gracePeriod=45
Jul 07 22:47:14.831379 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.831316    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:47:14.962223 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.962155    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-dshm\") pod \"c65c2a5b-697f-4461-8385-8f6837eb9639\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") "
Jul 07 22:47:14.962430 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.962254    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c65c2a5b-697f-4461-8385-8f6837eb9639-tls-certs\") pod \"c65c2a5b-697f-4461-8385-8f6837eb9639\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") "
Jul 07 22:47:14.962430 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.962322    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-tmp-dir\") pod \"c65c2a5b-697f-4461-8385-8f6837eb9639\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") "
Jul 07 22:47:14.962430 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.962368    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-model-cache\") pod \"c65c2a5b-697f-4461-8385-8f6837eb9639\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") "
Jul 07 22:47:14.962430 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.962387    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-home\") pod \"c65c2a5b-697f-4461-8385-8f6837eb9639\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") "
Jul 07 22:47:14.962430 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.962413    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxjnv\" (UniqueName: \"kubernetes.io/projected/c65c2a5b-697f-4461-8385-8f6837eb9639-kube-api-access-bxjnv\") pod \"c65c2a5b-697f-4461-8385-8f6837eb9639\" (UID: \"c65c2a5b-697f-4461-8385-8f6837eb9639\") "
Jul 07 22:47:14.962724 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.962636    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c65c2a5b-697f-4461-8385-8f6837eb9639" (UID: "c65c2a5b-697f-4461-8385-8f6837eb9639"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:47:14.962724 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.962646    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-home" (OuterVolumeSpecName: "home") pod "c65c2a5b-697f-4461-8385-8f6837eb9639" (UID: "c65c2a5b-697f-4461-8385-8f6837eb9639"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:47:14.962724 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.962665    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-model-cache" (OuterVolumeSpecName: "model-cache") pod "c65c2a5b-697f-4461-8385-8f6837eb9639" (UID: "c65c2a5b-697f-4461-8385-8f6837eb9639"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:47:14.964618 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.964592    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c65c2a5b-697f-4461-8385-8f6837eb9639-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c65c2a5b-697f-4461-8385-8f6837eb9639" (UID: "c65c2a5b-697f-4461-8385-8f6837eb9639"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:47:14.964618 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.964592    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-dshm" (OuterVolumeSpecName: "dshm") pod "c65c2a5b-697f-4461-8385-8f6837eb9639" (UID: "c65c2a5b-697f-4461-8385-8f6837eb9639"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:47:14.964810 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:14.964641    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c65c2a5b-697f-4461-8385-8f6837eb9639-kube-api-access-bxjnv" (OuterVolumeSpecName: "kube-api-access-bxjnv") pod "c65c2a5b-697f-4461-8385-8f6837eb9639" (UID: "c65c2a5b-697f-4461-8385-8f6837eb9639"). InnerVolumeSpecName "kube-api-access-bxjnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:47:15.063587 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.063528    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-model-cache\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:15.063587 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.063576    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-home\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:15.063587 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.063590    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxjnv\" (UniqueName: \"kubernetes.io/projected/c65c2a5b-697f-4461-8385-8f6837eb9639-kube-api-access-bxjnv\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:15.063587 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.063604    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-dshm\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:15.063908 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.063614    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c65c2a5b-697f-4461-8385-8f6837eb9639-tls-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:15.063908 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.063623    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c65c2a5b-697f-4461-8385-8f6837eb9639-tmp-dir\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:15.537814 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.537779    2561 generic.go:356] "Generic (PLEG): container finished" podID="c65c2a5b-697f-4461-8385-8f6837eb9639" containerID="fbf622ccdc85152fce0925edb2696ebe9931a2bbca9cec6b8ef2602ff3f01194" exitCode=0
Jul 07 22:47:15.538012 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.537820    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"
Jul 07 22:47:15.538012 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.537864    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx" event={"ID":"c65c2a5b-697f-4461-8385-8f6837eb9639","Type":"ContainerDied","Data":"fbf622ccdc85152fce0925edb2696ebe9931a2bbca9cec6b8ef2602ff3f01194"}
Jul 07 22:47:15.538012 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.537908    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx" event={"ID":"c65c2a5b-697f-4461-8385-8f6837eb9639","Type":"ContainerDied","Data":"713d96caf7f8308785363d3177903aee3ba7b6e111d00fa6f8060d9284c84233"}
Jul 07 22:47:15.538012 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.537925    2561 scope.go:117] "RemoveContainer" containerID="fbf622ccdc85152fce0925edb2696ebe9931a2bbca9cec6b8ef2602ff3f01194"
Jul 07 22:47:15.547298 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.547277    2561 scope.go:117] "RemoveContainer" containerID="fbf622ccdc85152fce0925edb2696ebe9931a2bbca9cec6b8ef2602ff3f01194"
Jul 07 22:47:15.547616 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:47:15.547596    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf622ccdc85152fce0925edb2696ebe9931a2bbca9cec6b8ef2602ff3f01194\": container with ID starting with fbf622ccdc85152fce0925edb2696ebe9931a2bbca9cec6b8ef2602ff3f01194 not found: ID does not exist" containerID="fbf622ccdc85152fce0925edb2696ebe9931a2bbca9cec6b8ef2602ff3f01194"
Jul 07 22:47:15.547662 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.547627    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf622ccdc85152fce0925edb2696ebe9931a2bbca9cec6b8ef2602ff3f01194"} err="failed to get container status \"fbf622ccdc85152fce0925edb2696ebe9931a2bbca9cec6b8ef2602ff3f01194\": rpc error: code = NotFound desc = could not find container \"fbf622ccdc85152fce0925edb2696ebe9931a2bbca9cec6b8ef2602ff3f01194\": container with ID starting with fbf622ccdc85152fce0925edb2696ebe9931a2bbca9cec6b8ef2602ff3f01194 not found: ID does not exist"
Jul 07 22:47:15.560149 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.560120    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"]
Jul 07 22:47:15.564355 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:15.564329    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2de05d/test-model-2de05d-kserve-787d7786cc-77jtx"]
Jul 07 22:47:16.293246 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:16.293185    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c65c2a5b-697f-4461-8385-8f6837eb9639" path="/var/lib/kubelet/pods/c65c2a5b-697f-4461-8385-8f6837eb9639/volumes"
Jul 07 22:47:46.977690 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:46.977643    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:47:50.246048 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:50.246006    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"]
Jul 07 22:47:50.246567 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:50.246359    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx" podUID="51100d6a-f6fd-4511-affd-d43d0a438718" containerName="istio-proxy" containerID="cri-o://13bb62794f1168b7006b9e484c1a7c1a251f61d903b9846434ed057545f7a1c2" gracePeriod=30
Jul 07 22:47:55.507047 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.506983    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:47:55.631521 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.631488    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51100d6a-f6fd-4511-affd-d43d0a438718-istio-token\") pod \"51100d6a-f6fd-4511-affd-d43d0a438718\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") "
Jul 07 22:47:55.631736 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.631549    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51100d6a-f6fd-4511-affd-d43d0a438718-istiod-ca-cert\") pod \"51100d6a-f6fd-4511-affd-d43d0a438718\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") "
Jul 07 22:47:55.631736 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.631599    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51100d6a-f6fd-4511-affd-d43d0a438718-istio-podinfo\") pod \"51100d6a-f6fd-4511-affd-d43d0a438718\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") "
Jul 07 22:47:55.631736 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.631636    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-istio-envoy\") pod \"51100d6a-f6fd-4511-affd-d43d0a438718\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") "
Jul 07 22:47:55.631736 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.631691    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44bwq\" (UniqueName: \"kubernetes.io/projected/51100d6a-f6fd-4511-affd-d43d0a438718-kube-api-access-44bwq\") pod \"51100d6a-f6fd-4511-affd-d43d0a438718\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") "
Jul 07 22:47:55.631949 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.631864    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-istio-data\") pod \"51100d6a-f6fd-4511-affd-d43d0a438718\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") "
Jul 07 22:47:55.632019 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.631961    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-credential-socket\") pod \"51100d6a-f6fd-4511-affd-d43d0a438718\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") "
Jul 07 22:47:55.632019 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.631964    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51100d6a-f6fd-4511-affd-d43d0a438718-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51100d6a-f6fd-4511-affd-d43d0a438718" (UID: "51100d6a-f6fd-4511-affd-d43d0a438718"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:47:55.632019 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.631990    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-workload-certs\") pod \"51100d6a-f6fd-4511-affd-d43d0a438718\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") "
Jul 07 22:47:55.632019 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.632020    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-workload-socket\") pod \"51100d6a-f6fd-4511-affd-d43d0a438718\" (UID: \"51100d6a-f6fd-4511-affd-d43d0a438718\") "
Jul 07 22:47:55.632337 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.632311    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51100d6a-f6fd-4511-affd-d43d0a438718" (UID: "51100d6a-f6fd-4511-affd-d43d0a438718"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:47:55.632466 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.632420    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51100d6a-f6fd-4511-affd-d43d0a438718-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:55.632466 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.632459    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:55.632583 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.632505    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51100d6a-f6fd-4511-affd-d43d0a438718" (UID: "51100d6a-f6fd-4511-affd-d43d0a438718"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:47:55.632710 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.632682    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51100d6a-f6fd-4511-affd-d43d0a438718" (UID: "51100d6a-f6fd-4511-affd-d43d0a438718"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:47:55.633051 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.633007    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-istio-data" (OuterVolumeSpecName: "istio-data") pod "51100d6a-f6fd-4511-affd-d43d0a438718" (UID: "51100d6a-f6fd-4511-affd-d43d0a438718"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:47:55.634024 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.633996    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51100d6a-f6fd-4511-affd-d43d0a438718-kube-api-access-44bwq" (OuterVolumeSpecName: "kube-api-access-44bwq") pod "51100d6a-f6fd-4511-affd-d43d0a438718" (UID: "51100d6a-f6fd-4511-affd-d43d0a438718"). InnerVolumeSpecName "kube-api-access-44bwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:47:55.634133 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.634017    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51100d6a-f6fd-4511-affd-d43d0a438718-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51100d6a-f6fd-4511-affd-d43d0a438718" (UID: "51100d6a-f6fd-4511-affd-d43d0a438718"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 22:47:55.634133 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.634046    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51100d6a-f6fd-4511-affd-d43d0a438718" (UID: "51100d6a-f6fd-4511-affd-d43d0a438718"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:47:55.634133 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.634102    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51100d6a-f6fd-4511-affd-d43d0a438718-istio-token" (OuterVolumeSpecName: "istio-token") pod "51100d6a-f6fd-4511-affd-d43d0a438718" (UID: "51100d6a-f6fd-4511-affd-d43d0a438718"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:47:55.733994 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.733956    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:55.733994 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.733986    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:55.733994 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.733999    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:55.734291 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.734011    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51100d6a-f6fd-4511-affd-d43d0a438718-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:55.734291 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.734022    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51100d6a-f6fd-4511-affd-d43d0a438718-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:55.734291 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.734034    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51100d6a-f6fd-4511-affd-d43d0a438718-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:55.734291 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.734046    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44bwq\" (UniqueName: \"kubernetes.io/projected/51100d6a-f6fd-4511-affd-d43d0a438718-kube-api-access-44bwq\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:47:55.745297 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.745258    2561 generic.go:356] "Generic (PLEG): container finished" podID="51100d6a-f6fd-4511-affd-d43d0a438718" containerID="13bb62794f1168b7006b9e484c1a7c1a251f61d903b9846434ed057545f7a1c2" exitCode=0
Jul 07 22:47:55.745454 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.745319    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"
Jul 07 22:47:55.745454 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.745350    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx" event={"ID":"51100d6a-f6fd-4511-affd-d43d0a438718","Type":"ContainerDied","Data":"13bb62794f1168b7006b9e484c1a7c1a251f61d903b9846434ed057545f7a1c2"}
Jul 07 22:47:55.745454 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.745425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx" event={"ID":"51100d6a-f6fd-4511-affd-d43d0a438718","Type":"ContainerDied","Data":"21dd58a4fd7a9b09570b7b8302cab40492202f6e3d7cf079311d73c0527ddf4f"}
Jul 07 22:47:55.745454 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.745447    2561 scope.go:117] "RemoveContainer" containerID="13bb62794f1168b7006b9e484c1a7c1a251f61d903b9846434ed057545f7a1c2"
Jul 07 22:47:55.755460 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.755441    2561 scope.go:117] "RemoveContainer" containerID="d02075890ba58bdea48a4a5220818b92fa0764a5ac760e1de2bce23fef35400d"
Jul 07 22:47:55.763392 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.763373    2561 scope.go:117] "RemoveContainer" containerID="13bb62794f1168b7006b9e484c1a7c1a251f61d903b9846434ed057545f7a1c2"
Jul 07 22:47:55.763667 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:47:55.763646    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13bb62794f1168b7006b9e484c1a7c1a251f61d903b9846434ed057545f7a1c2\": container with ID starting with 13bb62794f1168b7006b9e484c1a7c1a251f61d903b9846434ed057545f7a1c2 not found: ID does not exist" containerID="13bb62794f1168b7006b9e484c1a7c1a251f61d903b9846434ed057545f7a1c2"
Jul 07 22:47:55.763745 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.763680    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13bb62794f1168b7006b9e484c1a7c1a251f61d903b9846434ed057545f7a1c2"} err="failed to get container status \"13bb62794f1168b7006b9e484c1a7c1a251f61d903b9846434ed057545f7a1c2\": rpc error: code = NotFound desc = could not find container \"13bb62794f1168b7006b9e484c1a7c1a251f61d903b9846434ed057545f7a1c2\": container with ID starting with 13bb62794f1168b7006b9e484c1a7c1a251f61d903b9846434ed057545f7a1c2 not found: ID does not exist"
Jul 07 22:47:55.763745 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.763706    2561 scope.go:117] "RemoveContainer" containerID="d02075890ba58bdea48a4a5220818b92fa0764a5ac760e1de2bce23fef35400d"
Jul 07 22:47:55.763978 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:47:55.763961    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d02075890ba58bdea48a4a5220818b92fa0764a5ac760e1de2bce23fef35400d\": container with ID starting with d02075890ba58bdea48a4a5220818b92fa0764a5ac760e1de2bce23fef35400d not found: ID does not exist" containerID="d02075890ba58bdea48a4a5220818b92fa0764a5ac760e1de2bce23fef35400d"
Jul 07 22:47:55.764016 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.763985    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d02075890ba58bdea48a4a5220818b92fa0764a5ac760e1de2bce23fef35400d"} err="failed to get container status \"d02075890ba58bdea48a4a5220818b92fa0764a5ac760e1de2bce23fef35400d\": rpc error: code = NotFound desc = could not find container \"d02075890ba58bdea48a4a5220818b92fa0764a5ac760e1de2bce23fef35400d\": container with ID starting with d02075890ba58bdea48a4a5220818b92fa0764a5ac760e1de2bce23fef35400d not found: ID does not exist"
Jul 07 22:47:55.766854 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.766829    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"]
Jul 07 22:47:55.770444 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:55.770422    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-346e61-openshift-default-547c6b8c45-7gjsx"]
Jul 07 22:47:56.293404 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:56.293370    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51100d6a-f6fd-4511-affd-d43d0a438718" path="/var/lib/kubelet/pods/51100d6a-f6fd-4511-affd-d43d0a438718/volumes"
Jul 07 22:47:59.935887 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:59.935852    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"]
Jul 07 22:47:59.936267 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:59.936247    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51100d6a-f6fd-4511-affd-d43d0a438718" containerName="istio-proxy"
Jul 07 22:47:59.936267 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:59.936261    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="51100d6a-f6fd-4511-affd-d43d0a438718" containerName="istio-proxy"
Jul 07 22:47:59.936365 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:59.936271    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c65c2a5b-697f-4461-8385-8f6837eb9639" containerName="main"
Jul 07 22:47:59.936365 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:59.936277    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c65c2a5b-697f-4461-8385-8f6837eb9639" containerName="main"
Jul 07 22:47:59.936365 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:59.936285    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51100d6a-f6fd-4511-affd-d43d0a438718" containerName="istio-proxy"
Jul 07 22:47:59.936365 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:59.936292    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="51100d6a-f6fd-4511-affd-d43d0a438718" containerName="istio-proxy"
Jul 07 22:47:59.936365 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:59.936348    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="51100d6a-f6fd-4511-affd-d43d0a438718" containerName="istio-proxy"
Jul 07 22:47:59.936365 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:59.936358    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c65c2a5b-697f-4461-8385-8f6837eb9639" containerName="main"
Jul 07 22:47:59.940927 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:59.940908    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:47:59.943825 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:59.943801    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-17949f-openshift-default-dockercfg-75fj4\""
Jul 07 22:47:59.950575 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:47:59.950552    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"]
Jul 07 22:48:00.071682 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.071645    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-credential-socket\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.071878 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.071714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-workload-certs\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.071878 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.071742    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-token\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.071878 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.071845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-envoy\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.072010 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.071933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-workload-socket\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.072010 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.071986    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqvkw\" (UniqueName: \"kubernetes.io/projected/bbfb88ae-737b-45a3-8674-ac75e6aea14c-kube-api-access-nqvkw\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.072086 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.072056    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istiod-ca-cert\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.072126 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.072091    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-data\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.072126 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.072117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-podinfo\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.173123 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.173085    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-workload-socket\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.173331 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.173146    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvkw\" (UniqueName: \"kubernetes.io/projected/bbfb88ae-737b-45a3-8674-ac75e6aea14c-kube-api-access-nqvkw\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.173331 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.173222    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istiod-ca-cert\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.173331 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.173258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-data\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.173331 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.173291    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-podinfo\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.173331 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.173328    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-credential-socket\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.173628 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.173354    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-workload-certs\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.173628 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.173378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-token\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.173628 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.173504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-envoy\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.173762 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.173660    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-workload-socket\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.173999 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.173973    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istiod-ca-cert\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.173999 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.173986    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-data\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.174313 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.173977    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-credential-socket\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.174313 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.174067    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-workload-certs\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.175846 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.175817    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-envoy\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.175943 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.175879    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-podinfo\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.181559 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.181526    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqvkw\" (UniqueName: \"kubernetes.io/projected/bbfb88ae-737b-45a3-8674-ac75e6aea14c-kube-api-access-nqvkw\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.182275 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.182251    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-token\") pod \"e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") " pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.254258 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.254134    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:00.376515 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.376480    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:48:00.400576 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.400553    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"]
Jul 07 22:48:00.402698 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:48:00.402664    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbfb88ae_737b_45a3_8674_ac75e6aea14c.slice/crio-2a4fb3ab563279f29ca557126f1a8ceaa2ed21423577a975b55e3c8e17584058 WatchSource:0}: Error finding container 2a4fb3ab563279f29ca557126f1a8ceaa2ed21423577a975b55e3c8e17584058: Status 404 returned error can't find the container with id 2a4fb3ab563279f29ca557126f1a8ceaa2ed21423577a975b55e3c8e17584058
Jul 07 22:48:00.405171 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.405131    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:48:00.405280 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.405239    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:48:00.405322 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.405284    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:48:00.770893 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.770857    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp" event={"ID":"bbfb88ae-737b-45a3-8674-ac75e6aea14c","Type":"ContainerStarted","Data":"3a297326df9277541079f31368c4c0e526f12e6a243980d2caa1cf39d6d5fe3c"}
Jul 07 22:48:00.771080 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.770914    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp" event={"ID":"bbfb88ae-737b-45a3-8674-ac75e6aea14c","Type":"ContainerStarted","Data":"2a4fb3ab563279f29ca557126f1a8ceaa2ed21423577a975b55e3c8e17584058"}
Jul 07 22:48:00.789663 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:00.789612    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp" podStartSLOduration=1.7895960359999998 podStartE2EDuration="1.789596036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:48:00.788163093 +0000 UTC m=+2020.104300537" watchObservedRunningTime="2026-07-07 22:48:00.789596036 +0000 UTC m=+2020.105733461"
Jul 07 22:48:01.255349 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:01.255308    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:01.260049 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:01.260024    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:01.775826 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:01.775790    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:01.776615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:01.776598    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:12.871344 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:12.871309    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:48:13.840586 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:13.840495    2561 generic.go:356] "Generic (PLEG): container finished" podID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" containerID="3a297326df9277541079f31368c4c0e526f12e6a243980d2caa1cf39d6d5fe3c" exitCode=0
Jul 07 22:48:13.840815 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:13.840571    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp" event={"ID":"bbfb88ae-737b-45a3-8674-ac75e6aea14c","Type":"ContainerDied","Data":"3a297326df9277541079f31368c4c0e526f12e6a243980d2caa1cf39d6d5fe3c"}
Jul 07 22:48:13.841050 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:13.841033    2561 scope.go:117] "RemoveContainer" containerID="3a297326df9277541079f31368c4c0e526f12e6a243980d2caa1cf39d6d5fe3c"
Jul 07 22:48:13.842106 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:13.842081    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:48:13.842230 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:13.842146    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:48:13.842230 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:13.842175    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:48:14.847737 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:14.847704    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp" event={"ID":"bbfb88ae-737b-45a3-8674-ac75e6aea14c","Type":"ContainerStarted","Data":"7dfc4de53745578f90ba7cdfef42dd06e62e8ec59e61374974cc0d341873a208"}
Jul 07 22:48:15.254747 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:15.254706    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:15.255968 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:15.255938    2561 patch_prober.go:28] interesting pod/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 07 22:48:15.256106 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:15.256001    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp" podUID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 07 22:48:16.255302 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:16.255265    2561 patch_prober.go:28] interesting pod/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 07 22:48:16.255718 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:16.255333    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp" podUID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 07 22:48:16.776541 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:16.776490    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:17.254758 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:17.254717    2561 patch_prober.go:28] interesting pod/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 07 22:48:17.254975 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:17.254778    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp" podUID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 07 22:48:18.254561 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:18.254518    2561 patch_prober.go:28] interesting pod/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body=
Jul 07 22:48:18.255045 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:18.254579    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp" podUID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused"
Jul 07 22:48:19.259006 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:19.258973    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:19.260117 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:19.260098    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:25.873654 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:25.873601    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:48:28.733762 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:28.733730    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"]
Jul 07 22:48:28.736301 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:28.734528    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp" podUID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" containerName="istio-proxy" containerID="cri-o://7dfc4de53745578f90ba7cdfef42dd06e62e8ec59e61374974cc0d341873a208" gracePeriod=30
Jul 07 22:48:33.945080 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:33.945041    2561 generic.go:356] "Generic (PLEG): container finished" podID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" containerID="7dfc4de53745578f90ba7cdfef42dd06e62e8ec59e61374974cc0d341873a208" exitCode=0
Jul 07 22:48:33.945592 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:33.945114    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp" event={"ID":"bbfb88ae-737b-45a3-8674-ac75e6aea14c","Type":"ContainerDied","Data":"7dfc4de53745578f90ba7cdfef42dd06e62e8ec59e61374974cc0d341873a208"}
Jul 07 22:48:33.945592 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:33.945178    2561 scope.go:117] "RemoveContainer" containerID="3a297326df9277541079f31368c4c0e526f12e6a243980d2caa1cf39d6d5fe3c"
Jul 07 22:48:34.001946 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.001871    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:34.091833 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.091796    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-credential-socket\") pod \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") "
Jul 07 22:48:34.092025 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.091849    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqvkw\" (UniqueName: \"kubernetes.io/projected/bbfb88ae-737b-45a3-8674-ac75e6aea14c-kube-api-access-nqvkw\") pod \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") "
Jul 07 22:48:34.092025 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.091882    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-workload-certs\") pod \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") "
Jul 07 22:48:34.092025 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.091930    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istiod-ca-cert\") pod \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") "
Jul 07 22:48:34.092025 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.091951    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-podinfo\") pod \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") "
Jul 07 22:48:34.092295 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.092040    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-data\") pod \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") "
Jul 07 22:48:34.092295 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.092055    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bbfb88ae-737b-45a3-8674-ac75e6aea14c" (UID: "bbfb88ae-737b-45a3-8674-ac75e6aea14c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:48:34.092295 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.092085    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-envoy\") pod \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") "
Jul 07 22:48:34.092295 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.092129    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-workload-socket\") pod \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") "
Jul 07 22:48:34.092295 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.092167    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-token\") pod \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\" (UID: \"bbfb88ae-737b-45a3-8674-ac75e6aea14c\") "
Jul 07 22:48:34.092295 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.092242    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bbfb88ae-737b-45a3-8674-ac75e6aea14c" (UID: "bbfb88ae-737b-45a3-8674-ac75e6aea14c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:48:34.092541 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.092346    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bbfb88ae-737b-45a3-8674-ac75e6aea14c" (UID: "bbfb88ae-737b-45a3-8674-ac75e6aea14c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:48:34.092627 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.092604    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:48:34.092695 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.092630    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:48:34.092695 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.092643    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:48:34.092695 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.092646    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bbfb88ae-737b-45a3-8674-ac75e6aea14c" (UID: "bbfb88ae-737b-45a3-8674-ac75e6aea14c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:48:34.092891 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.092874    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-data" (OuterVolumeSpecName: "istio-data") pod "bbfb88ae-737b-45a3-8674-ac75e6aea14c" (UID: "bbfb88ae-737b-45a3-8674-ac75e6aea14c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:48:34.094369 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.094340    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bbfb88ae-737b-45a3-8674-ac75e6aea14c" (UID: "bbfb88ae-737b-45a3-8674-ac75e6aea14c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:48:34.094491 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.094366    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbfb88ae-737b-45a3-8674-ac75e6aea14c-kube-api-access-nqvkw" (OuterVolumeSpecName: "kube-api-access-nqvkw") pod "bbfb88ae-737b-45a3-8674-ac75e6aea14c" (UID: "bbfb88ae-737b-45a3-8674-ac75e6aea14c"). InnerVolumeSpecName "kube-api-access-nqvkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:48:34.094562 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.094510    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bbfb88ae-737b-45a3-8674-ac75e6aea14c" (UID: "bbfb88ae-737b-45a3-8674-ac75e6aea14c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 22:48:34.094671 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.094655    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-token" (OuterVolumeSpecName: "istio-token") pod "bbfb88ae-737b-45a3-8674-ac75e6aea14c" (UID: "bbfb88ae-737b-45a3-8674-ac75e6aea14c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:48:34.193403 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.193365    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:48:34.193403 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.193397    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:48:34.193403 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.193408    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:48:34.193640 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.193417    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bbfb88ae-737b-45a3-8674-ac75e6aea14c-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:48:34.193640 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.193425    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bbfb88ae-737b-45a3-8674-ac75e6aea14c-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:48:34.193640 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.193433    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqvkw\" (UniqueName: \"kubernetes.io/projected/bbfb88ae-737b-45a3-8674-ac75e6aea14c-kube-api-access-nqvkw\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:48:34.951496 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.951456    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp" event={"ID":"bbfb88ae-737b-45a3-8674-ac75e6aea14c","Type":"ContainerDied","Data":"2a4fb3ab563279f29ca557126f1a8ceaa2ed21423577a975b55e3c8e17584058"}
Jul 07 22:48:34.951936 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.951519    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"
Jul 07 22:48:34.951936 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.951532    2561 scope.go:117] "RemoveContainer" containerID="7dfc4de53745578f90ba7cdfef42dd06e62e8ec59e61374974cc0d341873a208"
Jul 07 22:48:34.967220 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.967166    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"]
Jul 07 22:48:34.971120 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:34.971088    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-17949f-openshift-default-75856bd7d5-w27tp"]
Jul 07 22:48:36.293918 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:36.293885    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" path="/var/lib/kubelet/pods/bbfb88ae-737b-45a3-8674-ac75e6aea14c/volumes"
Jul 07 22:48:36.869563 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:36.869529    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:48:37.854624 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.854594    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"]
Jul 07 22:48:37.855103 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.855058    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" containerName="istio-proxy"
Jul 07 22:48:37.855103 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.855083    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" containerName="istio-proxy"
Jul 07 22:48:37.855256 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.855107    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" containerName="istio-proxy"
Jul 07 22:48:37.855256 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.855115    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" containerName="istio-proxy"
Jul 07 22:48:37.855256 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.855236    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" containerName="istio-proxy"
Jul 07 22:48:37.855256 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.855253    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbfb88ae-737b-45a3-8674-ac75e6aea14c" containerName="istio-proxy"
Jul 07 22:48:37.855470 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.855264    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="51100d6a-f6fd-4511-affd-d43d0a438718" containerName="istio-proxy"
Jul 07 22:48:37.859759 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.859736    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:37.862436 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.862416    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-986e04-openshift-default-dockercfg-xbvvq\""
Jul 07 22:48:37.869489 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.869467    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"]
Jul 07 22:48:37.927261 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.927215    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhgc2\" (UniqueName: \"kubernetes.io/projected/b606bdbd-bf0b-4116-82db-b028b33f8ee3-kube-api-access-fhgc2\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:37.927445 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.927278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-token\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:37.927445 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.927300    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-envoy\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:37.927445 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.927320    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-workload-certs\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:37.927445 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.927351    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istiod-ca-cert\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:37.927445 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.927411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-workload-socket\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:37.927649 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.927467    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-data\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:37.927649 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.927494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-credential-socket\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:37.927649 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:37.927521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-podinfo\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.028590 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.028550    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-workload-certs\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.028783 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.028600    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istiod-ca-cert\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.028783 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.028622    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-workload-socket\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.028783 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.028652    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-data\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.028783 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.028672    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-credential-socket\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.028783 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.028696    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-podinfo\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.028783 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.028740    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhgc2\" (UniqueName: \"kubernetes.io/projected/b606bdbd-bf0b-4116-82db-b028b33f8ee3-kube-api-access-fhgc2\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.028783 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.028779    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-token\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.029142 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.028807    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-envoy\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.029237 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.029134    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-workload-certs\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.029237 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.029173    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-credential-socket\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.029237 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.029190    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-data\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.029411 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.029308    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-workload-socket\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.029469 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.029442    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istiod-ca-cert\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.031211 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.031177    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-envoy\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.031427 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.031408    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-podinfo\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.037595 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.037569    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhgc2\" (UniqueName: \"kubernetes.io/projected/b606bdbd-bf0b-4116-82db-b028b33f8ee3-kube-api-access-fhgc2\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.037698 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.037603    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-token\") pod \"e2e-shared-b-986e04-openshift-default-847596d895-4h54c\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") " pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.173738 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.173636    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:38.316831 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.316802    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"]
Jul 07 22:48:38.318543 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:48:38.318512    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb606bdbd_bf0b_4116_82db_b028b33f8ee3.slice/crio-cc35620f122a10be52433dd12ab6e592782f7e7984b8f251ae77a0d9a8e95c54 WatchSource:0}: Error finding container cc35620f122a10be52433dd12ab6e592782f7e7984b8f251ae77a0d9a8e95c54: Status 404 returned error can't find the container with id cc35620f122a10be52433dd12ab6e592782f7e7984b8f251ae77a0d9a8e95c54
Jul 07 22:48:38.320697 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.320665    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:48:38.320759 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.320729    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:48:38.320802 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.320761    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:48:38.981896 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.981862    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c" event={"ID":"b606bdbd-bf0b-4116-82db-b028b33f8ee3","Type":"ContainerStarted","Data":"2deb7b75c0cbffe30b63c56b3a9af83c5857b07cb6066dd50fa0e7b7c6e2b54f"}
Jul 07 22:48:38.982326 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:38.981918    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c" event={"ID":"b606bdbd-bf0b-4116-82db-b028b33f8ee3","Type":"ContainerStarted","Data":"cc35620f122a10be52433dd12ab6e592782f7e7984b8f251ae77a0d9a8e95c54"}
Jul 07 22:48:39.003256 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:39.003153    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c" podStartSLOduration=2.003137671 podStartE2EDuration="2.003137671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:48:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:48:39.001883759 +0000 UTC m=+2058.318021184" watchObservedRunningTime="2026-07-07 22:48:39.003137671 +0000 UTC m=+2058.319275095"
Jul 07 22:48:39.173839 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:39.173806    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:39.178612 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:39.178576    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:39.994176 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:39.994134    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:39.995102 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:39.995068    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:47.782882 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:47.782795    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:48:55.749833 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:55.749681    2561 patch_prober.go:28] interesting pod/e2e-shared-b-986e04-openshift-default-847596d895-4h54c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": read tcp 10.132.0.2:37796->10.132.0.41:15021: read: connection reset by peer" start-of-body=
Jul 07 22:48:55.749833 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:55.749813    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c" podUID="b606bdbd-bf0b-4116-82db-b028b33f8ee3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": read tcp 10.132.0.2:37796->10.132.0.41:15021: read: connection reset by peer"
Jul 07 22:48:56.071488 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:56.071406    2561 generic.go:356] "Generic (PLEG): container finished" podID="b606bdbd-bf0b-4116-82db-b028b33f8ee3" containerID="2deb7b75c0cbffe30b63c56b3a9af83c5857b07cb6066dd50fa0e7b7c6e2b54f" exitCode=0
Jul 07 22:48:56.071488 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:56.071466    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c" event={"ID":"b606bdbd-bf0b-4116-82db-b028b33f8ee3","Type":"ContainerDied","Data":"2deb7b75c0cbffe30b63c56b3a9af83c5857b07cb6066dd50fa0e7b7c6e2b54f"}
Jul 07 22:48:56.071926 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:56.071912    2561 scope.go:117] "RemoveContainer" containerID="2deb7b75c0cbffe30b63c56b3a9af83c5857b07cb6066dd50fa0e7b7c6e2b54f"
Jul 07 22:48:56.072959 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:56.072930    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:48:56.073054 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:56.073015    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:48:56.073121 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:56.073067    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 07 22:48:57.094222 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:57.093354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c" event={"ID":"b606bdbd-bf0b-4116-82db-b028b33f8ee3","Type":"ContainerStarted","Data":"f3a6145a3ce2bcce43e846e5f99657e997f9d2f4d1fbba6260fb2634fa92e150"}
Jul 07 22:48:57.181480 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:57.181376    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:48:57.181795 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:57.181760    2561 patch_prober.go:28] interesting pod/e2e-shared-b-986e04-openshift-default-847596d895-4h54c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 22:48:57.181923 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:57.181877    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c" podUID="b606bdbd-bf0b-4116-82db-b028b33f8ee3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 22:48:57.380350 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:57.380238    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:48:58.174214 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:58.174147    2561 patch_prober.go:28] interesting pod/e2e-shared-b-986e04-openshift-default-847596d895-4h54c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 22:48:58.174753 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:58.174239    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c" podUID="b606bdbd-bf0b-4116-82db-b028b33f8ee3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 22:48:59.174152 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:59.174106    2561 patch_prober.go:28] interesting pod/e2e-shared-b-986e04-openshift-default-847596d895-4h54c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 22:48:59.174392 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:48:59.174173    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c" podUID="b606bdbd-bf0b-4116-82db-b028b33f8ee3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 22:49:00.174573 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:00.174534    2561 patch_prober.go:28] interesting pod/e2e-shared-b-986e04-openshift-default-847596d895-4h54c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 07 22:49:00.175188 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:00.175150    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c" podUID="b606bdbd-bf0b-4116-82db-b028b33f8ee3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 07 22:49:01.177410 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:01.177377    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:49:01.177807 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:01.177650    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:49:01.178444 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:01.178424    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:49:21.363671 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:21.363642    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:49:21.814643 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:21.814618    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:49:22.177526 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.177441    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"]
Jul 07 22:49:22.180559 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.180541    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.183389 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.183366    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-986e04\"/\"openshift-service-ca.crt\""
Jul 07 22:49:22.184439 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.184419    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-986e04\"/\"default-dockercfg-8wcrj\""
Jul 07 22:49:22.184512 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.184499    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-986e04\"/\"kube-root-ca.crt\""
Jul 07 22:49:22.184561 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.184499    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-986e04\"/\"auth-test-model-986e04-kserve-self-signed-certs\""
Jul 07 22:49:22.188977 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.188957    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"]
Jul 07 22:49:22.228042 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.228005    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-dshm\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.228260 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.228054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-model-cache\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.228260 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.228071    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-tls-certs\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.228260 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.228091    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btlqz\" (UniqueName: \"kubernetes.io/projected/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-kube-api-access-btlqz\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.228260 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.228177    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-home\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.228451 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.228276    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-tmp-dir\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.329220 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.329155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-model-cache\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.329220 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.329223    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-tls-certs\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.329479 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.329252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btlqz\" (UniqueName: \"kubernetes.io/projected/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-kube-api-access-btlqz\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.329479 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.329295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-home\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.329479 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.329343    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-tmp-dir\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.329479 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.329428    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-dshm\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.329698 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.329548    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-model-cache\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.329698 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.329656    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-home\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.329797 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.329754    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-tmp-dir\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.331615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.331589    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-dshm\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.331883 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.331866    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-tls-certs\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.337318 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.337297    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btlqz\" (UniqueName: \"kubernetes.io/projected/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-kube-api-access-btlqz\") pod \"auth-test-model-986e04-kserve-7898dd95f9-8xr45\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") " pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.491898 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.491853    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:22.629225 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:22.629186    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"]
Jul 07 22:49:22.630927 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:49:22.630895    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c7b83c0_9154_4a6b_9d56_07e0661e25e9.slice/crio-3b77a3a84b7151731bb26e713fadcf4d2bb8f4ee39f35dc5453332bd24a06d2d WatchSource:0}: Error finding container 3b77a3a84b7151731bb26e713fadcf4d2bb8f4ee39f35dc5453332bd24a06d2d: Status 404 returned error can't find the container with id 3b77a3a84b7151731bb26e713fadcf4d2bb8f4ee39f35dc5453332bd24a06d2d
Jul 07 22:49:23.220179 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:23.220134    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45" event={"ID":"6c7b83c0-9154-4a6b-9d56-07e0661e25e9","Type":"ContainerStarted","Data":"426ec97a871326a35e47428ebc675b0ceae945dd9f56c10c49c7eef0e2a7082b"}
Jul 07 22:49:23.220179 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:23.220187    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45" event={"ID":"6c7b83c0-9154-4a6b-9d56-07e0661e25e9","Type":"ContainerStarted","Data":"3b77a3a84b7151731bb26e713fadcf4d2bb8f4ee39f35dc5453332bd24a06d2d"}
Jul 07 22:49:23.239487 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:23.239434    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45" podStartSLOduration=1.239417177 podStartE2EDuration="1.239417177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:49:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:49:23.238284185 +0000 UTC m=+2102.554421611" watchObservedRunningTime="2026-07-07 22:49:23.239417177 +0000 UTC m=+2102.555554602"
Jul 07 22:49:25.468396 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:25.468361    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:49:32.492108 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:32.492064    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:32.492609 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:32.492123    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:32.505000 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:32.504974    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:33.281021 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:33.280988    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:49:41.477056 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:41.477019    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:49:54.968461 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:49:54.968424    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:50:12.068989 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:50:12.068954    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:50:29.173348 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:50:29.173316    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:50:44.865615 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:50:44.865577    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:50:59.472270 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:50:59.472230    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:51:14.402354 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:14.402319    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"]
Jul 07 22:51:16.770627 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:16.770595    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:51:29.422951 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.422906    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45" podUID="6c7b83c0-9154-4a6b-9d56-07e0661e25e9" containerName="main" containerID="cri-o://426ec97a871326a35e47428ebc675b0ceae945dd9f56c10c49c7eef0e2a7082b" gracePeriod=45
Jul 07 22:51:29.686082 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.686054    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:51:29.789171 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.789133    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-dshm\") pod \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") "
Jul 07 22:51:29.789362 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.789188    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-model-cache\") pod \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") "
Jul 07 22:51:29.789362 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.789232    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-home\") pod \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") "
Jul 07 22:51:29.789362 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.789269    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-tmp-dir\") pod \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") "
Jul 07 22:51:29.789362 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.789304    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-tls-certs\") pod \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") "
Jul 07 22:51:29.789362 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.789356    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btlqz\" (UniqueName: \"kubernetes.io/projected/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-kube-api-access-btlqz\") pod \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\" (UID: \"6c7b83c0-9154-4a6b-9d56-07e0661e25e9\") "
Jul 07 22:51:29.789621 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.789510    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-home" (OuterVolumeSpecName: "home") pod "6c7b83c0-9154-4a6b-9d56-07e0661e25e9" (UID: "6c7b83c0-9154-4a6b-9d56-07e0661e25e9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:51:29.789621 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.789498    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-model-cache" (OuterVolumeSpecName: "model-cache") pod "6c7b83c0-9154-4a6b-9d56-07e0661e25e9" (UID: "6c7b83c0-9154-4a6b-9d56-07e0661e25e9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:51:29.789621 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.789541    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6c7b83c0-9154-4a6b-9d56-07e0661e25e9" (UID: "6c7b83c0-9154-4a6b-9d56-07e0661e25e9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:51:29.789767 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.789684    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-model-cache\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:51:29.789767 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.789695    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-home\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:51:29.789767 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.789704    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-tmp-dir\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:51:29.791594 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.791561    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-dshm" (OuterVolumeSpecName: "dshm") pod "6c7b83c0-9154-4a6b-9d56-07e0661e25e9" (UID: "6c7b83c0-9154-4a6b-9d56-07e0661e25e9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:51:29.791786 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.791686    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-kube-api-access-btlqz" (OuterVolumeSpecName: "kube-api-access-btlqz") pod "6c7b83c0-9154-4a6b-9d56-07e0661e25e9" (UID: "6c7b83c0-9154-4a6b-9d56-07e0661e25e9"). InnerVolumeSpecName "kube-api-access-btlqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:51:29.791786 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.791774    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6c7b83c0-9154-4a6b-9d56-07e0661e25e9" (UID: "6c7b83c0-9154-4a6b-9d56-07e0661e25e9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:51:29.843132 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.843096    2561 generic.go:356] "Generic (PLEG): container finished" podID="6c7b83c0-9154-4a6b-9d56-07e0661e25e9" containerID="426ec97a871326a35e47428ebc675b0ceae945dd9f56c10c49c7eef0e2a7082b" exitCode=0
Jul 07 22:51:29.843329 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.843139    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"
Jul 07 22:51:29.843329 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.843219    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45" event={"ID":"6c7b83c0-9154-4a6b-9d56-07e0661e25e9","Type":"ContainerDied","Data":"426ec97a871326a35e47428ebc675b0ceae945dd9f56c10c49c7eef0e2a7082b"}
Jul 07 22:51:29.843329 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.843264    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45" event={"ID":"6c7b83c0-9154-4a6b-9d56-07e0661e25e9","Type":"ContainerDied","Data":"3b77a3a84b7151731bb26e713fadcf4d2bb8f4ee39f35dc5453332bd24a06d2d"}
Jul 07 22:51:29.843329 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.843280    2561 scope.go:117] "RemoveContainer" containerID="426ec97a871326a35e47428ebc675b0ceae945dd9f56c10c49c7eef0e2a7082b"
Jul 07 22:51:29.852991 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.852905    2561 scope.go:117] "RemoveContainer" containerID="426ec97a871326a35e47428ebc675b0ceae945dd9f56c10c49c7eef0e2a7082b"
Jul 07 22:51:29.854688 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:51:29.854657    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"426ec97a871326a35e47428ebc675b0ceae945dd9f56c10c49c7eef0e2a7082b\": container with ID starting with 426ec97a871326a35e47428ebc675b0ceae945dd9f56c10c49c7eef0e2a7082b not found: ID does not exist" containerID="426ec97a871326a35e47428ebc675b0ceae945dd9f56c10c49c7eef0e2a7082b"
Jul 07 22:51:29.854805 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.854695    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"426ec97a871326a35e47428ebc675b0ceae945dd9f56c10c49c7eef0e2a7082b"} err="failed to get container status \"426ec97a871326a35e47428ebc675b0ceae945dd9f56c10c49c7eef0e2a7082b\": rpc error: code = NotFound desc = could not find container \"426ec97a871326a35e47428ebc675b0ceae945dd9f56c10c49c7eef0e2a7082b\": container with ID starting with 426ec97a871326a35e47428ebc675b0ceae945dd9f56c10c49c7eef0e2a7082b not found: ID does not exist"
Jul 07 22:51:29.862374 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.862349    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"]
Jul 07 22:51:29.865439 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.865414    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-986e04/auth-test-model-986e04-kserve-7898dd95f9-8xr45"]
Jul 07 22:51:29.890281 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.890254    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-tls-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:51:29.890281 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.890276    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btlqz\" (UniqueName: \"kubernetes.io/projected/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-kube-api-access-btlqz\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:51:29.890281 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:29.890286    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c7b83c0-9154-4a6b-9d56-07e0661e25e9-dshm\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:51:30.071955 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.071874    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"]
Jul 07 22:51:30.072282 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.072266    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c7b83c0-9154-4a6b-9d56-07e0661e25e9" containerName="main"
Jul 07 22:51:30.072342 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.072284    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c7b83c0-9154-4a6b-9d56-07e0661e25e9" containerName="main"
Jul 07 22:51:30.072379 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.072367    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c7b83c0-9154-4a6b-9d56-07e0661e25e9" containerName="main"
Jul 07 22:51:30.075259 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.075241    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.078084 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.078063    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-af2c94\"/\"kube-root-ca.crt\""
Jul 07 22:51:30.078241 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.078107    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-af2c94\"/\"default-dockercfg-l6txc\""
Jul 07 22:51:30.078295 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.078280    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-af2c94\"/\"sub-test-model-af2c94-kserve-self-signed-certs\""
Jul 07 22:51:30.078404 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.078377    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-af2c94\"/\"openshift-service-ca.crt\""
Jul 07 22:51:30.081658 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.081640    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"]
Jul 07 22:51:30.194307 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.194270    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-tmp-dir\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.194497 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.194331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46d55c7f-9f63-46c9-a1ec-56809a3795b2-tls-certs\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.194497 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.194384    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-home\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.194497 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.194446    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-dshm\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.194497 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.194475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-model-cache\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.194668 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.194504    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r95r5\" (UniqueName: \"kubernetes.io/projected/46d55c7f-9f63-46c9-a1ec-56809a3795b2-kube-api-access-r95r5\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.295638 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.295592    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r95r5\" (UniqueName: \"kubernetes.io/projected/46d55c7f-9f63-46c9-a1ec-56809a3795b2-kube-api-access-r95r5\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.295841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.295657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-tmp-dir\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.295841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.295694    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46d55c7f-9f63-46c9-a1ec-56809a3795b2-tls-certs\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.295841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.295765    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-home\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.295841 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.295828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-dshm\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.296038 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.295863    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-model-cache\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.296186 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.296162    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-tmp-dir\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.296270 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.296223    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-model-cache\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.296321 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.296283    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-home\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.298204 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.298162    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-dshm\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.298851 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.298830    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46d55c7f-9f63-46c9-a1ec-56809a3795b2-tls-certs\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.301485 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.301461    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c7b83c0-9154-4a6b-9d56-07e0661e25e9" path="/var/lib/kubelet/pods/6c7b83c0-9154-4a6b-9d56-07e0661e25e9/volumes"
Jul 07 22:51:30.303910 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.303886    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r95r5\" (UniqueName: \"kubernetes.io/projected/46d55c7f-9f63-46c9-a1ec-56809a3795b2-kube-api-access-r95r5\") pod \"sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") " pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.385991 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.385884    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:30.526547 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.526503    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"]
Jul 07 22:51:30.528915 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:51:30.528877    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46d55c7f_9f63_46c9_a1ec_56809a3795b2.slice/crio-b80b5c6cd09fd29ea84f034dbd33cf3d3de105228b64ae00912aa6b10d153963 WatchSource:0}: Error finding container b80b5c6cd09fd29ea84f034dbd33cf3d3de105228b64ae00912aa6b10d153963: Status 404 returned error can't find the container with id b80b5c6cd09fd29ea84f034dbd33cf3d3de105228b64ae00912aa6b10d153963
Jul 07 22:51:30.849998 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.849955    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm" event={"ID":"46d55c7f-9f63-46c9-a1ec-56809a3795b2","Type":"ContainerStarted","Data":"b850f2b3d3bcf11ada0cfad9aefe35b91ff35f7cacb5d08f7857695b166ae8bc"}
Jul 07 22:51:30.849998 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.850003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm" event={"ID":"46d55c7f-9f63-46c9-a1ec-56809a3795b2","Type":"ContainerStarted","Data":"b80b5c6cd09fd29ea84f034dbd33cf3d3de105228b64ae00912aa6b10d153963"}
Jul 07 22:51:30.866077 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:30.866022    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm" podStartSLOduration=0.866005671 podStartE2EDuration="866.005671ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:51:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:51:30.864421354 +0000 UTC m=+2230.180558779" watchObservedRunningTime="2026-07-07 22:51:30.866005671 +0000 UTC m=+2230.182143096"
Jul 07 22:51:33.574649 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:33.574612    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:51:40.386918 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:40.386866    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:40.387390 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:40.386945    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:40.399701 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:40.399671    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:40.912530 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:40.912493    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:51:58.787145 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:51:58.787064    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:52:11.768945 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:11.768898    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:52:30.373003 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:30.372966    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:52:35.356609 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:35.356572    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"]
Jul 07 22:52:47.784755 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:47.784718    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:52:50.377023 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.376979    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm" podUID="46d55c7f-9f63-46c9-a1ec-56809a3795b2" containerName="main" containerID="cri-o://b850f2b3d3bcf11ada0cfad9aefe35b91ff35f7cacb5d08f7857695b166ae8bc" gracePeriod=45
Jul 07 22:52:50.642086 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.642019    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:52:50.742657 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.742617    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-model-cache\") pod \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") "
Jul 07 22:52:50.742837 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.742679    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46d55c7f-9f63-46c9-a1ec-56809a3795b2-tls-certs\") pod \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") "
Jul 07 22:52:50.742837 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.742710    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r95r5\" (UniqueName: \"kubernetes.io/projected/46d55c7f-9f63-46c9-a1ec-56809a3795b2-kube-api-access-r95r5\") pod \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") "
Jul 07 22:52:50.742837 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.742734    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-home\") pod \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") "
Jul 07 22:52:50.742837 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.742751    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-dshm\") pod \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") "
Jul 07 22:52:50.742837 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.742801    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-tmp-dir\") pod \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\" (UID: \"46d55c7f-9f63-46c9-a1ec-56809a3795b2\") "
Jul 07 22:52:50.743109 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.742925    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-model-cache" (OuterVolumeSpecName: "model-cache") pod "46d55c7f-9f63-46c9-a1ec-56809a3795b2" (UID: "46d55c7f-9f63-46c9-a1ec-56809a3795b2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:52:50.743109 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.743042    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-home" (OuterVolumeSpecName: "home") pod "46d55c7f-9f63-46c9-a1ec-56809a3795b2" (UID: "46d55c7f-9f63-46c9-a1ec-56809a3795b2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:52:50.743271 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.743224    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "46d55c7f-9f63-46c9-a1ec-56809a3795b2" (UID: "46d55c7f-9f63-46c9-a1ec-56809a3795b2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:52:50.743315 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.743274    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-model-cache\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:52:50.743315 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.743293    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-home\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:52:50.745214 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.745162    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-dshm" (OuterVolumeSpecName: "dshm") pod "46d55c7f-9f63-46c9-a1ec-56809a3795b2" (UID: "46d55c7f-9f63-46c9-a1ec-56809a3795b2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:52:50.745214 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.745173    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46d55c7f-9f63-46c9-a1ec-56809a3795b2-kube-api-access-r95r5" (OuterVolumeSpecName: "kube-api-access-r95r5") pod "46d55c7f-9f63-46c9-a1ec-56809a3795b2" (UID: "46d55c7f-9f63-46c9-a1ec-56809a3795b2"). InnerVolumeSpecName "kube-api-access-r95r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:52:50.745380 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.745241    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46d55c7f-9f63-46c9-a1ec-56809a3795b2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "46d55c7f-9f63-46c9-a1ec-56809a3795b2" (UID: "46d55c7f-9f63-46c9-a1ec-56809a3795b2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:52:50.844458 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.844419    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46d55c7f-9f63-46c9-a1ec-56809a3795b2-tls-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:52:50.844458 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.844452    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r95r5\" (UniqueName: \"kubernetes.io/projected/46d55c7f-9f63-46c9-a1ec-56809a3795b2-kube-api-access-r95r5\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:52:50.844458 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.844465    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-dshm\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:52:50.844701 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:50.844475    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46d55c7f-9f63-46c9-a1ec-56809a3795b2-tmp-dir\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:52:51.256133 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:51.256092    2561 generic.go:356] "Generic (PLEG): container finished" podID="46d55c7f-9f63-46c9-a1ec-56809a3795b2" containerID="b850f2b3d3bcf11ada0cfad9aefe35b91ff35f7cacb5d08f7857695b166ae8bc" exitCode=0
Jul 07 22:52:51.256324 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:51.256140    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"
Jul 07 22:52:51.256324 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:51.256148    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm" event={"ID":"46d55c7f-9f63-46c9-a1ec-56809a3795b2","Type":"ContainerDied","Data":"b850f2b3d3bcf11ada0cfad9aefe35b91ff35f7cacb5d08f7857695b166ae8bc"}
Jul 07 22:52:51.256324 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:51.256240    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm" event={"ID":"46d55c7f-9f63-46c9-a1ec-56809a3795b2","Type":"ContainerDied","Data":"b80b5c6cd09fd29ea84f034dbd33cf3d3de105228b64ae00912aa6b10d153963"}
Jul 07 22:52:51.256324 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:51.256265    2561 scope.go:117] "RemoveContainer" containerID="b850f2b3d3bcf11ada0cfad9aefe35b91ff35f7cacb5d08f7857695b166ae8bc"
Jul 07 22:52:51.265498 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:51.265475    2561 scope.go:117] "RemoveContainer" containerID="b850f2b3d3bcf11ada0cfad9aefe35b91ff35f7cacb5d08f7857695b166ae8bc"
Jul 07 22:52:51.265774 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:52:51.265756    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b850f2b3d3bcf11ada0cfad9aefe35b91ff35f7cacb5d08f7857695b166ae8bc\": container with ID starting with b850f2b3d3bcf11ada0cfad9aefe35b91ff35f7cacb5d08f7857695b166ae8bc not found: ID does not exist" containerID="b850f2b3d3bcf11ada0cfad9aefe35b91ff35f7cacb5d08f7857695b166ae8bc"
Jul 07 22:52:51.265826 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:51.265783    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b850f2b3d3bcf11ada0cfad9aefe35b91ff35f7cacb5d08f7857695b166ae8bc"} err="failed to get container status \"b850f2b3d3bcf11ada0cfad9aefe35b91ff35f7cacb5d08f7857695b166ae8bc\": rpc error: code = NotFound desc = could not find container \"b850f2b3d3bcf11ada0cfad9aefe35b91ff35f7cacb5d08f7857695b166ae8bc\": container with ID starting with b850f2b3d3bcf11ada0cfad9aefe35b91ff35f7cacb5d08f7857695b166ae8bc not found: ID does not exist"
Jul 07 22:52:51.277821 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:51.277789    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"]
Jul 07 22:52:51.283635 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:51.283611    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-af2c94/sub-test-model-af2c94-kserve-6d6d5dc4bf-8rzhm"]
Jul 07 22:52:52.293482 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:52:52.293448    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46d55c7f-9f63-46c9-a1ec-56809a3795b2" path="/var/lib/kubelet/pods/46d55c7f-9f63-46c9-a1ec-56809a3795b2/volumes"
Jul 07 22:53:00.413991 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.413953    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"]
Jul 07 22:53:00.414408 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.414325    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46d55c7f-9f63-46c9-a1ec-56809a3795b2" containerName="main"
Jul 07 22:53:00.414408 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.414337    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="46d55c7f-9f63-46c9-a1ec-56809a3795b2" containerName="main"
Jul 07 22:53:00.414408 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.414392    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="46d55c7f-9f63-46c9-a1ec-56809a3795b2" containerName="main"
Jul 07 22:53:00.417261 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.417244    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.421685 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.421658    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-986e04\"/\"default-dockercfg-8wcrj\""
Jul 07 22:53:00.421834 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.421655    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-986e04\"/\"rate-test-model-986e04-kserve-self-signed-certs\""
Jul 07 22:53:00.421834 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.421663    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-986e04\"/\"openshift-service-ca.crt\""
Jul 07 22:53:00.421978 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.421965    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-986e04\"/\"kube-root-ca.crt\""
Jul 07 22:53:00.429902 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.429879    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"]
Jul 07 22:53:00.533180 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.533137    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-tmp-dir\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.533180 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.533179    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-tls-certs\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.533465 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.533323    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-home\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.533465 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.533376    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-dshm\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.533465 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.533411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6lth\" (UniqueName: \"kubernetes.io/projected/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-kube-api-access-r6lth\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.533465 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.533433    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-model-cache\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.634670 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.634626    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-tmp-dir\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.634670 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.634671    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-tls-certs\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.634923 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.634733    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-home\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.634923 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.634762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-dshm\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.634923 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.634784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6lth\" (UniqueName: \"kubernetes.io/projected/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-kube-api-access-r6lth\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.634923 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.634816    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-model-cache\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.635151 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.635121    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-tmp-dir\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.635247 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.635184    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-home\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.635364 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.635343    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-model-cache\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.637080 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.637052    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-dshm\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.637416 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.637396    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-tls-certs\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.648879 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.648853    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6lth\" (UniqueName: \"kubernetes.io/projected/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-kube-api-access-r6lth\") pod \"rate-test-model-986e04-kserve-5f7859f675-dxcmm\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") " pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.726658 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.726623    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:00.876874 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:00.876831    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"]
Jul 07 22:53:00.879220 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:53:00.879177    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod346ffbcd_7b0a_425d_bbcb_c11811b6d0b8.slice/crio-39568ec5a04cc1deb80e0880a2603ae70d30d74971219e7badae8355112f2395 WatchSource:0}: Error finding container 39568ec5a04cc1deb80e0880a2603ae70d30d74971219e7badae8355112f2395: Status 404 returned error can't find the container with id 39568ec5a04cc1deb80e0880a2603ae70d30d74971219e7badae8355112f2395
Jul 07 22:53:01.305674 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:01.305640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm" event={"ID":"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8","Type":"ContainerStarted","Data":"0fb2e4f8b8b7545b7afe5c580c0af35919ac7f669d0dd811046a5553b9f17b9d"}
Jul 07 22:53:01.305674 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:01.305683    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm" event={"ID":"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8","Type":"ContainerStarted","Data":"39568ec5a04cc1deb80e0880a2603ae70d30d74971219e7badae8355112f2395"}
Jul 07 22:53:01.328347 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:01.328270    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm" podStartSLOduration=1.328253253 podStartE2EDuration="1.328253253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 22:53:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:53:01.326175217 +0000 UTC m=+2320.642312643" watchObservedRunningTime="2026-07-07 22:53:01.328253253 +0000 UTC m=+2320.644390677"
Jul 07 22:53:05.586053 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:05.586010    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:53:10.727381 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:10.727344    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:10.727871 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:10.727398    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:10.743306 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:10.743275    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:11.363299 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:11.363268    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:19.093137 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:19.093046    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:53:33.402070 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:33.402030    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:53:40.770129 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:40.770093    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"]
Jul 07 22:53:46.992048 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:46.992012    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:53:55.790243 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:55.790081    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm" podUID="346ffbcd-7b0a-425d-bbcb-c11811b6d0b8" containerName="main" containerID="cri-o://0fb2e4f8b8b7545b7afe5c580c0af35919ac7f669d0dd811046a5553b9f17b9d" gracePeriod=45
Jul 07 22:53:56.047988 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.047925    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:56.136678 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.136644    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-home\") pod \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") "
Jul 07 22:53:56.136880 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.136698    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-tmp-dir\") pod \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") "
Jul 07 22:53:56.136880 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.136735    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-model-cache\") pod \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") "
Jul 07 22:53:56.136880 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.136803    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-tls-certs\") pod \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") "
Jul 07 22:53:56.136880 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.136843    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-dshm\") pod \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") "
Jul 07 22:53:56.137109 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.136887    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6lth\" (UniqueName: \"kubernetes.io/projected/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-kube-api-access-r6lth\") pod \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\" (UID: \"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8\") "
Jul 07 22:53:56.137109 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.136983    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-home" (OuterVolumeSpecName: "home") pod "346ffbcd-7b0a-425d-bbcb-c11811b6d0b8" (UID: "346ffbcd-7b0a-425d-bbcb-c11811b6d0b8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:53:56.137109 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.137046    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "346ffbcd-7b0a-425d-bbcb-c11811b6d0b8" (UID: "346ffbcd-7b0a-425d-bbcb-c11811b6d0b8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:53:56.137109 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.137060    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-model-cache" (OuterVolumeSpecName: "model-cache") pod "346ffbcd-7b0a-425d-bbcb-c11811b6d0b8" (UID: "346ffbcd-7b0a-425d-bbcb-c11811b6d0b8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:53:56.137354 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.137340    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-tmp-dir\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:53:56.137405 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.137362    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-model-cache\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:53:56.137405 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.137376    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-home\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:53:56.139227 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.139168    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-dshm" (OuterVolumeSpecName: "dshm") pod "346ffbcd-7b0a-425d-bbcb-c11811b6d0b8" (UID: "346ffbcd-7b0a-425d-bbcb-c11811b6d0b8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:53:56.139227 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.139206    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-kube-api-access-r6lth" (OuterVolumeSpecName: "kube-api-access-r6lth") pod "346ffbcd-7b0a-425d-bbcb-c11811b6d0b8" (UID: "346ffbcd-7b0a-425d-bbcb-c11811b6d0b8"). InnerVolumeSpecName "kube-api-access-r6lth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:53:56.139374 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.139225    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "346ffbcd-7b0a-425d-bbcb-c11811b6d0b8" (UID: "346ffbcd-7b0a-425d-bbcb-c11811b6d0b8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 22:53:56.238699 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.238661    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-tls-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:53:56.238699 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.238690    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-dshm\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:53:56.238699 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.238700    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6lth\" (UniqueName: \"kubernetes.io/projected/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8-kube-api-access-r6lth\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:53:56.576323 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.576220    2561 generic.go:356] "Generic (PLEG): container finished" podID="346ffbcd-7b0a-425d-bbcb-c11811b6d0b8" containerID="0fb2e4f8b8b7545b7afe5c580c0af35919ac7f669d0dd811046a5553b9f17b9d" exitCode=0
Jul 07 22:53:56.576323 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.576267    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"
Jul 07 22:53:56.576323 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.576307    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm" event={"ID":"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8","Type":"ContainerDied","Data":"0fb2e4f8b8b7545b7afe5c580c0af35919ac7f669d0dd811046a5553b9f17b9d"}
Jul 07 22:53:56.576606 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.576366    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm" event={"ID":"346ffbcd-7b0a-425d-bbcb-c11811b6d0b8","Type":"ContainerDied","Data":"39568ec5a04cc1deb80e0880a2603ae70d30d74971219e7badae8355112f2395"}
Jul 07 22:53:56.576606 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.576389    2561 scope.go:117] "RemoveContainer" containerID="0fb2e4f8b8b7545b7afe5c580c0af35919ac7f669d0dd811046a5553b9f17b9d"
Jul 07 22:53:56.585240 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.585215    2561 scope.go:117] "RemoveContainer" containerID="0fb2e4f8b8b7545b7afe5c580c0af35919ac7f669d0dd811046a5553b9f17b9d"
Jul 07 22:53:56.585522 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:53:56.585503    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fb2e4f8b8b7545b7afe5c580c0af35919ac7f669d0dd811046a5553b9f17b9d\": container with ID starting with 0fb2e4f8b8b7545b7afe5c580c0af35919ac7f669d0dd811046a5553b9f17b9d not found: ID does not exist" containerID="0fb2e4f8b8b7545b7afe5c580c0af35919ac7f669d0dd811046a5553b9f17b9d"
Jul 07 22:53:56.585585 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.585531    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb2e4f8b8b7545b7afe5c580c0af35919ac7f669d0dd811046a5553b9f17b9d"} err="failed to get container status \"0fb2e4f8b8b7545b7afe5c580c0af35919ac7f669d0dd811046a5553b9f17b9d\": rpc error: code = NotFound desc = could not find container \"0fb2e4f8b8b7545b7afe5c580c0af35919ac7f669d0dd811046a5553b9f17b9d\": container with ID starting with 0fb2e4f8b8b7545b7afe5c580c0af35919ac7f669d0dd811046a5553b9f17b9d not found: ID does not exist"
Jul 07 22:53:56.602916 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.602887    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"]
Jul 07 22:53:56.609485 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:56.609459    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-986e04/rate-test-model-986e04-kserve-5f7859f675-dxcmm"]
Jul 07 22:53:58.294282 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:53:58.294247    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="346ffbcd-7b0a-425d-bbcb-c11811b6d0b8" path="/var/lib/kubelet/pods/346ffbcd-7b0a-425d-bbcb-c11811b6d0b8/volumes"
Jul 07 22:54:21.392911 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:21.392885    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:54:21.841808 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:21.841778    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:54:27.872665 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:27.872622    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6x84p"]
Jul 07 22:54:31.905683 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:31.905649    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"]
Jul 07 22:54:31.906114 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:31.905870    2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c" podUID="b606bdbd-bf0b-4116-82db-b028b33f8ee3" containerName="istio-proxy" containerID="cri-o://f3a6145a3ce2bcce43e846e5f99657e997f9d2f4d1fbba6260fb2634fa92e150" gracePeriod=30
Jul 07 22:54:37.162680 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.162651    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:54:37.310305 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310270    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-data\") pod \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") "
Jul 07 22:54:37.310305 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310311    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-workload-socket\") pod \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") "
Jul 07 22:54:37.310543 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310331    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-credential-socket\") pod \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") "
Jul 07 22:54:37.310543 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310348    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-token\") pod \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") "
Jul 07 22:54:37.310543 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310389    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-envoy\") pod \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") "
Jul 07 22:54:37.310543 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310429    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhgc2\" (UniqueName: \"kubernetes.io/projected/b606bdbd-bf0b-4116-82db-b028b33f8ee3-kube-api-access-fhgc2\") pod \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") "
Jul 07 22:54:37.310543 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310507    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-workload-certs\") pod \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") "
Jul 07 22:54:37.310543 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310530    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-podinfo\") pod \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") "
Jul 07 22:54:37.310853 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310555    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istiod-ca-cert\") pod \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\" (UID: \"b606bdbd-bf0b-4116-82db-b028b33f8ee3\") "
Jul 07 22:54:37.310853 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310614    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b606bdbd-bf0b-4116-82db-b028b33f8ee3" (UID: "b606bdbd-bf0b-4116-82db-b028b33f8ee3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:54:37.310853 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310631    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b606bdbd-bf0b-4116-82db-b028b33f8ee3" (UID: "b606bdbd-bf0b-4116-82db-b028b33f8ee3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:54:37.310853 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310823    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b606bdbd-bf0b-4116-82db-b028b33f8ee3" (UID: "b606bdbd-bf0b-4116-82db-b028b33f8ee3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:54:37.311058 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310894    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-workload-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:54:37.311058 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310914    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-credential-socket\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:54:37.311058 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.310940    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b606bdbd-bf0b-4116-82db-b028b33f8ee3" (UID: "b606bdbd-bf0b-4116-82db-b028b33f8ee3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 22:54:37.311380 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.311354    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-data" (OuterVolumeSpecName: "istio-data") pod "b606bdbd-bf0b-4116-82db-b028b33f8ee3" (UID: "b606bdbd-bf0b-4116-82db-b028b33f8ee3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:54:37.312767 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.312739    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b606bdbd-bf0b-4116-82db-b028b33f8ee3" (UID: "b606bdbd-bf0b-4116-82db-b028b33f8ee3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 22:54:37.312767 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.312752    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-token" (OuterVolumeSpecName: "istio-token") pod "b606bdbd-bf0b-4116-82db-b028b33f8ee3" (UID: "b606bdbd-bf0b-4116-82db-b028b33f8ee3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:54:37.312941 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.312779    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b606bdbd-bf0b-4116-82db-b028b33f8ee3" (UID: "b606bdbd-bf0b-4116-82db-b028b33f8ee3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 22:54:37.312941 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.312871    2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b606bdbd-bf0b-4116-82db-b028b33f8ee3-kube-api-access-fhgc2" (OuterVolumeSpecName: "kube-api-access-fhgc2") pod "b606bdbd-bf0b-4116-82db-b028b33f8ee3" (UID: "b606bdbd-bf0b-4116-82db-b028b33f8ee3"). InnerVolumeSpecName "kube-api-access-fhgc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 22:54:37.411510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.411475    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhgc2\" (UniqueName: \"kubernetes.io/projected/b606bdbd-bf0b-4116-82db-b028b33f8ee3-kube-api-access-fhgc2\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:54:37.411510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.411504    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-workload-certs\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:54:37.411510 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.411517    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-podinfo\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:54:37.411764 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.411528    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istiod-ca-cert\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:54:37.411764 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.411541    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-data\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:54:37.411764 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.411551    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-token\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:54:37.411764 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.411562    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b606bdbd-bf0b-4116-82db-b028b33f8ee3-istio-envoy\") on node \"ip-10-0-128-229.ec2.internal\" DevicePath \"\""
Jul 07 22:54:37.413798 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.413774    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724390-dm7b8_7be6eff1-e84d-4fb2-bfae-e846254cb294/cleanup/0.log"
Jul 07 22:54:37.524103 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.524067    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724405-4rx5w_6c3f3830-7ba3-4a0c-a7c9-645c55644e67/cleanup/0.log"
Jul 07 22:54:37.770646 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.770615    2561 generic.go:356] "Generic (PLEG): container finished" podID="b606bdbd-bf0b-4116-82db-b028b33f8ee3" containerID="f3a6145a3ce2bcce43e846e5f99657e997f9d2f4d1fbba6260fb2634fa92e150" exitCode=0
Jul 07 22:54:37.770819 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.770662    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"
Jul 07 22:54:37.770819 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.770699    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c" event={"ID":"b606bdbd-bf0b-4116-82db-b028b33f8ee3","Type":"ContainerDied","Data":"f3a6145a3ce2bcce43e846e5f99657e997f9d2f4d1fbba6260fb2634fa92e150"}
Jul 07 22:54:37.770819 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.770755    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c" event={"ID":"b606bdbd-bf0b-4116-82db-b028b33f8ee3","Type":"ContainerDied","Data":"cc35620f122a10be52433dd12ab6e592782f7e7984b8f251ae77a0d9a8e95c54"}
Jul 07 22:54:37.770819 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.770788    2561 scope.go:117] "RemoveContainer" containerID="f3a6145a3ce2bcce43e846e5f99657e997f9d2f4d1fbba6260fb2634fa92e150"
Jul 07 22:54:37.780150 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.780131    2561 scope.go:117] "RemoveContainer" containerID="2deb7b75c0cbffe30b63c56b3a9af83c5857b07cb6066dd50fa0e7b7c6e2b54f"
Jul 07 22:54:37.788334 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.788313    2561 scope.go:117] "RemoveContainer" containerID="f3a6145a3ce2bcce43e846e5f99657e997f9d2f4d1fbba6260fb2634fa92e150"
Jul 07 22:54:37.788593 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:54:37.788576    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3a6145a3ce2bcce43e846e5f99657e997f9d2f4d1fbba6260fb2634fa92e150\": container with ID starting with f3a6145a3ce2bcce43e846e5f99657e997f9d2f4d1fbba6260fb2634fa92e150 not found: ID does not exist" containerID="f3a6145a3ce2bcce43e846e5f99657e997f9d2f4d1fbba6260fb2634fa92e150"
Jul 07 22:54:37.788662 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.788600    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3a6145a3ce2bcce43e846e5f99657e997f9d2f4d1fbba6260fb2634fa92e150"} err="failed to get container status \"f3a6145a3ce2bcce43e846e5f99657e997f9d2f4d1fbba6260fb2634fa92e150\": rpc error: code = NotFound desc = could not find container \"f3a6145a3ce2bcce43e846e5f99657e997f9d2f4d1fbba6260fb2634fa92e150\": container with ID starting with f3a6145a3ce2bcce43e846e5f99657e997f9d2f4d1fbba6260fb2634fa92e150 not found: ID does not exist"
Jul 07 22:54:37.788662 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.788616    2561 scope.go:117] "RemoveContainer" containerID="2deb7b75c0cbffe30b63c56b3a9af83c5857b07cb6066dd50fa0e7b7c6e2b54f"
Jul 07 22:54:37.788877 ip-10-0-128-229 kubenswrapper[2561]: E0707 22:54:37.788860    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2deb7b75c0cbffe30b63c56b3a9af83c5857b07cb6066dd50fa0e7b7c6e2b54f\": container with ID starting with 2deb7b75c0cbffe30b63c56b3a9af83c5857b07cb6066dd50fa0e7b7c6e2b54f not found: ID does not exist" containerID="2deb7b75c0cbffe30b63c56b3a9af83c5857b07cb6066dd50fa0e7b7c6e2b54f"
Jul 07 22:54:37.788919 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.788887    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2deb7b75c0cbffe30b63c56b3a9af83c5857b07cb6066dd50fa0e7b7c6e2b54f"} err="failed to get container status \"2deb7b75c0cbffe30b63c56b3a9af83c5857b07cb6066dd50fa0e7b7c6e2b54f\": rpc error: code = NotFound desc = could not find container \"2deb7b75c0cbffe30b63c56b3a9af83c5857b07cb6066dd50fa0e7b7c6e2b54f\": container with ID starting with 2deb7b75c0cbffe30b63c56b3a9af83c5857b07cb6066dd50fa0e7b7c6e2b54f not found: ID does not exist"
Jul 07 22:54:37.792577 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.792552    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"]
Jul 07 22:54:37.796719 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:37.796694    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-986e04-openshift-default-847596d895-4h54c"]
Jul 07 22:54:38.206077 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:38.206054    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch_cb80a9b1-862f-4002-a2a5-2ad302b2f969/copy-manifests/0.log"
Jul 07 22:54:38.218443 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:38.218417    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch_cb80a9b1-862f-4002-a2a5-2ad302b2f969/manager/0.log"
Jul 07 22:54:38.293436 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:38.293398    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b606bdbd-bf0b-4116-82db-b028b33f8ee3" path="/var/lib/kubelet/pods/b606bdbd-bf0b-4116-82db-b028b33f8ee3/volumes"
Jul 07 22:54:39.730255 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:39.730221    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-f8s6n_4d5bd86b-77fd-499f-816f-34323721ebd5/manager/0.log"
Jul 07 22:54:40.306035 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:40.306000    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6x84p_8603929d-cb30-4473-9b76-b41e9abd69e1/limitador/0.log"
Jul 07 22:54:40.778856 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:40.778821    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4v94rh_17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb/istio-proxy/0.log"
Jul 07 22:54:41.230431 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:41.230393    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xc84c_9b6a4a1d-06a2-45d1-bde0-558a2e03fd86/istio-proxy/1.log"
Jul 07 22:54:41.588103 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:41.588023    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b8948f45-trjld_b578bb6c-1572-4342-be6c-d10f04301077/router/0.log"
Jul 07 22:54:42.153181 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:42.153152    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-vq874_c5b753d1-d661-4fb1-994e-f333b2a13ea3/main/0.log"
Jul 07 22:54:49.425677 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:49.425598    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7rp6t_a7b9c7c7-f0ee-45dd-8d3b-b2ca737b3d8c/global-pull-secret-syncer/0.log"
Jul 07 22:54:49.635875 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:49.635839    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ltjqr_e35cf280-f6da-4851-821d-84c40d15a85f/konnectivity-agent/0.log"
Jul 07 22:54:49.682594 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:49.682571    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-229.ec2.internal_651afb1b5549eafbdf78c97ea2bcc023/haproxy/0.log"
Jul 07 22:54:54.623464 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:54.623431    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-f8s6n_4d5bd86b-77fd-499f-816f-34323721ebd5/manager/0.log"
Jul 07 22:54:54.896489 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:54.896407    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6x84p_8603929d-cb30-4473-9b76-b41e9abd69e1/limitador/0.log"
Jul 07 22:54:56.811298 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:56.811271    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-4mk9h_042e7349-698d-48f3-8af4-4fb44cb9352c/cluster-monitoring-operator/0.log"
Jul 07 22:54:57.161742 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:57.161619    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-whldw_5f5089c0-1ac1-4843-b358-7741aed113c0/node-exporter/0.log"
Jul 07 22:54:57.185533 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:57.185486    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-whldw_5f5089c0-1ac1-4843-b358-7741aed113c0/kube-rbac-proxy/0.log"
Jul 07 22:54:57.209379 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:57.209353    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-whldw_5f5089c0-1ac1-4843-b358-7741aed113c0/init-textfile/0.log"
Jul 07 22:54:58.935761 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:58.935735    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-5b9f6_19eac3ab-96ae-45bd-a521-26becaa7f563/networking-console-plugin/0.log"
Jul 07 22:54:59.445532 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.445494    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"]
Jul 07 22:54:59.445915 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.445899    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b606bdbd-bf0b-4116-82db-b028b33f8ee3" containerName="istio-proxy"
Jul 07 22:54:59.445968 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.445919    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b606bdbd-bf0b-4116-82db-b028b33f8ee3" containerName="istio-proxy"
Jul 07 22:54:59.445968 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.445952    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="346ffbcd-7b0a-425d-bbcb-c11811b6d0b8" containerName="main"
Jul 07 22:54:59.445968 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.445957    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="346ffbcd-7b0a-425d-bbcb-c11811b6d0b8" containerName="main"
Jul 07 22:54:59.446067 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.446043    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b606bdbd-bf0b-4116-82db-b028b33f8ee3" containerName="istio-proxy"
Jul 07 22:54:59.446067 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.446053    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="346ffbcd-7b0a-425d-bbcb-c11811b6d0b8" containerName="main"
Jul 07 22:54:59.449279 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.449254    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.452421 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.452392    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xs5cp\"/\"openshift-service-ca.crt\""
Jul 07 22:54:59.452565 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.452542    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xs5cp\"/\"default-dockercfg-7sh64\""
Jul 07 22:54:59.458339 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.457109    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xs5cp\"/\"kube-root-ca.crt\""
Jul 07 22:54:59.462800 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.462775    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"]
Jul 07 22:54:59.514098 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.514058    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc6k5\" (UniqueName: \"kubernetes.io/projected/704efc2f-fb1e-42ae-9532-5f578ee4b887-kube-api-access-wc6k5\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.514314 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.514106    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/704efc2f-fb1e-42ae-9532-5f578ee4b887-proc\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.514314 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.514205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/704efc2f-fb1e-42ae-9532-5f578ee4b887-sys\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.514314 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.514237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/704efc2f-fb1e-42ae-9532-5f578ee4b887-lib-modules\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.514314 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.514258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/704efc2f-fb1e-42ae-9532-5f578ee4b887-podres\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.569805 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.569747    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/1.log"
Jul 07 22:54:59.575607 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.575583    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-j6ggt_4b45fd96-0bc5-4293-8f54-c477274177fe/console-operator/2.log"
Jul 07 22:54:59.614750 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.614712    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/704efc2f-fb1e-42ae-9532-5f578ee4b887-lib-modules\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.614750 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.614751    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/704efc2f-fb1e-42ae-9532-5f578ee4b887-podres\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.615012 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.614837    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc6k5\" (UniqueName: \"kubernetes.io/projected/704efc2f-fb1e-42ae-9532-5f578ee4b887-kube-api-access-wc6k5\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.615012 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.614878    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/704efc2f-fb1e-42ae-9532-5f578ee4b887-proc\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.615012 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.614920    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/704efc2f-fb1e-42ae-9532-5f578ee4b887-podres\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.615012 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.614959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/704efc2f-fb1e-42ae-9532-5f578ee4b887-sys\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.615012 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.615007    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/704efc2f-fb1e-42ae-9532-5f578ee4b887-sys\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.615012 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.614964    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/704efc2f-fb1e-42ae-9532-5f578ee4b887-proc\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.615276 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.614922    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/704efc2f-fb1e-42ae-9532-5f578ee4b887-lib-modules\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.623210 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.623170    2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc6k5\" (UniqueName: \"kubernetes.io/projected/704efc2f-fb1e-42ae-9532-5f578ee4b887-kube-api-access-wc6k5\") pod \"perf-node-gather-daemonset-8qqtt\" (UID: \"704efc2f-fb1e-42ae-9532-5f578ee4b887\") " pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.766440 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.766340    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:54:59.900922 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:54:59.900898    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"]
Jul 07 22:54:59.903037 ip-10-0-128-229 kubenswrapper[2561]: W0707 22:54:59.903012    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod704efc2f_fb1e_42ae_9532_5f578ee4b887.slice/crio-63cdc113dce3a16a30178303f566a50cc0ad9bba112be86d7a2de9bf0dbf4f7f WatchSource:0}: Error finding container 63cdc113dce3a16a30178303f566a50cc0ad9bba112be86d7a2de9bf0dbf4f7f: Status 404 returned error can't find the container with id 63cdc113dce3a16a30178303f566a50cc0ad9bba112be86d7a2de9bf0dbf4f7f
Jul 07 22:55:00.187417 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:00.187388    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-rz57s_f05a84bd-4955-4220-a74f-ffb343e48d0c/download-server/0.log"
Jul 07 22:55:00.795098 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:00.795060    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-snwkk_44656a98-ae77-4ed7-a2ee-aa6bb9af1437/volume-data-source-validator/0.log"
Jul 07 22:55:00.885282 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:00.885238    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt" event={"ID":"704efc2f-fb1e-42ae-9532-5f578ee4b887","Type":"ContainerStarted","Data":"44f467b8b469b85222e1f5e9f35a41fefedbdbf5f413b64d489689011e9cd306"}
Jul 07 22:55:00.885473 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:00.885298    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt" event={"ID":"704efc2f-fb1e-42ae-9532-5f578ee4b887","Type":"ContainerStarted","Data":"63cdc113dce3a16a30178303f566a50cc0ad9bba112be86d7a2de9bf0dbf4f7f"}
Jul 07 22:55:00.885473 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:00.885407    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:55:00.902594 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:00.902543    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt" podStartSLOduration=1.9025256769999999 podStartE2EDuration="1.902525677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 22:54:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 22:55:00.901414809 +0000 UTC m=+2440.217552244" watchObservedRunningTime="2026-07-07 22:55:00.902525677 +0000 UTC m=+2440.218663102"
Jul 07 22:55:01.832765 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:01.832699    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8bg8x_5ae33a4a-0bdb-4f0e-9a86-221c82e0e066/dns/0.log"
Jul 07 22:55:01.854988 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:01.854958    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8bg8x_5ae33a4a-0bdb-4f0e-9a86-221c82e0e066/kube-rbac-proxy/0.log"
Jul 07 22:55:01.973314 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:01.973281    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z9j2z_6cb3a312-1e9b-4d3d-899c-732658e9719e/dns-node-resolver/0.log"
Jul 07 22:55:02.535058 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:02.535014    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-gqdwk_9f07fbbf-a565-4d75-8c14-0231b9d78467/node-ca/0.log"
Jul 07 22:55:03.554481 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:03.554447    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4v94rh_17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb/istio-proxy/0.log"
Jul 07 22:55:03.748706 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:03.748678    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xc84c_9b6a4a1d-06a2-45d1-bde0-558a2e03fd86/istio-proxy/0.log"
Jul 07 22:55:03.776280 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:03.776247    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xc84c_9b6a4a1d-06a2-45d1-bde0-558a2e03fd86/istio-proxy/1.log"
Jul 07 22:55:03.878029 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:03.877946    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b8948f45-trjld_b578bb6c-1572-4342-be6c-d10f04301077/router/0.log"
Jul 07 22:55:04.555182 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:04.555144    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4889x_711e34a9-0496-4aa9-a5be-b178510ec995/serve-healthcheck-canary/0.log"
Jul 07 22:55:05.068360 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:05.068324    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-xrff4_e7952286-be37-4657-a639-fd1d0e0fd54f/insights-operator/0.log"
Jul 07 22:55:05.069274 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:05.069258    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-xrff4_e7952286-be37-4657-a639-fd1d0e0fd54f/insights-operator/1.log"
Jul 07 22:55:05.238111 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:05.238080    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzlpx_3775aa4f-886b-4e99-a63f-ff6930e1f560/kube-rbac-proxy/0.log"
Jul 07 22:55:05.260402 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:05.260376    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzlpx_3775aa4f-886b-4e99-a63f-ff6930e1f560/exporter/0.log"
Jul 07 22:55:05.284704 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:05.284677    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzlpx_3775aa4f-886b-4e99-a63f-ff6930e1f560/extractor/0.log"
Jul 07 22:55:06.900709 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:06.900683    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xs5cp/perf-node-gather-daemonset-8qqtt"
Jul 07 22:55:07.677499 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:07.677472    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724390-dm7b8_7be6eff1-e84d-4fb2-bfae-e846254cb294/cleanup/0.log"
Jul 07 22:55:07.706282 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:07.706248    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724405-4rx5w_6c3f3830-7ba3-4a0c-a7c9-645c55644e67/cleanup/0.log"
Jul 07 22:55:08.091979 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:08.091942    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch_cb80a9b1-862f-4002-a2a5-2ad302b2f969/manager/0.log"
Jul 07 22:55:08.110379 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:08.110357    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b6cfc4c4c-n2bch_cb80a9b1-862f-4002-a2a5-2ad302b2f969/copy-manifests/0.log"
Jul 07 22:55:09.436877 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:09.436846    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f8cffc658-ntkcf_a371edff-1295-47da-b38b-0fc4d80e8fd3/manager/0.log"
Jul 07 22:55:09.715722 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:09.715638    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4v94rh_17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb/istio-proxy/0.log"
Jul 07 22:55:09.879057 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:09.879020    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xc84c_9b6a4a1d-06a2-45d1-bde0-558a2e03fd86/istio-proxy/0.log"
Jul 07 22:55:09.906300 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:09.906243    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xc84c_9b6a4a1d-06a2-45d1-bde0-558a2e03fd86/istio-proxy/1.log"
Jul 07 22:55:09.980463 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:09.980440    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b8948f45-trjld_b578bb6c-1572-4342-be6c-d10f04301077/router/0.log"
Jul 07 22:55:11.209017 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:11.208982    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4v94rh_17e71e04-0db5-42a8-a9a6-acf5d7a8f6fb/istio-proxy/0.log"
Jul 07 22:55:11.362523 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:11.362490    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xc84c_9b6a4a1d-06a2-45d1-bde0-558a2e03fd86/istio-proxy/0.log"
Jul 07 22:55:11.394759 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:11.394718    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-xc84c_9b6a4a1d-06a2-45d1-bde0-558a2e03fd86/istio-proxy/1.log"
Jul 07 22:55:11.469160 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:11.469041    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74b8948f45-trjld_b578bb6c-1572-4342-be6c-d10f04301077/router/0.log"
Jul 07 22:55:14.589408 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:14.589373    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-pdg4x_504958b6-3b25-47af-bebc-db979abb7c92/migrator/0.log"
Jul 07 22:55:14.612015 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:14.611986    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-pdg4x_504958b6-3b25-47af-bebc-db979abb7c92/graceful-termination/0.log"
Jul 07 22:55:14.955881 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:14.955844    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-hfw45_42aea693-6e1b-4430-85b7-7f93340ca882/kube-storage-version-migrator-operator/1.log"
Jul 07 22:55:14.956973 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:14.956952    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-hfw45_42aea693-6e1b-4430-85b7-7f93340ca882/kube-storage-version-migrator-operator/0.log"
Jul 07 22:55:16.249257 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:16.249226    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r4qhq_d0b88798-8527-4a73-a88f-df113df09d6a/kube-multus-additional-cni-plugins/0.log"
Jul 07 22:55:16.270633 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:16.270599    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r4qhq_d0b88798-8527-4a73-a88f-df113df09d6a/egress-router-binary-copy/0.log"
Jul 07 22:55:16.290883 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:16.290857    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r4qhq_d0b88798-8527-4a73-a88f-df113df09d6a/cni-plugins/0.log"
Jul 07 22:55:16.310696 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:16.310673    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r4qhq_d0b88798-8527-4a73-a88f-df113df09d6a/bond-cni-plugin/0.log"
Jul 07 22:55:16.330677 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:16.330651    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r4qhq_d0b88798-8527-4a73-a88f-df113df09d6a/routeoverride-cni/0.log"
Jul 07 22:55:16.351800 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:16.351777    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r4qhq_d0b88798-8527-4a73-a88f-df113df09d6a/whereabouts-cni-bincopy/0.log"
Jul 07 22:55:16.373093 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:16.373067    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r4qhq_d0b88798-8527-4a73-a88f-df113df09d6a/whereabouts-cni/0.log"
Jul 07 22:55:16.433648 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:16.433614    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v67vf_7626485b-4b41-4706-8663-12bd5ef5bffd/kube-multus/0.log"
Jul 07 22:55:16.550255 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:16.550162    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m7pwq_49442a39-eb53-419a-a05d-209c81bba22e/network-metrics-daemon/0.log"
Jul 07 22:55:16.571879 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:16.571843    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-m7pwq_49442a39-eb53-419a-a05d-209c81bba22e/kube-rbac-proxy/0.log"
Jul 07 22:55:17.429790 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:17.429695    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjkqk_e23add91-9559-44af-8220-1a3b0956e7ef/ovn-controller/0.log"
Jul 07 22:55:17.449053 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:17.449025    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjkqk_e23add91-9559-44af-8220-1a3b0956e7ef/ovn-acl-logging/0.log"
Jul 07 22:55:17.474303 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:17.474271    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjkqk_e23add91-9559-44af-8220-1a3b0956e7ef/kube-rbac-proxy-node/0.log"
Jul 07 22:55:17.496311 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:17.496279    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjkqk_e23add91-9559-44af-8220-1a3b0956e7ef/kube-rbac-proxy-ovn-metrics/0.log"
Jul 07 22:55:17.516361 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:17.516332    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjkqk_e23add91-9559-44af-8220-1a3b0956e7ef/northd/0.log"
Jul 07 22:55:17.538533 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:17.538504    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjkqk_e23add91-9559-44af-8220-1a3b0956e7ef/nbdb/0.log"
Jul 07 22:55:17.564991 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:17.564963    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjkqk_e23add91-9559-44af-8220-1a3b0956e7ef/sbdb/0.log"
Jul 07 22:55:17.618644 ip-10-0-128-229 kubenswrapper[2561]: I0707 22:55:17.618608    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hjkqk_e23add91-9559-44af-8220-1a3b0956e7ef/ovnkube-controller/0.log"